[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:14:09.949761  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:41123
I20260709 13:14:09.951463  9147 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:14:09.952492  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:09.968056  9154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.968791  9153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:09.971045  9156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:09.971024  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:11.159837  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.160099  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.160377  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602851160340 us; error 0 us; skew 500 ppm
I20260709 13:14:11.161235  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.167956  9147 webserver.cc:533] Webserver started at http://127.8.238.254:33611/ using document root <none> and password file <none>
I20260709 13:14:11.168917  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.169167  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.169746  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.176133  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "701bc245728744598b2d9486b41cb69c"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.184456  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:14:11.190047  9162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.191439  9147 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:14:11.191808  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "701bc245728744598b2d9486b41cb69c"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.192130  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.243391  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.244963  9147 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:14:11.245389  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.320099  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:41123
I20260709 13:14:11.320184  9213 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:41123 every 8 connection(s)
I20260709 13:14:11.328536  9214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.352193  9214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c: Bootstrap starting.
I20260709 13:14:11.358201  9214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.360270  9214 log.cc:826] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c: Log is configured to *not* fsync() on all Append() calls
I20260709 13:14:11.365159  9214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c: No bootstrap required, opened a new log
I20260709 13:14:11.386373  9214 raft_consensus.cc:359] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701bc245728744598b2d9486b41cb69c" member_type: VOTER }
I20260709 13:14:11.386960  9214 raft_consensus.cc:385] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.387240  9214 raft_consensus.cc:740] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 701bc245728744598b2d9486b41cb69c, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.388197  9214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701bc245728744598b2d9486b41cb69c" member_type: VOTER }
I20260709 13:14:11.388762  9214 raft_consensus.cc:399] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:11.389067  9214 raft_consensus.cc:493] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:11.389432  9214 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.393697  9214 raft_consensus.cc:515] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701bc245728744598b2d9486b41cb69c" member_type: VOTER }
I20260709 13:14:11.394568  9214 leader_election.cc:304] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 701bc245728744598b2d9486b41cb69c; no voters: 
I20260709 13:14:11.396330  9214 leader_election.cc:290] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:11.396750  9217 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.399168  9217 raft_consensus.cc:697] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 1 LEADER]: Becoming Leader. State: Replica: 701bc245728744598b2d9486b41cb69c, State: Running, Role: LEADER
I20260709 13:14:11.400266  9217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701bc245728744598b2d9486b41cb69c" member_type: VOTER }
I20260709 13:14:11.401338  9214 sys_catalog.cc:565] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:11.413369  9218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "701bc245728744598b2d9486b41cb69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701bc245728744598b2d9486b41cb69c" member_type: VOTER } }
I20260709 13:14:11.414728  9219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 701bc245728744598b2d9486b41cb69c. Latest consensus state: current_term: 1 leader_uuid: "701bc245728744598b2d9486b41cb69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "701bc245728744598b2d9486b41cb69c" member_type: VOTER } }
I20260709 13:14:11.415520  9219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:11.415598  9218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:11.418094  9227 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:11.431820  9227 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:11.435575  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:11.449438  9227 catalog_manager.cc:1383] Generated new cluster ID: e53a0d01a7834fc18ba020c8f66e3037
I20260709 13:14:11.449776  9227 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:11.486754  9227 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:11.488389  9227 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:11.502563  9227 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c: Generated new TSK 0
I20260709 13:14:11.503638  9227 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:11.567493  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.577664  9236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.579210  9237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.583700  9147 server_base.cc:1061] running on GCE node
W20260709 13:14:11.584059  9239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.585202  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.585495  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.585706  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602851585687 us; error 0 us; skew 500 ppm
I20260709 13:14:11.586611  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.590948  9147 webserver.cc:533] Webserver started at http://127.8.238.193:41359/ using document root <none> and password file <none>
I20260709 13:14:11.591692  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.591961  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.592355  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.593924  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "05d2d6227b904a19b1c856690399cc79"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.601081  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:14:11.606684  9244 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.607662  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:11.607990  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "05d2d6227b904a19b1c856690399cc79"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.608320  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.634912  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.636303  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.638702  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:11.643504  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:11.643802  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.644117  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:11.644320  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.746910  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:44773
I20260709 13:14:11.747005  9306 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:44773 every 8 connection(s)
I20260709 13:14:11.755745  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.764946  9311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.768038  9312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.773222  9147 server_base.cc:1061] running on GCE node
W20260709 13:14:11.774771  9314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.775859  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.776065  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.776302  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602851776266 us; error 0 us; skew 500 ppm
I20260709 13:14:11.776924  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.780109  9147 webserver.cc:533] Webserver started at http://127.8.238.194:35415/ using document root <none> and password file <none>
I20260709 13:14:11.780802  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.781076  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.781450  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.782958  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "1ad582eccf6b49cfb2560a192c8379fe"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.784550  9307 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41123
I20260709 13:14:11.785094  9307 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:11.786482  9307 heartbeater.cc:507] Master 127.8.238.254:41123 requested a full tablet report, sending...
I20260709 13:14:11.790468  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:11.790452  9179 ts_manager.cc:194] Registered new tserver with Master: 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773)
I20260709 13:14:11.793776  9179 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41810
I20260709 13:14:11.795651  9319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.796691  9147 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:14:11.797019  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "1ad582eccf6b49cfb2560a192c8379fe"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.797335  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.818404  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.819720  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.821862  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:11.825238  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:11.825491  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.825747  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:11.825924  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.927078  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:45969
I20260709 13:14:11.927214  9381 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:45969 every 8 connection(s)
I20260709 13:14:11.941929  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.950709  9385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.954089  9386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.959187  9382 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41123
I20260709 13:14:11.959852  9382 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:11.961527  9382 heartbeater.cc:507] Master 127.8.238.254:41123 requested a full tablet report, sending...
I20260709 13:14:11.962018  9147 server_base.cc:1061] running on GCE node
W20260709 13:14:11.963613  9388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.964416  9179 ts_manager.cc:194] Registered new tserver with Master: 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:11.964753  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.965092  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.965299  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602851965281 us; error 0 us; skew 500 ppm
I20260709 13:14:11.965934  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.966280  9179 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41812
I20260709 13:14:11.969640  9147 webserver.cc:533] Webserver started at http://127.8.238.195:41445/ using document root <none> and password file <none>
I20260709 13:14:11.970220  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.970525  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.970814  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.971935  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "f329b189765449c59969cf6c9fb72ca6"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.977200  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:11.981101  9393 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.981982  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:11.982359  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "f329b189765449c59969cf6c9fb72ca6"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-ml7r"
I20260709 13:14:11.982679  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:12.003664  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:12.005144  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:12.006857  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:12.009262  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:12.009475  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.009810  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:12.009976  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.106580  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:33737
I20260709 13:14:12.107136  9455 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:33737 every 8 connection(s)
I20260709 13:14:12.125389  9456 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41123
I20260709 13:14:12.126065  9456 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:12.127153  9456 heartbeater.cc:507] Master 127.8.238.254:41123 requested a full tablet report, sending...
I20260709 13:14:12.129550  9179 ts_manager.cc:194] Registered new tserver with Master: f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:12.130336  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018217088s
I20260709 13:14:12.131377  9179 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41828
I20260709 13:14:12.188308  9179 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41842:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:12.192243  9179 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:12.299362  9421 tablet_service.cc:1511] Processing CreateTablet for tablet e0a3dd532ee548ceb7a6a23858121daa (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:12.301083  9421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a3dd532ee548ceb7a6a23858121daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.301585  9419 tablet_service.cc:1511] Processing CreateTablet for tablet 3efee172ce7f4a43b709cda76880a197 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:12.299379  9420 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6acacd88724a5e8a3099a5b7408f50 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:12.304005  9420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6acacd88724a5e8a3099a5b7408f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.305727  9419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efee172ce7f4a43b709cda76880a197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.307969  9418 tablet_service.cc:1511] Processing CreateTablet for tablet c7aa1640a1d34bd1a4861dce2d6c1bca (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:12.313781  9418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7aa1640a1d34bd1a4861dce2d6c1bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.315021  9417 tablet_service.cc:1511] Processing CreateTablet for tablet ae882a7be7d7481a8ce55954f76c0887 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:12.318117  9417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae882a7be7d7481a8ce55954f76c0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.338805  9416 tablet_service.cc:1511] Processing CreateTablet for tablet 96ae388c826b4e97b30e6b5892b4acd6 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:12.342195  9269 tablet_service.cc:1511] Processing CreateTablet for tablet c7aa1640a1d34bd1a4861dce2d6c1bca (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:12.341288  9271 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6acacd88724a5e8a3099a5b7408f50 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:12.343618  9270 tablet_service.cc:1511] Processing CreateTablet for tablet 3efee172ce7f4a43b709cda76880a197 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:12.352833  9271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6acacd88724a5e8a3099a5b7408f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.349548  9272 tablet_service.cc:1511] Processing CreateTablet for tablet e0a3dd532ee548ceb7a6a23858121daa (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:12.356115  9269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7aa1640a1d34bd1a4861dce2d6c1bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.367107  9416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ae388c826b4e97b30e6b5892b4acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.360781  9268 tablet_service.cc:1511] Processing CreateTablet for tablet ae882a7be7d7481a8ce55954f76c0887 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:12.370736  9266 tablet_service.cc:1511] Processing CreateTablet for tablet ea32c17c2ef34033ab50c4277078c8b8 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:12.372468  9267 tablet_service.cc:1511] Processing CreateTablet for tablet 96ae388c826b4e97b30e6b5892b4acd6 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:12.374168  9272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a3dd532ee548ceb7a6a23858121daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.376086  9268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae882a7be7d7481a8ce55954f76c0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.383261  9267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ae388c826b4e97b30e6b5892b4acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.390599  9266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea32c17c2ef34033ab50c4277078c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.388864  9265 tablet_service.cc:1511] Processing CreateTablet for tablet 704537f5ace74488a0c8e330a0626381 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:12.394934  9415 tablet_service.cc:1511] Processing CreateTablet for tablet ea32c17c2ef34033ab50c4277078c8b8 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:12.401475  9270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efee172ce7f4a43b709cda76880a197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.407927  9415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea32c17c2ef34033ab50c4277078c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.408766  9265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704537f5ace74488a0c8e330a0626381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.432574  9414 tablet_service.cc:1511] Processing CreateTablet for tablet 704537f5ace74488a0c8e330a0626381 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:12.437199  9264 tablet_service.cc:1511] Processing CreateTablet for tablet 771157be0d5344c697c8a70cb6d065d7 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:14:12.443573  9226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:12.444307  9264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771157be0d5344c697c8a70cb6d065d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.445912  9414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704537f5ace74488a0c8e330a0626381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.450338  9474 tablet_bootstrap.cc:492] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:12.468374  9417 tablet_service.cc:1511] Processing CreateTablet for tablet 771157be0d5344c697c8a70cb6d065d7 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:12.469688  9417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771157be0d5344c697c8a70cb6d065d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.502899  9347 tablet_service.cc:1511] Processing CreateTablet for tablet e0a3dd532ee548ceb7a6a23858121daa (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:12.502475  9346 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6acacd88724a5e8a3099a5b7408f50 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:12.503605  9345 tablet_service.cc:1511] Processing CreateTablet for tablet 3efee172ce7f4a43b709cda76880a197 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:12.522185  9343 tablet_service.cc:1511] Processing CreateTablet for tablet ae882a7be7d7481a8ce55954f76c0887 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:12.515127  9344 tablet_service.cc:1511] Processing CreateTablet for tablet c7aa1640a1d34bd1a4861dce2d6c1bca (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:12.519457  9347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0a3dd532ee548ceb7a6a23858121daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.527169  9475 tablet_bootstrap.cc:492] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:12.531687  9342 tablet_service.cc:1511] Processing CreateTablet for tablet 96ae388c826b4e97b30e6b5892b4acd6 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:12.535300  9341 tablet_service.cc:1511] Processing CreateTablet for tablet ea32c17c2ef34033ab50c4277078c8b8 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:12.540815  9346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6acacd88724a5e8a3099a5b7408f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.546159  9340 tablet_service.cc:1511] Processing CreateTablet for tablet 704537f5ace74488a0c8e330a0626381 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:12.551285  9341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea32c17c2ef34033ab50c4277078c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.553674  9339 tablet_service.cc:1511] Processing CreateTablet for tablet 771157be0d5344c697c8a70cb6d065d7 (DEFAULT_TABLE table=test-workload [id=5cea81c284f94ad894274890f89d4633]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:12.568732  9344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7aa1640a1d34bd1a4861dce2d6c1bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.570309  9339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771157be0d5344c697c8a70cb6d065d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.581275  9345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efee172ce7f4a43b709cda76880a197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.588868  9342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ae388c826b4e97b30e6b5892b4acd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.593020  9340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704537f5ace74488a0c8e330a0626381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.609688  9474 tablet_bootstrap.cc:654] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.610863  9343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae882a7be7d7481a8ce55954f76c0887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.620761  9475 tablet_bootstrap.cc:654] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.679121  9476 tablet_bootstrap.cc:492] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:12.681377  9474 tablet_bootstrap.cc:492] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:12.681905  9474 ts_tablet_manager.cc:1403] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.248s	user 0.019s	sys 0.014s
I20260709 13:14:12.686098  9474 raft_consensus.cc:359] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.687513  9474 raft_consensus.cc:385] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.687860  9474 raft_consensus.cc:740] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.689574  9474 consensus_queue.cc:260] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.691061  9476 tablet_bootstrap.cc:654] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.691978  9475 tablet_bootstrap.cc:492] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:12.692622  9475 ts_tablet_manager.cc:1403] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.010s
I20260709 13:14:12.696624  9475 raft_consensus.cc:359] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:12.697398  9475 raft_consensus.cc:385] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.697693  9475 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.698480  9475 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:12.704280  9474 ts_tablet_manager.cc:1434] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:14:12.704592  9456 heartbeater.cc:499] Master 127.8.238.254:41123 was elected leader, sending a full tablet report...
I20260709 13:14:12.705492  9474 tablet_bootstrap.cc:492] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:12.713806  9474 tablet_bootstrap.cc:654] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.725466  9476 tablet_bootstrap.cc:492] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:12.725936  9476 ts_tablet_manager.cc:1403] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.012s
I20260709 13:14:12.726958  9474 tablet_bootstrap.cc:492] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:12.727487  9474 ts_tablet_manager.cc:1403] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:14:12.728116  9475 ts_tablet_manager.cc:1434] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.024s
I20260709 13:14:12.728863  9307 heartbeater.cc:499] Master 127.8.238.254:41123 was elected leader, sending a full tablet report...
I20260709 13:14:12.729326  9475 tablet_bootstrap.cc:492] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:12.729403  9476 raft_consensus.cc:359] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.730268  9476 raft_consensus.cc:385] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.730592  9476 raft_consensus.cc:740] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.731382  9476 consensus_queue.cc:260] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.735409  9474 raft_consensus.cc:359] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:12.736475  9474 raft_consensus.cc:385] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.736861  9474 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.737701  9474 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:12.740533  9474 ts_tablet_manager.cc:1434] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:14:12.741920  9474 tablet_bootstrap.cc:492] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:12.738294  9475 tablet_bootstrap.cc:654] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.750527  9382 heartbeater.cc:499] Master 127.8.238.254:41123 was elected leader, sending a full tablet report...
I20260709 13:14:12.756904  9474 tablet_bootstrap.cc:654] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:12.756822  9308 tablet.cc:2406] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:12.768157  9475 tablet_bootstrap.cc:492] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:12.768656  9475 ts_tablet_manager.cc:1403] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.007s
I20260709 13:14:12.771842  9483 raft_consensus.cc:493] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.771849  9475 raft_consensus.cc:359] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.772827  9475 raft_consensus.cc:385] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.772541  9483 raft_consensus.cc:515] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.773242  9475 raft_consensus.cc:740] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.774060  9475 consensus_queue.cc:260] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.772938  9474 tablet_bootstrap.cc:492] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:12.775383  9474 ts_tablet_manager.cc:1403] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.005s
I20260709 13:14:12.774683  9476 ts_tablet_manager.cc:1434] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.048s	user 0.019s	sys 0.002s
I20260709 13:14:12.780018  9474 raft_consensus.cc:359] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.780652  9476 tablet_bootstrap.cc:492] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:12.780787  9474 raft_consensus.cc:385] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.781199  9474 raft_consensus.cc:740] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.781946  9474 consensus_queue.cc:260] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.784232  9474 ts_tablet_manager.cc:1434] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:14:12.786339  9475 ts_tablet_manager.cc:1434] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:14:12.787446  9475 tablet_bootstrap.cc:492] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:12.784469  9483 leader_election.cc:290] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:12.792739  9476 tablet_bootstrap.cc:654] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.794919  9474 tablet_bootstrap.cc:492] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:12.795432  9475 tablet_bootstrap.cc:654] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.809397  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
W20260709 13:14:12.813045  9320 leader_election.cc:343] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.817767  9474 tablet_bootstrap.cc:654] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.825232  9479 raft_consensus.cc:493] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.825820  9479 raft_consensus.cc:515] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.828960  9479 leader_election.cc:290] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:12.836416  9474 tablet_bootstrap.cc:492] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:12.836967  9474 ts_tablet_manager.cc:1403] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.011s
I20260709 13:14:12.837355  9475 tablet_bootstrap.cc:492] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:12.837898  9475 ts_tablet_manager.cc:1403] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.010s
I20260709 13:14:12.841861  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:12.842811  9474 raft_consensus.cc:359] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.843873  9474 raft_consensus.cc:385] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:14:12.843897  9321 leader_election.cc:343] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.844380  9474 raft_consensus.cc:740] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.844517  9321 leader_election.cc:304] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe; no voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:12.845937  9483 raft_consensus.cc:2749] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.845522  9474 consensus_queue.cc:260] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.848340  9474 ts_tablet_manager.cc:1434] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:14:12.849472  9474 tablet_bootstrap.cc:492] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:12.851301  9475 raft_consensus.cc:359] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.854871  9475 raft_consensus.cc:385] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.855345  9475 raft_consensus.cc:740] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.856906  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:12.857904  9475 consensus_queue.cc:260] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
W20260709 13:14:12.859416  9395 leader_election.cc:343] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.860600  9475 ts_tablet_manager.cc:1434] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:14:12.861649  9475 tablet_bootstrap.cc:492] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:12.867514  9476 tablet_bootstrap.cc:492] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:12.868172  9476 ts_tablet_manager.cc:1403] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.003s
I20260709 13:14:12.868432  9475 tablet_bootstrap.cc:654] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.871531  9476 raft_consensus.cc:359] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.872486  9476 raft_consensus.cc:385] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.872929  9476 raft_consensus.cc:740] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.873956  9476 consensus_queue.cc:260] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.876518  9474 tablet_bootstrap.cc:654] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.879596  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
I20260709 13:14:12.880331  9282 raft_consensus.cc:2468] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 0.
I20260709 13:14:12.881985  9394 leader_election.cc:304] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:12.883175  9479 raft_consensus.cc:2804] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.883522  9479 raft_consensus.cc:493] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.883833  9479 raft_consensus.cc:3060] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.884097  9476 ts_tablet_manager.cc:1434] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:12.891314  9479 raft_consensus.cc:515] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.894320  9476 tablet_bootstrap.cc:492] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:12.894541  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:12.895150  9282 raft_consensus.cc:3060] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.902782  9282 raft_consensus.cc:2468] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 1.
I20260709 13:14:12.905154  9476 tablet_bootstrap.cc:654] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.905884  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
W20260709 13:14:12.913424  9395 leader_election.cc:343] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.904219  9479 leader_election.cc:290] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:12.920086  9479 raft_consensus.cc:493] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.921345  9394 leader_election.cc:304] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:12.927781  9476 tablet_bootstrap.cc:492] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:12.928529  9476 ts_tablet_manager.cc:1403] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.006s
I20260709 13:14:12.923826  9479 raft_consensus.cc:515] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.932565  9476 raft_consensus.cc:359] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:12.934545  9476 raft_consensus.cc:385] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.934986  9476 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.936069  9476 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:12.937064  9479 leader_election.cc:290] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:12.942361  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
W20260709 13:14:12.945202  9394 leader_election.cc:343] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.938139  9496 raft_consensus.cc:493] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.940367  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
W20260709 13:14:12.947151  9395 leader_election.cc:343] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.947650  9395 leader_election.cc:304] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f329b189765449c59969cf6c9fb72ca6; no voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:12.949014  9476 ts_tablet_manager.cc:1434] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:14:12.939100  9498 raft_consensus.cc:2804] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.951086  9479 raft_consensus.cc:2749] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.948338  9496 raft_consensus.cc:515] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.955369  9474 tablet_bootstrap.cc:492] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:12.955904  9474 ts_tablet_manager.cc:1403] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.032s
I20260709 13:14:12.957361  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
I20260709 13:14:12.959050  9476 tablet_bootstrap.cc:492] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
W20260709 13:14:12.959125  9394 leader_election.cc:343] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.959486  9474 raft_consensus.cc:359] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.960254  9474 raft_consensus.cc:385] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.960497  9496 leader_election.cc:290] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:12.961725  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
W20260709 13:14:12.963369  9395 leader_election.cc:343] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.963891  9475 tablet_bootstrap.cc:492] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:12.963860  9395 leader_election.cc:304] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f329b189765449c59969cf6c9fb72ca6; no voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:12.964490  9475 ts_tablet_manager.cc:1403] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.103s	user 0.033s	sys 0.014s
I20260709 13:14:12.964884  9479 raft_consensus.cc:2749] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:12.966070  9476 tablet_bootstrap.cc:654] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.966533  9498 raft_consensus.cc:697] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:12.967424  9498 consensus_queue.cc:237] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.967598  9475 raft_consensus.cc:359] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.968417  9475 raft_consensus.cc:385] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.968732  9475 raft_consensus.cc:740] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.969568  9475 consensus_queue.cc:260] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.960556  9474 raft_consensus.cc:740] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.971933  9474 consensus_queue.cc:260] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.975073  9474 ts_tablet_manager.cc:1434] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 13:14:12.976233  9474 tablet_bootstrap.cc:492] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:12.981069  9475 ts_tablet_manager.cc:1434] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:14:12.983194  9498 raft_consensus.cc:493] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.985687  9475 tablet_bootstrap.cc:492] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:12.985237  9498 raft_consensus.cc:515] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:12.993155  9474 tablet_bootstrap.cc:654] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.995427  9498 leader_election.cc:290] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:12.996177  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
W20260709 13:14:12.997807  9394 leader_election.cc:343] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.997915  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:12.998814  9357 raft_consensus.cc:2468] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 0.
I20260709 13:14:13.000523  9476 tablet_bootstrap.cc:492] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:13.000762  9395 leader_election.cc:304] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:12.998153  9475 tablet_bootstrap.cc:654] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.001219  9476 ts_tablet_manager.cc:1403] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.007s
I20260709 13:14:13.002345  9498 raft_consensus.cc:2804] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.002955  9498 raft_consensus.cc:493] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.003494  9498 raft_consensus.cc:3060] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.004804  9476 raft_consensus.cc:359] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.005744  9476 raft_consensus.cc:385] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.006155  9476 raft_consensus.cc:740] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.007229  9476 consensus_queue.cc:260] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.010492  9476 ts_tablet_manager.cc:1434] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:13.012028  9476 tablet_bootstrap.cc:492] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:13.012913  9498 raft_consensus.cc:515] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.017936  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:13.018719  9475 tablet_bootstrap.cc:492] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:13.019239  9475 ts_tablet_manager.cc:1403] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.007s
I20260709 13:14:13.020972  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
W20260709 13:14:13.021580  9394 leader_election.cc:343] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.021929  9357 raft_consensus.cc:3060] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.019626  9176 catalog_manager.cc:5697] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.024503  9476 tablet_bootstrap.cc:654] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.020264  9498 leader_election.cc:290] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:13.034595  9357 raft_consensus.cc:2468] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 1.
I20260709 13:14:13.035171  9475 raft_consensus.cc:359] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.036460  9475 raft_consensus.cc:385] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.036903  9475 raft_consensus.cc:740] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.036782  9395 leader_election.cc:304] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:13.037914  9474 tablet_bootstrap.cc:492] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:13.038553  9474 ts_tablet_manager.cc:1403] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.011s
I20260709 13:14:13.037925  9475 consensus_queue.cc:260] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.040591  9475 ts_tablet_manager.cc:1434] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:13.042901  9483 raft_consensus.cc:493] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.043437  9483 raft_consensus.cc:515] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:13.043962  9474 raft_consensus.cc:359] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.044754  9474 raft_consensus.cc:385] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.045115  9474 raft_consensus.cc:740] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.045610  9483 leader_election.cc:290] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737), 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773)
I20260709 13:14:13.047359  9475 tablet_bootstrap.cc:492] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:13.048738  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.049647  9431 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 0.
I20260709 13:14:13.047057  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
I20260709 13:14:13.045971  9474 consensus_queue.cc:260] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.051137  9282 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 0.
I20260709 13:14:13.052022  9499 raft_consensus.cc:2804] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.052556  9499 raft_consensus.cc:697] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:13.052764  9320 leader_election.cc:304] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:13.053436  9499 consensus_queue.cc:237] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.054642  9474 ts_tablet_manager.cc:1434] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:14:13.055678  9474 tablet_bootstrap.cc:492] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:13.058506  9483 raft_consensus.cc:2804] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.058916  9483 raft_consensus.cc:493] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.059250  9483 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.065948  9474 tablet_bootstrap.cc:654] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.067157  9483 raft_consensus.cc:515] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:13.067955  9480 raft_consensus.cc:493] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.068555  9480 raft_consensus.cc:515] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.074800  9480 leader_election.cc:290] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.080719  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.081444  9431 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.090474  9431 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 1.
I20260709 13:14:13.091333  9474 tablet_bootstrap.cc:492] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:13.091979  9474 ts_tablet_manager.cc:1403] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.016s
I20260709 13:14:13.091897  9321 leader_election.cc:304] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:13.095422  9512 raft_consensus.cc:2804] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.096035  9474 raft_consensus.cc:359] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.096928  9474 raft_consensus.cc:385] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.097250  9474 raft_consensus.cc:740] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.096514  9483 leader_election.cc:290] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Requested vote from peers f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737), 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773)
I20260709 13:14:13.097846  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:13.099464  9282 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.103817  9475 tablet_bootstrap.cc:654] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.107818  9512 raft_consensus.cc:697] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:13.105584  9474 consensus_queue.cc:260] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.113826  9474 ts_tablet_manager.cc:1434] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:14:13.114871  9474 tablet_bootstrap.cc:492] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:13.130980  9282 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 1.
I20260709 13:14:13.113198  9512 consensus_queue.cc:237] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:13.132543  9476 tablet_bootstrap.cc:492] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:13.133167  9476 ts_tablet_manager.cc:1403] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.022s
I20260709 13:14:13.143263  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:13.136504  9476 raft_consensus.cc:359] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.144176  9476 raft_consensus.cc:385] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.144778  9476 raft_consensus.cc:740] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.144213  9357 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.145857  9476 consensus_queue.cc:260] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.147243  9246 leader_election.cc:304] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:13.149278  9480 raft_consensus.cc:2804] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.149672  9480 raft_consensus.cc:493] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.150023  9480 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.146927  9474 tablet_bootstrap.cc:654] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.151594  9476 ts_tablet_manager.cc:1434] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:14:13.157847  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.158953  9431 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.156394  9476 tablet_bootstrap.cc:492] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:13.169574  9176 catalog_manager.cc:5697] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 0 to 1, leader changed from <none> to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.181960  9480 raft_consensus.cc:515] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.184273  9480 leader_election.cc:290] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.187785  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.188419  9431 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.188549  9474 tablet_bootstrap.cc:492] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:13.188584  9475 tablet_bootstrap.cc:492] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:13.189128  9474 ts_tablet_manager.cc:1403] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.010s
I20260709 13:14:13.189231  9475 ts_tablet_manager.cc:1403] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.036s
I20260709 13:14:13.191236  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:13.191818  9357 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.191992  9474 raft_consensus.cc:359] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.192689  9474 raft_consensus.cc:385] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.192469  9475 raft_consensus.cc:359] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.193120  9474 raft_consensus.cc:740] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.193217  9475 raft_consensus.cc:385] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.193574  9475 raft_consensus.cc:740] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.193858  9474 consensus_queue.cc:260] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.194351  9475 consensus_queue.cc:260] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.194677  9177 catalog_manager.cc:5697] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.197384  9475 ts_tablet_manager.cc:1434] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:14:13.202857  9475 tablet_bootstrap.cc:492] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:13.203120  9474 ts_tablet_manager.cc:1434] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:14:13.204015  9474 tablet_bootstrap.cc:492] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6: Bootstrap starting.
I20260709 13:14:13.204931  9476 tablet_bootstrap.cc:654] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.209302  9431 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.210810  9474 tablet_bootstrap.cc:654] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.211189  9246 leader_election.cc:304] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:13.213260  9480 raft_consensus.cc:2804] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.219512  9357 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.232921  9480 raft_consensus.cc:697] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:13.233960  9480 consensus_queue.cc:237] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.234975  9476 tablet_bootstrap.cc:492] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:13.235836  9475 tablet_bootstrap.cc:654] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.235502  9476 ts_tablet_manager.cc:1403] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.006s
I20260709 13:14:13.242278  9476 raft_consensus.cc:359] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.243058  9476 raft_consensus.cc:385] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.243391  9476 raft_consensus.cc:740] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.244388  9476 consensus_queue.cc:260] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.248382  9476 ts_tablet_manager.cc:1434] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:14:13.249321  9475 tablet_bootstrap.cc:492] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:13.249428  9476 tablet_bootstrap.cc:492] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:13.249883  9475 ts_tablet_manager.cc:1403] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.004s
I20260709 13:14:13.256601  9474 tablet_bootstrap.cc:492] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6: No bootstrap required, opened a new log
I20260709 13:14:13.257035  9474 ts_tablet_manager.cc:1403] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.000s
I20260709 13:14:13.258538  9512 raft_consensus.cc:493] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.253031  9475 raft_consensus.cc:359] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.264848  9475 raft_consensus.cc:385] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.265241  9475 raft_consensus.cc:740] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.264761  9512 raft_consensus.cc:515] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.266376  9474 raft_consensus.cc:359] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.267220  9474 raft_consensus.cc:385] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.267578  9474 raft_consensus.cc:740] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.274791  9177 catalog_manager.cc:5697] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.278028  9474 consensus_queue.cc:260] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.280407  9474 ts_tablet_manager.cc:1434] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:14:13.281379  9475 consensus_queue.cc:260] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.282811  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
I20260709 13:14:13.274096  9476 tablet_bootstrap.cc:654] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:13.284441  9320 leader_election.cc:343] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.283965  9475 ts_tablet_manager.cc:1434] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:14:13.289345  9512 leader_election.cc:290] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.290583  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.291337  9476 tablet_bootstrap.cc:492] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:13.291287  9431 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 0.
I20260709 13:14:13.291880  9476 ts_tablet_manager.cc:1403] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.001s
I20260709 13:14:13.292577  9475 tablet_bootstrap.cc:492] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:13.292750  9321 leader_election.cc:304] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:13.293926  9512 raft_consensus.cc:2804] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.294341  9512 raft_consensus.cc:493] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.294685  9512 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.302708  9512 raft_consensus.cc:515] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.305778  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:13.306066  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.305776  9476 raft_consensus.cc:359] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.306658  9431 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:13.307471  9320 leader_election.cc:343] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.306780  9475 tablet_bootstrap.cc:654] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.306658  9476 raft_consensus.cc:385] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.312706  9476 raft_consensus.cc:740] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.313583  9431 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 1.
I20260709 13:14:13.313514  9476 consensus_queue.cc:260] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.314886  9321 leader_election.cc:304] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:13.315794  9476 ts_tablet_manager.cc:1434] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:14:13.315960  9513 raft_consensus.cc:2804] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.316506  9513 raft_consensus.cc:697] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:13.317193  9476 tablet_bootstrap.cc:492] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:13.317386  9513 consensus_queue.cc:237] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.318585  9475 tablet_bootstrap.cc:492] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:13.319106  9475 ts_tablet_manager.cc:1403] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.006s
I20260709 13:14:13.321981  9475 raft_consensus.cc:359] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.322875  9475 raft_consensus.cc:385] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.323227  9475 raft_consensus.cc:740] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.324070  9475 consensus_queue.cc:260] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.324399  9476 tablet_bootstrap.cc:654] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.327796  9512 leader_election.cc:290] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.330633  9475 ts_tablet_manager.cc:1434] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:14:13.339723  9480 raft_consensus.cc:493] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.340541  9480 raft_consensus.cc:515] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.342799  9480 leader_election.cc:290] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.343626  9476 tablet_bootstrap.cc:492] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:13.342906  9177 catalog_manager.cc:5697] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.344165  9475 tablet_bootstrap.cc:492] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79: Bootstrap starting.
I20260709 13:14:13.344632  9476 ts_tablet_manager.cc:1403] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.003s
I20260709 13:14:13.346472  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
W20260709 13:14:13.349392  9395 consensus_peers.cc:597] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 -> Peer 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969): Couldn't send request to peer 1ad582eccf6b49cfb2560a192c8379fe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.349565  9476 raft_consensus.cc:359] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.350353  9476 raft_consensus.cc:385] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.350630  9476 raft_consensus.cc:740] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.352327  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.353157  9513 raft_consensus.cc:493] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.353646  9513 raft_consensus.cc:515] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.356316  9475 tablet_bootstrap.cc:654] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.359678  9480 raft_consensus.cc:493] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.360175  9480 raft_consensus.cc:515] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.360471  9499 consensus_queue.cc:1048] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.362318  9480 leader_election.cc:290] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.363240  9356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:13.363919  9356 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.363926  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.365554  9430 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.355396  9431 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.369154  9246 leader_election.cc:304] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:13.370066  9281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
I20260709 13:14:13.370679  9480 raft_consensus.cc:2804] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.371328  9281 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 0.
I20260709 13:14:13.371835  9246 leader_election.cc:304] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:13.372890  9320 leader_election.cc:304] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:13.373613  9480 raft_consensus.cc:493] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.373935  9518 raft_consensus.cc:2804] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.374204  9480 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.374418  9518 raft_consensus.cc:493] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.374843  9518 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.382563  9518 raft_consensus.cc:515] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.383487  9512 raft_consensus.cc:2804] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.385396  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.391103  9356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:13.394179  9431 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 0.
I20260709 13:14:13.385890  9513 leader_election.cc:290] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.397313  9518 leader_election.cc:290] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.397998  9518 raft_consensus.cc:493] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.398530  9512 raft_consensus.cc:493] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.399473  9512 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.399833  9476 consensus_queue.cc:260] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.402702  9357 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.406049  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.407022  9431 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.412214  9480 raft_consensus.cc:515] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.416630  9518 raft_consensus.cc:515] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.417150  9475 tablet_bootstrap.cc:492] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79: No bootstrap required, opened a new log
I20260709 13:14:13.422895  9475 ts_tablet_manager.cc:1403] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79: Time spent bootstrapping tablet: real 0.091s	user 0.029s	sys 0.032s
I20260709 13:14:13.424055  9480 leader_election.cc:290] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.426607  9475 raft_consensus.cc:359] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.427650  9475 raft_consensus.cc:385] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.427994  9475 raft_consensus.cc:740] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.428824  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:13.430213  9431 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.430943  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.421759  9512 raft_consensus.cc:515] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.429219  9475 consensus_queue.cc:260] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.431528  9430 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.432458  9357 raft_consensus.cc:2393] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 05d2d6227b904a19b1c856690399cc79 in current term 1: Already voted for candidate 1ad582eccf6b49cfb2560a192c8379fe in this term.
I20260709 13:14:13.432863  9475 ts_tablet_manager.cc:1434] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:14:13.434444  9480 raft_consensus.cc:493] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.434928  9480 raft_consensus.cc:515] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.438066  9512 leader_election.cc:290] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.439131  9281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:13.439975  9281 raft_consensus.cc:2393] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ad582eccf6b49cfb2560a192c8379fe in current term 1: Already voted for candidate 05d2d6227b904a19b1c856690399cc79 in this term.
I20260709 13:14:13.441660  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.442763  9518 leader_election.cc:290] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.443181  9321 leader_election.cc:304] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe; no voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6
W20260709 13:14:13.447624  9226 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:13.448833  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:13.449262  9430 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.450546  9356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:13.449640  9357 raft_consensus.cc:2468] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.448932  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.418500  9476 ts_tablet_manager.cc:1434] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:14:13.450006  9246 leader_election.cc:304] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:13.453418  9480 leader_election.cc:290] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.455361  9518 raft_consensus.cc:2804] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.459143  9518 raft_consensus.cc:697] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:13.460093  9518 consensus_queue.cc:237] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.461879  9512 raft_consensus.cc:2749] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.453697  9431 raft_consensus.cc:2468] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.457260  9246 leader_election.cc:304] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:13.456630  9476 tablet_bootstrap.cc:492] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe: Bootstrap starting.
I20260709 13:14:13.470526  9518 raft_consensus.cc:2804] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.470960  9518 raft_consensus.cc:493] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.471323  9518 raft_consensus.cc:3060] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.471658  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.472543  9431 raft_consensus.cc:2393] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05d2d6227b904a19b1c856690399cc79 in current term 1: Already voted for candidate 1ad582eccf6b49cfb2560a192c8379fe in this term.
I20260709 13:14:13.475370  9476 tablet_bootstrap.cc:654] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.478168  9246 leader_election.cc:304] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:13.479056  9480 raft_consensus.cc:2804] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.479708  9480 raft_consensus.cc:697] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:13.479969  9246 leader_election.cc:304] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79; no voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:13.480753  9528 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.484544  9476 tablet_bootstrap.cc:492] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe: No bootstrap required, opened a new log
I20260709 13:14:13.485059  9476 ts_tablet_manager.cc:1403] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 13:14:13.480566  9480 consensus_queue.cc:237] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.488113  9528 raft_consensus.cc:2749] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.488013  9476 raft_consensus.cc:359] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.488744  9476 raft_consensus.cc:385] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.489050  9476 raft_consensus.cc:740] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.489830  9476 consensus_queue.cc:260] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.478440  9518 raft_consensus.cc:515] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.492105  9476 ts_tablet_manager.cc:1434] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:13.492066  9512 raft_consensus.cc:493] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.492744  9512 raft_consensus.cc:515] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.489889  9176 catalog_manager.cc:5697] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.496739  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.498895  9518 leader_election.cc:290] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.500674  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:13.496834  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05d2d6227b904a19b1c856690399cc79" is_pre_election: true
I20260709 13:14:13.501286  9357 raft_consensus.cc:3060] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.502573  9320 leader_election.cc:304] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe; no voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:13.503537  9513 raft_consensus.cc:2749] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.504525  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.505084  9431 raft_consensus.cc:3060] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.506348  9512 leader_election.cc:290] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.508070  9357 raft_consensus.cc:2468] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.511922  9246 leader_election.cc:304] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:13.512689  9518 raft_consensus.cc:2804] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.512888  9431 raft_consensus.cc:2468] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.513548  9518 raft_consensus.cc:697] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:13.514608  9518 consensus_queue.cc:237] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.518647  9480 raft_consensus.cc:493] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.519135  9480 raft_consensus.cc:515] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.521310  9480 leader_election.cc:290] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.524171  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe" is_pre_election: true
I20260709 13:14:13.524889  9357 raft_consensus.cc:2468] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.525604  9280 raft_consensus.cc:3060] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.527227  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6" is_pre_election: true
I20260709 13:14:13.527884  9431 raft_consensus.cc:2468] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 0.
I20260709 13:14:13.532842  9246 leader_election.cc:304] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:13.533699  9518 raft_consensus.cc:2804] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.534094  9518 raft_consensus.cc:493] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.534521  9518 raft_consensus.cc:3060] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.537689  9177 catalog_manager.cc:5697] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.539572  9518 raft_consensus.cc:515] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.539626  9177 catalog_manager.cc:5697] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.541561  9496 consensus_queue.cc:1048] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.541879  9518 leader_election.cc:290] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.544148  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:13.544826  9357 raft_consensus.cc:3060] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.547325  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.547958  9431 raft_consensus.cc:3060] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.551757  9357 raft_consensus.cc:2468] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.554378  9496 consensus_queue.cc:1048] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.555521  9246 leader_election.cc:304] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:13.559314  9518 raft_consensus.cc:2804] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.559863  9518 raft_consensus.cc:697] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:13.560890  9518 consensus_queue.cc:237] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.578037  9431 raft_consensus.cc:2468] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 1.
I20260709 13:14:13.580675  9177 catalog_manager.cc:5697] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.616474  9512 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.628371  9483 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.642623  9518 consensus_queue.cc:1048] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.658623  9528 consensus_queue.cc:1048] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.809185  9483 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.819029  9356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:44416
I20260709 13:14:13.819762  9356 raft_consensus.cc:606] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Received request to transfer leadership to TS 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:13.825707  9356 raft_consensus.cc:3060] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.828644  9483 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.853091  9357 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.866520  9528 consensus_queue.cc:1048] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.877965  9431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:43650
I20260709 13:14:13.878721  9431 raft_consensus.cc:606] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:13.890362  9431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:43650
I20260709 13:14:13.890944  9480 consensus_queue.cc:1048] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.891168  9431 raft_consensus.cc:606] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:13.920142  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "704537f5ace74488a0c8e330a0626381"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:14:13.920703  9280 raft_consensus.cc:606] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:13.926185  9280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
mode: GRACEFUL
new_leader_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:14:13.926750  9280 raft_consensus.cc:606] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Received request to transfer leadership to TS f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:13.932787  9480 consensus_queue.cc:1048] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.941011  9480 consensus_queue.cc:1048] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.942482  9480 raft_consensus.cc:993] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:13.943001  9518 raft_consensus.cc:1081] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:13.947907  9356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "704537f5ace74488a0c8e330a0626381"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:14:13.948586  9356 raft_consensus.cc:493] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.948980  9356 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.952869  9528 consensus_queue.cc:1048] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.962868  9480 consensus_queue.cc:1048] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.969425  9356 raft_consensus.cc:515] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.979884  9480 consensus_queue.cc:1048] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.986963  9356 leader_election.cc:290] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:13.988380  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:13.988984  9280 raft_consensus.cc:3055] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.989344  9280 raft_consensus.cc:740] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:13.990136  9280 consensus_queue.cc:260] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:13.992429  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:13.993059  9430 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.998116  9280 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.011924  9430 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:14.012600  9480 consensus_queue.cc:1048] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:14.013211  9321 leader_election.cc:304] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:14.014050  9483 raft_consensus.cc:2804] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.014518  9483 raft_consensus.cc:697] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:14.015295  9483 consensus_queue.cc:237] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.028370  9280 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:14.033685  9179 catalog_manager.cc:5697] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 1 to 2, leader changed from 05d2d6227b904a19b1c856690399cc79 (127.8.238.193) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.049871  9518 raft_consensus.cc:993] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: : Instructing follower f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:14.050410  9518 raft_consensus.cc:1081] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Signalling peer f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:14.052070  9429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:43638
I20260709 13:14:14.052712  9429 raft_consensus.cc:493] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.053150  9429 raft_consensus.cc:3060] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.060515  9429 raft_consensus.cc:515] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.064219  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:14.064275  9355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "771157be0d5344c697c8a70cb6d065d7" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:14.065050  9280 raft_consensus.cc:3055] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.065339  9355 raft_consensus.cc:3060] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.065582  9280 raft_consensus.cc:740] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:14.066851  9429 leader_election.cc:290] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:14.066560  9280 consensus_queue.cc:260] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.067838  9280 raft_consensus.cc:3060] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.073194  9355 raft_consensus.cc:2468] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 2.
I20260709 13:14:14.074569  9395 leader_election.cc:304] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:14.075522  9496 raft_consensus.cc:2804] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.076350  9280 raft_consensus.cc:2468] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 2.
I20260709 13:14:14.078418  9496 raft_consensus.cc:697] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:14.079393  9496 consensus_queue.cc:237] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.086470  9177 catalog_manager.cc:5697] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 1 to 2, leader changed from 05d2d6227b904a19b1c856690399cc79 (127.8.238.193) to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.125177  9483 raft_consensus.cc:993] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:14.125640  9483 raft_consensus.cc:1081] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Signalling peer 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:14.127509  9280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:14:14.128286  9280 raft_consensus.cc:493] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.128799  9280 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.130013  9560 raft_consensus.cc:993] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:14.130491  9560 raft_consensus.cc:1081] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:14.132640  9355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44402
I20260709 13:14:14.133206  9355 raft_consensus.cc:493] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.133605  9355 raft_consensus.cc:3060] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.136062  9280 raft_consensus.cc:515] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:14.138743  9355 raft_consensus.cc:515] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.139086  9429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:14.139686  9429 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.141954  9355 leader_election.cc:290] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:14.142235  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:14.142524  9280 leader_election.cc:290] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 2 election: Requested vote from peers f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:14.142910  9430 raft_consensus.cc:3055] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.143265  9430 raft_consensus.cc:740] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:14.144068  9430 consensus_queue.cc:260] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.144433  9355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:14.144997  9355 raft_consensus.cc:3055] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.145243  9430 raft_consensus.cc:3060] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.145326  9355 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:14.146334  9355 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:14.147461  9355 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.152261  9430 raft_consensus.cc:2468] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:14.152395  9429 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 2.
I20260709 13:14:14.153364  9431 raft_consensus.cc:1240] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Rejecting Update request from peer 1ad582eccf6b49cfb2560a192c8379fe for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:14.153772  9321 leader_election.cc:304] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:14.154229  9355 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 2.
I20260709 13:14:14.154924  9513 raft_consensus.cc:2804] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.155424  9513 raft_consensus.cc:697] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:14.155804  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ae388c826b4e97b30e6b5892b4acd6" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:14.156445  9280 raft_consensus.cc:3060] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.156252  9513 consensus_queue.cc:237] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.157503  9246 leader_election.cc:304] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:14.158427  9557 raft_consensus.cc:2804] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.160280  9557 raft_consensus.cc:697] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:14.161090  9557 consensus_queue.cc:237] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:14.165197  9280 raft_consensus.cc:2468] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:14.167410  9176 catalog_manager.cc:5697] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 1 to 2, leader changed from f329b189765449c59969cf6c9fb72ca6 (127.8.238.195) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.169299  9177 catalog_manager.cc:5697] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 1 to 2, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.422506  9560 raft_consensus.cc:993] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:14.423075  9560 raft_consensus.cc:1081] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:14.424719  9355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44402
I20260709 13:14:14.425208  9355 raft_consensus.cc:493] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:14.425248  9430 raft_consensus.cc:1275] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.425558  9355 raft_consensus.cc:3060] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.426964  9513 consensus_queue.cc:1048] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.432158  9355 raft_consensus.cc:515] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.434834  9355 leader_election.cc:290] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:14.435828  9280 raft_consensus.cc:1275] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.436916  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:14.437506  9483 consensus_queue.cc:1048] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:14.437551  9282 raft_consensus.cc:3060] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.438704  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae882a7be7d7481a8ce55954f76c0887" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:14.440254  9430 raft_consensus.cc:3055] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:14.440923  9430 raft_consensus.cc:740] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:14.442062  9430 consensus_queue.cc:260] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.443913  9430 raft_consensus.cc:3060] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.448551  9282 raft_consensus.cc:2468] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:14.449761  9320 leader_election.cc:304] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:14.450642  9483 raft_consensus.cc:2804] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:14.452919  9483 raft_consensus.cc:697] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:14.453797  9483 consensus_queue.cc:237] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:14.455726  9430 raft_consensus.cc:2468] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:14.467130  9179 catalog_manager.cc:5697] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 1 to 2, leader changed from f329b189765449c59969cf6c9fb72ca6 (127.8.238.195) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.535696  9355 raft_consensus.cc:1275] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.537045  9561 consensus_queue.cc:1048] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.544166  9282 raft_consensus.cc:1275] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.545570  9496 consensus_queue.cc:1048] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.615186  9282 raft_consensus.cc:1275] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.616475  9483 consensus_queue.cc:1048] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.624989  9430 raft_consensus.cc:1275] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.628460  9513 consensus_queue.cc:1048] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.692692  9430 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.693957  9518 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.703441  9355 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.705026  9518 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.847817  9282 raft_consensus.cc:1275] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.848991  9513 consensus_queue.cc:1048] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.857352  9430 raft_consensus.cc:1275] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.859633  9512 consensus_queue.cc:1048] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:16.957098  9147 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:14:16.958027  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:16.979378  9282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
mode: GRACEFUL
new_leader_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:54700
I20260709 13:14:16.979960  9282 raft_consensus.cc:606] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 LEADER]: Received request to transfer leadership to TS f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:16.990612  9355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:14:16.991218  9355 raft_consensus.cc:606] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Received request to transfer leadership to TS f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:16.992810  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:16.993446  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:17.042398  9483 raft_consensus.cc:993] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:17.042869  9574 raft_consensus.cc:1081] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Signalling peer f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:17.044519  9430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:43632
I20260709 13:14:17.045025  9430 raft_consensus.cc:493] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:17.045439  9430 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:17.050117  9430 raft_consensus.cc:515] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:17.051910  9430 leader_election.cc:290] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:17.052803  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:17.053442  9282 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:17.053395  9355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:17.054482  9355 raft_consensus.cc:3055] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:17.054795  9355 raft_consensus.cc:740] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:17.055546  9355 consensus_queue.cc:260] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:17.056648  9355 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:17.059049  9282 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 2.
I20260709 13:14:17.060283  9394 leader_election.cc:304] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:17.061827  9575 raft_consensus.cc:2804] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:17.061992  9355 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 2.
I20260709 13:14:17.063445  9575 raft_consensus.cc:697] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:17.064307  9575 consensus_queue.cc:237] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:17.071303  9179 catalog_manager.cc:5697] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 1 to 2, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.220902  9570 raft_consensus.cc:993] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: : Instructing follower f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:17.221345  9582 raft_consensus.cc:1081] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 LEADER]: Signalling peer f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:17.222872  9430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:43638
I20260709 13:14:17.223335  9430 raft_consensus.cc:493] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:17.223587  9430 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:17.228338  9430 raft_consensus.cc:515] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:17.230017  9430 leader_election.cc:290] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 3 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:17.231009  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:17.231138  9355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:17.231516  9282 raft_consensus.cc:3055] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:17.231746  9355 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:17.231897  9282 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:17.232699  9282 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:17.233651  9282 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:17.236778  9355 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 3.
I20260709 13:14:17.237805  9395 leader_election.cc:304] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:17.238543  9575 raft_consensus.cc:2804] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:17.238559  9282 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 3.
I20260709 13:14:17.239113  9575 raft_consensus.cc:697] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:17.239954  9575 consensus_queue.cc:237] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:17.249393  9179 catalog_manager.cc:5697] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 2 to 3, leader changed from 05d2d6227b904a19b1c856690399cc79 (127.8.238.193) to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.523351  9355 raft_consensus.cc:1275] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:17.524701  9575 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:17.536003  9282 raft_consensus.cc:1275] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:17.537719  9575 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:17.788507  9282 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:17.789804  9588 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.798332  9355 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:17.800222  9575 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.994289  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:18.004034  9430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:43650
I20260709 13:14:18.004582  9430 raft_consensus.cc:606] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:18.009403  9282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:14:18.009956  9282 raft_consensus.cc:606] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:18.014706  9282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:14:18.015194  9282 raft_consensus.cc:606] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:18.019861  9282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:54688
I20260709 13:14:18.020334  9282 raft_consensus.cc:606] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:18.030994  9430 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
mode: GRACEFUL
new_leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:43650
I20260709 13:14:18.031260  9582 raft_consensus.cc:993] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.031659  9430 raft_consensus.cc:606] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Received request to transfer leadership to TS 1ad582eccf6b49cfb2560a192c8379fe
I20260709 13:14:18.031925  9570 raft_consensus.cc:1081] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.033562  9355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:14:18.034075  9355 raft_consensus.cc:493] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.034477  9355 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.041059  9355 raft_consensus.cc:515] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.041890  9582 raft_consensus.cc:993] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.042353  9570 raft_consensus.cc:1081] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.043941  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:18.044028  9355 leader_election.cc:290] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:18.044250  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:18.044123  9357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:14:18.044729  9282 raft_consensus.cc:3055] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.044906  9430 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.044988  9357 raft_consensus.cc:493] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.045112  9282 raft_consensus.cc:740] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:18.045581  9357 raft_consensus.cc:3060] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.046108  9282 consensus_queue.cc:260] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.047387  9282 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.050177  9357 raft_consensus.cc:515] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.051891  9357 leader_election.cc:290] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:18.052091  9430 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:18.052868  9280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:18.052958  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6acacd88724a5e8a3099a5b7408f50" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:18.053475  9280 raft_consensus.cc:3055] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.053608  9431 raft_consensus.cc:3060] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.053786  9280 raft_consensus.cc:740] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:18.054605  9280 consensus_queue.cc:260] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.055419  9280 raft_consensus.cc:3060] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.058545  9431 raft_consensus.cc:2468] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:18.058984  9321 leader_election.cc:304] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:18.059818  9574 raft_consensus.cc:2804] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.060032  9321 leader_election.cc:304] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:18.060352  9280 raft_consensus.cc:2468] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:18.061604  9574 raft_consensus.cc:697] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:18.062266  9282 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:18.062613  9593 raft_consensus.cc:2804] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.063076  9593 raft_consensus.cc:697] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:18.062757  9574 consensus_queue.cc:237] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.063911  9593 consensus_queue.cc:237] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.072021  9582 raft_consensus.cc:993] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.071841  9179 catalog_manager.cc:5697] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 1 to 2, leader changed from 05d2d6227b904a19b1c856690399cc79 (127.8.238.193) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.072484  9570 raft_consensus.cc:1081] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.074117  9357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44410
I20260709 13:14:18.074755  9357 raft_consensus.cc:493] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.075210  9357 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.081116  9357 raft_consensus.cc:515] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.083107  9357 leader_election.cc:290] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:18.083967  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:18.084336  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:18.084599  9282 raft_consensus.cc:3055] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.084877  9431 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.084952  9282 raft_consensus.cc:740] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:18.085804  9282 consensus_queue.cc:260] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.087028  9282 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.087854  9179 catalog_manager.cc:5697] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 1 to 2, leader changed from 05d2d6227b904a19b1c856690399cc79 (127.8.238.193) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.093009  9431 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:18.093998  9282 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 2.
I20260709 13:14:18.094447  9321 leader_election.cc:304] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad582eccf6b49cfb2560a192c8379fe, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:18.095341  9593 raft_consensus.cc:2804] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.095845  9593 raft_consensus.cc:697] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:18.096653  9593 consensus_queue.cc:237] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.103436  9179 catalog_manager.cc:5697] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 1 to 2, leader changed from 05d2d6227b904a19b1c856690399cc79 (127.8.238.193) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.142035  9588 raft_consensus.cc:993] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.142498  9575 raft_consensus.cc:1081] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.143896  9357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44402
I20260709 13:14:18.144412  9357 raft_consensus.cc:493] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.144723  9357 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:18.149295  9357 raft_consensus.cc:515] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.151049  9357 leader_election.cc:290] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 3 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:18.151870  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:18.152221  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:18.152546  9282 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:18.152796  9431 raft_consensus.cc:3055] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:18.153124  9431 raft_consensus.cc:740] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:18.153918  9431 consensus_queue.cc:260] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.155200  9431 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:18.159551  9282 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 3.
I20260709 13:14:18.160844  9320 leader_election.cc:304] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:18.161660  9574 raft_consensus.cc:2804] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:18.161826  9431 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 3.
I20260709 13:14:18.162328  9574 raft_consensus.cc:697] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:18.163179  9574 consensus_queue.cc:237] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:18.169678  9179 catalog_manager.cc:5697] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 2 to 3, leader changed from f329b189765449c59969cf6c9fb72ca6 (127.8.238.195) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 3 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.218134  9588 raft_consensus.cc:993] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: : Instructing follower 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.218668  9575 raft_consensus.cc:1081] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Signalling peer 1ad582eccf6b49cfb2560a192c8379fe to start an election
I20260709 13:14:18.220237  9357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
 from {username='slave'} at 127.0.0.1:44402
I20260709 13:14:18.220786  9357 raft_consensus.cc:493] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.221103  9357 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:18.225566  9357 raft_consensus.cc:515] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:18.227538  9357 leader_election.cc:290] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 4 election: Requested vote from peers f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737), 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773)
I20260709 13:14:18.228233  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:18.228602  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "1ad582eccf6b49cfb2560a192c8379fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:18.228875  9430 raft_consensus.cc:3055] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:18.229203  9282 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:18.229257  9430 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:18.230130  9430 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:18.231364  9430 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:18.234051  9282 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 4.
I20260709 13:14:18.235088  9320 leader_election.cc:304] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, 1ad582eccf6b49cfb2560a192c8379fe; no voters: 
I20260709 13:14:18.235772  9574 raft_consensus.cc:2804] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:18.236310  9574 raft_consensus.cc:697] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 LEADER]: Becoming Leader. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:18.236827  9430 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad582eccf6b49cfb2560a192c8379fe in term 4.
I20260709 13:14:18.237120  9574 consensus_queue.cc:237] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:18.242815  9179 catalog_manager.cc:5697] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe reported cstate change: term changed from 3 to 4, leader changed from f329b189765449c59969cf6c9fb72ca6 (127.8.238.195) to 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194). New cstate: current_term: 4 leader_uuid: "1ad582eccf6b49cfb2560a192c8379fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.447407  9430 raft_consensus.cc:1275] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.448776  9574 consensus_queue.cc:1048] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:18.457791  9282 raft_consensus.cc:1275] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.459127  9574 consensus_queue.cc:1048] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:14:18.497359  9430 raft_consensus.cc:1275] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.498723  9594 consensus_queue.cc:1048] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.508991  9282 raft_consensus.cc:1275] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.510900  9593 consensus_queue.cc:1048] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.635198  9430 raft_consensus.cc:1275] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.636514  9593 consensus_queue.cc:1048] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.645515  9282 raft_consensus.cc:1275] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.647609  9593 consensus_queue.cc:1048] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.702375  9431 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:18.703711  9593 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.711937  9282 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 4 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:18.713235  9574 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.733012  9282 raft_consensus.cc:1275] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:18.734315  9574 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.744911  9431 raft_consensus.cc:1275] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Refusing update from remote peer 1ad582eccf6b49cfb2560a192c8379fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:18.746321  9593 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.040084  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:21.047286  9357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:14:21.048096  9357 raft_consensus.cc:606] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Received request to transfer leadership to TS 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:21.050902  9357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "704537f5ace74488a0c8e330a0626381"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:14:21.051537  9357 raft_consensus.cc:606] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Received request to transfer leadership to TS 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:21.053787  9357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:14:21.054208  9357 raft_consensus.cc:606] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Received request to transfer leadership to TS f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:21.056396  9357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:14:21.056797  9357 raft_consensus.cc:606] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 LEADER]: Received request to transfer leadership to TS f329b189765449c59969cf6c9fb72ca6
I20260709 13:14:21.059098  9357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8"
dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
mode: GRACEFUL
new_leader_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:44424
I20260709 13:14:21.059571  9357 raft_consensus.cc:606] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 LEADER]: Received request to transfer leadership to TS 05d2d6227b904a19b1c856690399cc79
I20260709 13:14:21.060803  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:21.060878  9612 raft_consensus.cc:993] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:21.061445  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:21.061597  9614 raft_consensus.cc:1081] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Signalling peer 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:21.063251  9282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:14:21.063733  9282 raft_consensus.cc:493] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.064066  9282 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.069300  9282 raft_consensus.cc:515] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.070986  9282 leader_election.cc:290] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 3 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:21.072023  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:21.072388  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efee172ce7f4a43b709cda76880a197" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:21.072824  9357 raft_consensus.cc:3055] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:21.072904  9431 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.073122  9357 raft_consensus.cc:740] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:21.073926  9357 consensus_queue.cc:260] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.075064  9357 raft_consensus.cc:3060] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.079079  9431 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 3.
I20260709 13:14:21.080402  9246 leader_election.cc:304] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:21.081795  9357 raft_consensus.cc:2468] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 3.
I20260709 13:14:21.081969  9615 raft_consensus.cc:2804] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:21.083238  9615 raft_consensus.cc:697] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 3 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:21.084215  9615 consensus_queue.cc:237] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.092392  9177 catalog_manager.cc:5697] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 2 to 3, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.356221  9612 raft_consensus.cc:993] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:21.356659  9614 raft_consensus.cc:1081] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 LEADER]: Signalling peer 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:21.358033  9282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:14:21.358458  9282 raft_consensus.cc:493] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.358680  9282 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.362877  9282 raft_consensus.cc:515] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.364593  9282 leader_election.cc:290] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 4 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:21.365309  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:21.365597  9431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea32c17c2ef34033ab50c4277078c8b8" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:21.365926  9357 raft_consensus.cc:3055] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:21.366133  9431 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.366336  9357 raft_consensus.cc:740] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:21.367266  9357 consensus_queue.cc:260] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.368348  9357 raft_consensus.cc:3060] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:21.367666  9612 raft_consensus.cc:993] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:21.368939  9614 raft_consensus.cc:1081] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Signalling peer f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:21.370705  9430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:43632
I20260709 13:14:21.371212  9430 raft_consensus.cc:493] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.371555  9430 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.371713  9431 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 4.
I20260709 13:14:21.372745  9246 leader_election.cc:304] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:21.373529  9615 raft_consensus.cc:2804] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:21.373970  9615 raft_consensus.cc:697] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 4 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:21.374752  9615 consensus_queue.cc:237] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.375027  9357 raft_consensus.cc:2468] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 4.
I20260709 13:14:21.377806  9430 raft_consensus.cc:515] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.379909  9430 leader_election.cc:290] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 3 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:21.380728  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:21.381371  9282 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.381047  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7aa1640a1d34bd1a4861dce2d6c1bca" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:21.382877  9357 raft_consensus.cc:3055] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:21.383332  9357 raft_consensus.cc:740] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:21.382877  9177 catalog_manager.cc:5697] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 3 to 4, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 4 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.384100  9357 consensus_queue.cc:260] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.385335  9357 raft_consensus.cc:3060] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.387970  9282 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 3.
I20260709 13:14:21.389308  9394 leader_election.cc:304] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:21.390069  9575 raft_consensus.cc:2804] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:21.391428  9575 raft_consensus.cc:697] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:21.391541  9357 raft_consensus.cc:2468] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 3.
I20260709 13:14:21.392316  9575 consensus_queue.cc:237] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.399806  9177 catalog_manager.cc:5697] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 2 to 3, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.448910  9612 raft_consensus.cc:993] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:21.449379  9614 raft_consensus.cc:1081] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 LEADER]: Signalling peer f329b189765449c59969cf6c9fb72ca6 to start an election
I20260709 13:14:21.450765  9430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa"
dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
 from {username='slave'} at 127.0.0.1:43632
I20260709 13:14:21.451215  9430 raft_consensus.cc:493] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.451493  9430 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:21.456193  9430 raft_consensus.cc:515] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:21.457701  9430 leader_election.cc:290] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 5 election: Requested vote from peers 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773), 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969)
I20260709 13:14:21.458879  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:21.458925  9282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0a3dd532ee548ceb7a6a23858121daa" candidate_uuid: "f329b189765449c59969cf6c9fb72ca6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "05d2d6227b904a19b1c856690399cc79"
I20260709 13:14:21.459444  9357 raft_consensus.cc:3055] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:21.459458  9282 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:21.459796  9357 raft_consensus.cc:740] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:21.460575  9357 consensus_queue.cc:260] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:21.461503  9357 raft_consensus.cc:3060] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:21.464825  9282 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 5.
I20260709 13:14:21.465667  9357 raft_consensus.cc:2468] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f329b189765449c59969cf6c9fb72ca6 in term 5.
I20260709 13:14:21.465902  9394 leader_election.cc:304] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:21.466746  9575 raft_consensus.cc:2804] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:21.467370  9575 raft_consensus.cc:697] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 5 LEADER]: Becoming Leader. State: Replica: f329b189765449c59969cf6c9fb72ca6, State: Running, Role: LEADER
I20260709 13:14:21.468111  9575 consensus_queue.cc:237] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } }
I20260709 13:14:21.475294  9177 catalog_manager.cc:5697] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 reported cstate change: term changed from 4 to 5, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to f329b189765449c59969cf6c9fb72ca6 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "f329b189765449c59969cf6c9fb72ca6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.490868  9430 raft_consensus.cc:1275] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:21.492172  9615 consensus_queue.cc:1048] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.504563  9357 raft_consensus.cc:1275] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:21.507249  9628 consensus_queue.cc:1048] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:21.646956  9612 raft_consensus.cc:993] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: : Instructing follower 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:21.647450  9614 raft_consensus.cc:1081] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Signalling peer 05d2d6227b904a19b1c856690399cc79 to start an election
I20260709 13:14:21.649088  9282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "704537f5ace74488a0c8e330a0626381"
dest_uuid: "05d2d6227b904a19b1c856690399cc79"
 from {username='slave'} at 127.0.0.1:54658
I20260709 13:14:21.649541  9282 raft_consensus.cc:493] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.649784  9282 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.655336  9282 raft_consensus.cc:515] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.656893  9282 leader_election.cc:290] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 3 election: Requested vote from peers 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969), f329b189765449c59969cf6c9fb72ca6 (127.8.238.195:33737)
I20260709 13:14:21.657574  9357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ad582eccf6b49cfb2560a192c8379fe"
I20260709 13:14:21.657853  9430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "704537f5ace74488a0c8e330a0626381" candidate_uuid: "05d2d6227b904a19b1c856690399cc79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f329b189765449c59969cf6c9fb72ca6"
I20260709 13:14:21.658169  9357 raft_consensus.cc:3055] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:21.658365  9430 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.658519  9357 raft_consensus.cc:740] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ad582eccf6b49cfb2560a192c8379fe, State: Running, Role: LEADER
I20260709 13:14:21.659291  9357 consensus_queue.cc:260] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.660686  9357 raft_consensus.cc:3060] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.663439  9430 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 3.
I20260709 13:14:21.664499  9246 leader_election.cc:304] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05d2d6227b904a19b1c856690399cc79, f329b189765449c59969cf6c9fb72ca6; no voters: 
I20260709 13:14:21.665200  9628 raft_consensus.cc:2804] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:21.665275  9357 raft_consensus.cc:2468] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05d2d6227b904a19b1c856690399cc79 in term 3.
I20260709 13:14:21.665745  9628 raft_consensus.cc:697] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 3 LEADER]: Becoming Leader. State: Replica: 05d2d6227b904a19b1c856690399cc79, State: Running, Role: LEADER
I20260709 13:14:21.666652  9628 consensus_queue.cc:237] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } }
I20260709 13:14:21.674081  9179 catalog_manager.cc:5697] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 reported cstate change: term changed from 2 to 3, leader changed from 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194) to 05d2d6227b904a19b1c856690399cc79 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "05d2d6227b904a19b1c856690399cc79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.806833  9357 raft_consensus.cc:1275] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:21.808066  9628 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.816990  9430 raft_consensus.cc:1275] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:21.818825  9616 consensus_queue.cc:1048] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:21.860343  9357 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 5 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:21.861549  9575 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.871455  9282 raft_consensus.cc:1275] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 5 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:21.873209  9575 consensus_queue.cc:1048] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.928437  9282 raft_consensus.cc:1275] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:21.929669  9575 consensus_queue.cc:1048] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05d2d6227b904a19b1c856690399cc79" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 44773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.939697  9355 raft_consensus.cc:1275] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Refusing update from remote peer f329b189765449c59969cf6c9fb72ca6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:21.941066  9636 consensus_queue.cc:1048] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:22.062582  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:22.068184  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
I20260709 13:14:22.069113  9430 raft_consensus.cc:1275] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:22.071925  9616 consensus_queue.cc:1048] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f329b189765449c59969cf6c9fb72ca6" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.084342  9355 raft_consensus.cc:1275] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Refusing update from remote peer 05d2d6227b904a19b1c856690399cc79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:22.086748  9616 consensus_queue.cc:1048] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad582eccf6b49cfb2560a192c8379fe" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.124387  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:22.125275  9147 tablet_replica.cc:333] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.126359  9147 raft_consensus.cc:2243] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.127074  9147 raft_consensus.cc:2272] T ea32c17c2ef34033ab50c4277078c8b8 P 05d2d6227b904a19b1c856690399cc79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.129571  9147 tablet_replica.cc:333] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.130092  9147 raft_consensus.cc:2243] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.130854  9147 raft_consensus.cc:2272] T 704537f5ace74488a0c8e330a0626381 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.132982  9147 tablet_replica.cc:333] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.133469  9147 raft_consensus.cc:2243] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.134137  9147 raft_consensus.cc:2272] T 3efee172ce7f4a43b709cda76880a197 P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.136220  9147 tablet_replica.cc:333] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.136706  9147 raft_consensus.cc:2243] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.137104  9147 raft_consensus.cc:2272] T c7aa1640a1d34bd1a4861dce2d6c1bca P 05d2d6227b904a19b1c856690399cc79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.139235  9147 tablet_replica.cc:333] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.139676  9147 raft_consensus.cc:2243] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.140035  9147 raft_consensus.cc:2272] T ae882a7be7d7481a8ce55954f76c0887 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.141640  9147 tablet_replica.cc:333] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.142063  9147 raft_consensus.cc:2243] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.142516  9147 raft_consensus.cc:2272] T 96ae388c826b4e97b30e6b5892b4acd6 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.144063  9147 tablet_replica.cc:333] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.144506  9147 raft_consensus.cc:2243] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.144891  9147 raft_consensus.cc:2272] T 1f6acacd88724a5e8a3099a5b7408f50 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.146538  9147 tablet_replica.cc:333] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.146948  9147 raft_consensus.cc:2243] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.147305  9147 raft_consensus.cc:2272] T 771157be0d5344c697c8a70cb6d065d7 P 05d2d6227b904a19b1c856690399cc79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.149137  9147 tablet_replica.cc:333] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79: stopping tablet replica
I20260709 13:14:22.149771  9147 raft_consensus.cc:2243] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.150328  9147 raft_consensus.cc:2272] T e0a3dd532ee548ceb7a6a23858121daa P 05d2d6227b904a19b1c856690399cc79 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.150703  9394 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:22.153898  9394 consensus_peers.cc:597] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 -> Peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Couldn't send request to peer 05d2d6227b904a19b1c856690399cc79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.252413  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
W20260709 13:14:22.253459  9320 consensus_peers.cc:597] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe -> Peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Couldn't send request to peer 05d2d6227b904a19b1c856690399cc79. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:44773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:22.262931  9394 consensus_peers.cc:597] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 -> Peer 05d2d6227b904a19b1c856690399cc79 (127.8.238.193:44773): Couldn't send request to peer 05d2d6227b904a19b1c856690399cc79. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:44773: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.275146  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
I20260709 13:14:22.298381  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:22.299115  9147 tablet_replica.cc:333] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.299898  9147 raft_consensus.cc:2243] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.300709  9147 raft_consensus.cc:2272] T ae882a7be7d7481a8ce55954f76c0887 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.302585  9147 tablet_replica.cc:333] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.303210  9147 raft_consensus.cc:2243] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.303648  9147 raft_consensus.cc:2272] T 704537f5ace74488a0c8e330a0626381 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.305544  9147 tablet_replica.cc:333] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.306052  9147 raft_consensus.cc:2243] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.306514  9147 raft_consensus.cc:2272] T ea32c17c2ef34033ab50c4277078c8b8 P 1ad582eccf6b49cfb2560a192c8379fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.308449  9147 tablet_replica.cc:333] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.308979  9147 raft_consensus.cc:2243] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.309381  9147 raft_consensus.cc:2272] T c7aa1640a1d34bd1a4861dce2d6c1bca P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.311345  9147 tablet_replica.cc:333] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.311851  9147 raft_consensus.cc:2243] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.312251  9147 raft_consensus.cc:2272] T 3efee172ce7f4a43b709cda76880a197 P 1ad582eccf6b49cfb2560a192c8379fe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.314208  9147 tablet_replica.cc:333] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.314811  9147 raft_consensus.cc:2243] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.315538  9147 raft_consensus.cc:2272] T 96ae388c826b4e97b30e6b5892b4acd6 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.317374  9147 tablet_replica.cc:333] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.317909  9147 raft_consensus.cc:2243] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.318707  9147 raft_consensus.cc:2272] T 1f6acacd88724a5e8a3099a5b7408f50 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.320331  9147 tablet_replica.cc:333] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.320786  9147 raft_consensus.cc:2243] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.321192  9147 raft_consensus.cc:2272] T e0a3dd532ee548ceb7a6a23858121daa P 1ad582eccf6b49cfb2560a192c8379fe [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.323527  9147 tablet_replica.cc:333] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe: stopping tablet replica
I20260709 13:14:22.324146  9147 raft_consensus.cc:2243] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.324628  9147 raft_consensus.cc:2272] T 771157be0d5344c697c8a70cb6d065d7 P 1ad582eccf6b49cfb2560a192c8379fe [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.325778  9395 consensus_peers.cc:597] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 -> Peer 1ad582eccf6b49cfb2560a192c8379fe (127.8.238.194:45969): Couldn't send request to peer 1ad582eccf6b49cfb2560a192c8379fe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.352846  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
I20260709 13:14:22.369078  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
I20260709 13:14:22.405519  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:22.406442  9147 tablet_replica.cc:333] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.407307  9147 raft_consensus.cc:2243] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.407954  9147 raft_consensus.cc:2272] T ea32c17c2ef34033ab50c4277078c8b8 P f329b189765449c59969cf6c9fb72ca6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.411105  9147 tablet_replica.cc:333] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.411731  9147 raft_consensus.cc:2243] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.412300  9147 raft_consensus.cc:2272] T 704537f5ace74488a0c8e330a0626381 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.415105  9147 tablet_replica.cc:333] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.415699  9147 raft_consensus.cc:2243] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.416177  9147 raft_consensus.cc:2272] T 1f6acacd88724a5e8a3099a5b7408f50 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.418565  9147 tablet_replica.cc:333] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.419237  9147 raft_consensus.cc:2243] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.419744  9147 raft_consensus.cc:2272] T 96ae388c826b4e97b30e6b5892b4acd6 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.422096  9147 tablet_replica.cc:333] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.422791  9147 raft_consensus.cc:2243] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.423802  9147 raft_consensus.cc:2272] T c7aa1640a1d34bd1a4861dce2d6c1bca P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.426466  9147 tablet_replica.cc:333] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.427206  9147 raft_consensus.cc:2243] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.427733  9147 raft_consensus.cc:2272] T 3efee172ce7f4a43b709cda76880a197 P f329b189765449c59969cf6c9fb72ca6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.430408  9147 tablet_replica.cc:333] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.431121  9147 raft_consensus.cc:2243] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.431975  9147 raft_consensus.cc:2272] T 771157be0d5344c697c8a70cb6d065d7 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.433621  9147 tablet_replica.cc:333] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.434082  9147 raft_consensus.cc:2243] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.434965  9147 raft_consensus.cc:2272] T e0a3dd532ee548ceb7a6a23858121daa P f329b189765449c59969cf6c9fb72ca6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.437057  9147 tablet_replica.cc:333] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6: stopping tablet replica
I20260709 13:14:22.437450  9147 raft_consensus.cc:2243] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.437853  9147 raft_consensus.cc:2272] T ae882a7be7d7481a8ce55954f76c0887 P f329b189765449c59969cf6c9fb72ca6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.466625  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:14:22.483912  9147 master.cc:562] Master@127.8.238.254:41123 shutting down...
I20260709 13:14:22.613880  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.614522  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.614897  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P 701bc245728744598b2d9486b41cb69c: stopping tablet replica
I20260709 13:14:22.634361  9147 master.cc:584] Master@127.8.238.254:41123 shutdown complete.
05d2d6227b904a19b1c856690399cc79  4
1ad582eccf6b49cfb2560a192c8379fe  4
f329b189765449c59969cf6c9fb72ca6  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12727 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:14:22.674226  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:34617
I20260709 13:14:22.675498  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:22.681054  9648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:22.681458  9649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:22.682737  9651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:22.683586  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:22.684441  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:22.684617  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:22.684729  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602862684718 us; error 0 us; skew 500 ppm
I20260709 13:14:22.685176  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:22.688102  9147 webserver.cc:533] Webserver started at http://127.8.238.254:38297/ using document root <none> and password file <none>
I20260709 13:14:22.688603  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:22.688766  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:22.688987  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:22.690172  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "865a55a807384888a9bfe7160135c5b6"
format_stamp: "Formatted at 2026-07-09 13:14:22 on dist-test-slave-ml7r"
I20260709 13:14:22.694893  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:22.698189  9656 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:22.699013  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:22.699278  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "865a55a807384888a9bfe7160135c5b6"
format_stamp: "Formatted at 2026-07-09 13:14:22 on dist-test-slave-ml7r"
I20260709 13:14:22.699536  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:22.722489  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:22.723675  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:22.762035  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:34617
I20260709 13:14:22.762120  9707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:34617 every 8 connection(s)
I20260709 13:14:22.766036  9708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:22.775244  9708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6: Bootstrap starting.
I20260709 13:14:22.779794  9708 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:22.784076  9708 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6: No bootstrap required, opened a new log
I20260709 13:14:22.786087  9708 raft_consensus.cc:359] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865a55a807384888a9bfe7160135c5b6" member_type: VOTER }
I20260709 13:14:22.786521  9708 raft_consensus.cc:385] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:22.786695  9708 raft_consensus.cc:740] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 865a55a807384888a9bfe7160135c5b6, State: Initialized, Role: FOLLOWER
I20260709 13:14:22.787189  9708 consensus_queue.cc:260] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865a55a807384888a9bfe7160135c5b6" member_type: VOTER }
I20260709 13:14:22.787596  9708 raft_consensus.cc:399] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:22.787781  9708 raft_consensus.cc:493] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:22.787989  9708 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:22.791917  9708 raft_consensus.cc:515] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865a55a807384888a9bfe7160135c5b6" member_type: VOTER }
I20260709 13:14:22.792455  9708 leader_election.cc:304] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 865a55a807384888a9bfe7160135c5b6; no voters: 
I20260709 13:14:22.793640  9708 leader_election.cc:290] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:22.794067  9711 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:22.795488  9711 raft_consensus.cc:697] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 1 LEADER]: Becoming Leader. State: Replica: 865a55a807384888a9bfe7160135c5b6, State: Running, Role: LEADER
I20260709 13:14:22.796154  9711 consensus_queue.cc:237] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865a55a807384888a9bfe7160135c5b6" member_type: VOTER }
I20260709 13:14:22.796736  9708 sys_catalog.cc:565] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:22.800756  9712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "865a55a807384888a9bfe7160135c5b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865a55a807384888a9bfe7160135c5b6" member_type: VOTER } }
I20260709 13:14:22.801996  9712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:22.801858  9713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 865a55a807384888a9bfe7160135c5b6. Latest consensus state: current_term: 1 leader_uuid: "865a55a807384888a9bfe7160135c5b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "865a55a807384888a9bfe7160135c5b6" member_type: VOTER } }
I20260709 13:14:22.802644  9713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:22.804915  9718 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:22.811685  9718 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:22.813164  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:22.820997  9718 catalog_manager.cc:1383] Generated new cluster ID: 6b7c6bfe8db343c0a4077c2f1d137b4e
I20260709 13:14:22.821314  9718 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:22.838362  9718 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:22.839644  9718 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:22.856774  9718 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6: Generated new TSK 0
I20260709 13:14:22.857455  9718 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:22.880089  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:22.886029  9729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:22.887099  9730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:22.888604  9732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:22.889329  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:22.890110  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:22.890372  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:22.890549  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602862890527 us; error 0 us; skew 500 ppm
I20260709 13:14:22.891113  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:22.893354  9147 webserver.cc:533] Webserver started at http://127.8.238.193:40789/ using document root <none> and password file <none>
I20260709 13:14:22.893857  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:22.894050  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:22.894379  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:22.895445  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "2b2c1f1edc05483e96e568426b620118"
format_stamp: "Formatted at 2026-07-09 13:14:22 on dist-test-slave-ml7r"
I20260709 13:14:22.900053  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:22.903527  9737 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:22.904275  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:14:22.904590  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "2b2c1f1edc05483e96e568426b620118"
format_stamp: "Formatted at 2026-07-09 13:14:22 on dist-test-slave-ml7r"
I20260709 13:14:22.904875  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:22.927080  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:22.928344  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:22.929828  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:22.932143  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:22.932387  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:22.932672  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:22.932863  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:22.972097  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:42253
I20260709 13:14:22.972187  9799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:42253 every 8 connection(s)
I20260709 13:14:22.977167  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:22.985139  9804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:22.986181  9805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:22.989245  9147 server_base.cc:1061] running on GCE node
W20260709 13:14:22.991151  9807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:22.992331  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:22.992520  9800 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34617
W20260709 13:14:22.992638  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:22.992934  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602862992914 us; error 0 us; skew 500 ppm
I20260709 13:14:22.992990  9800 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:22.993505  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:22.993857  9800 heartbeater.cc:507] Master 127.8.238.254:34617 requested a full tablet report, sending...
I20260709 13:14:22.996404  9147 webserver.cc:533] Webserver started at http://127.8.238.194:41861/ using document root <none> and password file <none>
I20260709 13:14:22.996454  9673 ts_manager.cc:194] Registered new tserver with Master: 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253)
I20260709 13:14:22.997196  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:22.997475  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:22.997792  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:22.999063  9673 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34750
I20260709 13:14:22.999459  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "95f5fe3584c844058f971777c75ddfb2"
format_stamp: "Formatted at 2026-07-09 13:14:22 on dist-test-slave-ml7r"
I20260709 13:14:23.004328  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:23.007582  9812 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.008518  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:23.008869  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "95f5fe3584c844058f971777c75ddfb2"
format_stamp: "Formatted at 2026-07-09 13:14:22 on dist-test-slave-ml7r"
I20260709 13:14:23.009162  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:23.030375  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:23.031586  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:23.033042  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:23.035259  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:23.035501  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.035754  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:23.035943  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.075477  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:38719
I20260709 13:14:23.075582  9874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:38719 every 8 connection(s)
I20260709 13:14:23.080368  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:23.087342  9878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:23.088112  9879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:23.091984  9147 server_base.cc:1061] running on GCE node
W20260709 13:14:23.092562  9881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:23.093564  9875 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34617
I20260709 13:14:23.093585  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:23.094002  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:23.094063  9875 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:23.094338  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602863094316 us; error 0 us; skew 500 ppm
I20260709 13:14:23.095089  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:23.095021  9875 heartbeater.cc:507] Master 127.8.238.254:34617 requested a full tablet report, sending...
I20260709 13:14:23.097414  9673 ts_manager.cc:194] Registered new tserver with Master: 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:23.097944  9147 webserver.cc:533] Webserver started at http://127.8.238.195:35649/ using document root <none> and password file <none>
I20260709 13:14:23.098529  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:23.098697  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:23.098901  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:23.099036  9673 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34756
I20260709 13:14:23.100262  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "20a79ac461c34734abd4f11320fde479"
format_stamp: "Formatted at 2026-07-09 13:14:23 on dist-test-slave-ml7r"
I20260709 13:14:23.105011  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:14:23.108513  9886 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.109365  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:14:23.109651  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "20a79ac461c34734abd4f11320fde479"
format_stamp: "Formatted at 2026-07-09 13:14:23 on dist-test-slave-ml7r"
I20260709 13:14:23.109898  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:23.131574  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:23.132767  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:23.134199  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:23.136538  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:23.136729  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.137068  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:23.137231  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:23.177336  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:39209
I20260709 13:14:23.177425  9948 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:39209 every 8 connection(s)
I20260709 13:14:23.191229  9949 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34617
I20260709 13:14:23.191633  9949 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:23.192415  9949 heartbeater.cc:507] Master 127.8.238.254:34617 requested a full tablet report, sending...
I20260709 13:14:23.194411  9673 ts_manager.cc:194] Registered new tserver with Master: 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.195035  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01458347s
I20260709 13:14:23.195793  9673 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34760
I20260709 13:14:23.220345  9673 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34768:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:23.223290  9673 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:23.292476  9765 tablet_service.cc:1511] Processing CreateTablet for tablet 19c32ea8fcce4970b3dffade8d5fe11b (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:23.294076  9765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c32ea8fcce4970b3dffade8d5fe11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.294422  9764 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffcb5f242f542e28b0fb4d3c940a5e1 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:23.295835  9764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffcb5f242f542e28b0fb4d3c940a5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.299471  9839 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffcb5f242f542e28b0fb4d3c940a5e1 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:23.300114  9763 tablet_service.cc:1511] Processing CreateTablet for tablet e021c16e5d904c41a84dc1e103f2e11c (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:23.300923  9839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffcb5f242f542e28b0fb4d3c940a5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.301486  9763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021c16e5d904c41a84dc1e103f2e11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.304472  9838 tablet_service.cc:1511] Processing CreateTablet for tablet e021c16e5d904c41a84dc1e103f2e11c (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:23.307246  9837 tablet_service.cc:1511] Processing CreateTablet for tablet 18c34ce0605b46bb94603154341ea026 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:23.307464  9762 tablet_service.cc:1511] Processing CreateTablet for tablet 18c34ce0605b46bb94603154341ea026 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:23.308667  9762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c34ce0605b46bb94603154341ea026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.298134  9840 tablet_service.cc:1511] Processing CreateTablet for tablet 19c32ea8fcce4970b3dffade8d5fe11b (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:23.311224  9836 tablet_service.cc:1511] Processing CreateTablet for tablet af87af0b4eec4c4cb597b2984d0a3311 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:23.311441  9761 tablet_service.cc:1511] Processing CreateTablet for tablet af87af0b4eec4c4cb597b2984d0a3311 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:23.312655  9761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af87af0b4eec4c4cb597b2984d0a3311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.313237  9838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021c16e5d904c41a84dc1e103f2e11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.314402  9914 tablet_service.cc:1511] Processing CreateTablet for tablet 19c32ea8fcce4970b3dffade8d5fe11b (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:23.315804  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c32ea8fcce4970b3dffade8d5fe11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.315416  9760 tablet_service.cc:1511] Processing CreateTablet for tablet c7f0fa8f7e9444368d479a913c39f2ed (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:23.316282  9835 tablet_service.cc:1511] Processing CreateTablet for tablet c7f0fa8f7e9444368d479a913c39f2ed (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:23.316819  9760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f0fa8f7e9444368d479a913c39f2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.319772  9759 tablet_service.cc:1511] Processing CreateTablet for tablet 2e76349b7bef4a0dbbdde52d585ffc8c (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:23.320884  9837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c34ce0605b46bb94603154341ea026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.321120  9759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e76349b7bef4a0dbbdde52d585ffc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.322671  9836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af87af0b4eec4c4cb597b2984d0a3311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.324529  9758 tablet_service.cc:1511] Processing CreateTablet for tablet daaa21a67e114fe58405c6495031b3c7 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:23.325121  9913 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffcb5f242f542e28b0fb4d3c940a5e1 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:23.325903  9758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daaa21a67e114fe58405c6495031b3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.326462  9913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffcb5f242f542e28b0fb4d3c940a5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.326660  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c32ea8fcce4970b3dffade8d5fe11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.328505  9835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f0fa8f7e9444368d479a913c39f2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.332031  9834 tablet_service.cc:1511] Processing CreateTablet for tablet 2e76349b7bef4a0dbbdde52d585ffc8c (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:23.333536  9834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e76349b7bef4a0dbbdde52d585ffc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.333390  9757 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec2035d440e4ea78413f2bc9d739399 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:23.333990  9912 tablet_service.cc:1511] Processing CreateTablet for tablet e021c16e5d904c41a84dc1e103f2e11c (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:23.335425  9912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021c16e5d904c41a84dc1e103f2e11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.335530  9756 tablet_service.cc:1511] Processing CreateTablet for tablet 3f6825f842aa49aebda3e2ce0970db5d (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:23.335688  9911 tablet_service.cc:1511] Processing CreateTablet for tablet 18c34ce0605b46bb94603154341ea026 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:23.337033  9911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c34ce0605b46bb94603154341ea026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.338606  9833 tablet_service.cc:1511] Processing CreateTablet for tablet daaa21a67e114fe58405c6495031b3c7 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:23.339375  9832 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec2035d440e4ea78413f2bc9d739399 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:23.339957  9833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daaa21a67e114fe58405c6495031b3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.340683  9832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec2035d440e4ea78413f2bc9d739399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.342586  9757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec2035d440e4ea78413f2bc9d739399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.346606  9756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f6825f842aa49aebda3e2ce0970db5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.356094  9910 tablet_service.cc:1511] Processing CreateTablet for tablet af87af0b4eec4c4cb597b2984d0a3311 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:23.357954  9910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af87af0b4eec4c4cb597b2984d0a3311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.358599  9831 tablet_service.cc:1511] Processing CreateTablet for tablet 3f6825f842aa49aebda3e2ce0970db5d (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:23.360018  9831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f6825f842aa49aebda3e2ce0970db5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.363961  9909 tablet_service.cc:1511] Processing CreateTablet for tablet c7f0fa8f7e9444368d479a913c39f2ed (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:23.365430  9909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f0fa8f7e9444368d479a913c39f2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.372287  9908 tablet_service.cc:1511] Processing CreateTablet for tablet 2e76349b7bef4a0dbbdde52d585ffc8c (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:23.373780  9908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e76349b7bef4a0dbbdde52d585ffc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.380615  9907 tablet_service.cc:1511] Processing CreateTablet for tablet daaa21a67e114fe58405c6495031b3c7 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:23.382464  9907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daaa21a67e114fe58405c6495031b3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.388545  9906 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec2035d440e4ea78413f2bc9d739399 (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:23.390425  9906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec2035d440e4ea78413f2bc9d739399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.409169  9905 tablet_service.cc:1511] Processing CreateTablet for tablet 3f6825f842aa49aebda3e2ce0970db5d (DEFAULT_TABLE table=test-workload [id=64557acefd7a4c8aa0fe1c73e1d81671]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:23.412997  9905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f6825f842aa49aebda3e2ce0970db5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.424041  9964 tablet_bootstrap.cc:492] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:23.451424  9964 tablet_bootstrap.cc:654] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.452469  9965 tablet_bootstrap.cc:492] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.480432  9965 tablet_bootstrap.cc:654] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.506323  9966 tablet_bootstrap.cc:492] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.513427  9966 tablet_bootstrap.cc:654] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.520493  9965 tablet_bootstrap.cc:492] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.521028  9965 ts_tablet_manager.cc:1403] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.003s
I20260709 13:14:23.522508  9966 tablet_bootstrap.cc:492] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.522856  9964 tablet_bootstrap.cc:492] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:23.522936  9966 ts_tablet_manager.cc:1403] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:14:23.523428  9964 ts_tablet_manager.cc:1403] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.001s
I20260709 13:14:23.524060  9965 raft_consensus.cc:359] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.524837  9965 raft_consensus.cc:385] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.525130  9965 raft_consensus.cc:740] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.525457  9966 raft_consensus.cc:359] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.526055  9966 raft_consensus.cc:385] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.526413  9966 raft_consensus.cc:740] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.526103  9965 consensus_queue.cc:260] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.526415  9964 raft_consensus.cc:359] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.527258  9964 raft_consensus.cc:385] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.527648  9964 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.527341  9966 consensus_queue.cc:260] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.528690  9875 heartbeater.cc:499] Master 127.8.238.254:34617 was elected leader, sending a full tablet report...
I20260709 13:14:23.529171  9965 ts_tablet_manager.cc:1434] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:23.529933  9800 heartbeater.cc:499] Master 127.8.238.254:34617 was elected leader, sending a full tablet report...
I20260709 13:14:23.530261  9965 tablet_bootstrap.cc:492] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.531267  9966 ts_tablet_manager.cc:1434] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:23.532348  9966 tablet_bootstrap.cc:492] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.537178  9965 tablet_bootstrap.cc:654] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.537689  9966 tablet_bootstrap.cc:654] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.540899  9964 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.574566  9949 heartbeater.cc:499] Master 127.8.238.254:34617 was elected leader, sending a full tablet report...
I20260709 13:14:23.576463  9966 tablet_bootstrap.cc:492] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.577020  9966 ts_tablet_manager.cc:1403] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.025s
I20260709 13:14:23.578689  9964 ts_tablet_manager.cc:1434] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.030s
I20260709 13:14:23.580598  9966 raft_consensus.cc:359] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.577099  9965 tablet_bootstrap.cc:492] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.581425  9966 raft_consensus.cc:385] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.582000  9965 ts_tablet_manager.cc:1403] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.016s
I20260709 13:14:23.581779  9966 raft_consensus.cc:740] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.582913  9964 tablet_bootstrap.cc:492] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:23.583053  9966 consensus_queue.cc:260] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.585371  9966 ts_tablet_manager.cc:1434] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:23.585458  9965 raft_consensus.cc:359] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.586477  9965 raft_consensus.cc:385] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.586583  9966 tablet_bootstrap.cc:492] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.586884  9965 raft_consensus.cc:740] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.587828  9965 consensus_queue.cc:260] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.590090  9965 ts_tablet_manager.cc:1434] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:23.591252  9965 tablet_bootstrap.cc:492] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.590147  9964 tablet_bootstrap.cc:654] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.594007  9966 tablet_bootstrap.cc:654] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.598503  9965 tablet_bootstrap.cc:654] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.606933  9966 tablet_bootstrap.cc:492] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.607627  9966 ts_tablet_manager.cc:1403] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:14:23.609133  9965 tablet_bootstrap.cc:492] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.609724  9965 ts_tablet_manager.cc:1403] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:14:23.611833  9966 raft_consensus.cc:359] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.612620  9966 raft_consensus.cc:385] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.612936  9966 raft_consensus.cc:740] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.613034  9965 raft_consensus.cc:359] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.613915  9965 raft_consensus.cc:385] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.613840  9966 consensus_queue.cc:260] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.614383  9965 raft_consensus.cc:740] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.615288  9965 consensus_queue.cc:260] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.616216  9966 ts_tablet_manager.cc:1434] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:23.616940  9971 raft_consensus.cc:493] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.617471  9971 raft_consensus.cc:515] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.618587  9966 tablet_bootstrap.cc:492] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.619416  9965 ts_tablet_manager.cc:1434] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:14:23.620373  9965 tablet_bootstrap.cc:492] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.626308  9966 tablet_bootstrap.cc:654] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.627619  9965 tablet_bootstrap.cc:654] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.633471  9971 leader_election.cc:290] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.636377  9965 tablet_bootstrap.cc:492] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.636915  9965 ts_tablet_manager.cc:1403] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 13:14:23.640476  9965 raft_consensus.cc:359] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.641389  9965 raft_consensus.cc:385] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.641713  9965 raft_consensus.cc:740] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.645239  9966 tablet_bootstrap.cc:492] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.645743  9966 ts_tablet_manager.cc:1403] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 13:14:23.647394  9964 tablet_bootstrap.cc:492] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:23.648097  9964 ts_tablet_manager.cc:1403] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.001s
I20260709 13:14:23.648226  9966 raft_consensus.cc:359] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.648931  9966 raft_consensus.cc:385] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.649215  9966 raft_consensus.cc:740] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.649808  9966 consensus_queue.cc:260] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.652403  9966 ts_tablet_manager.cc:1434] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:23.653591  9966 tablet_bootstrap.cc:492] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.652854  9965 consensus_queue.cc:260] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.652405  9964 raft_consensus.cc:359] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.655350  9964 raft_consensus.cc:385] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.655726  9964 raft_consensus.cc:740] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.656664  9964 consensus_queue.cc:260] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.659211  9964 ts_tablet_manager.cc:1434] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:14:23.660190  9964 tablet_bootstrap.cc:492] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:23.660724  9966 tablet_bootstrap.cc:654] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.668697  9964 tablet_bootstrap.cc:654] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.670364  9965 ts_tablet_manager.cc:1434] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 13:14:23.671460  9965 tablet_bootstrap.cc:492] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.676319  9971 raft_consensus.cc:493] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.676873  9971 raft_consensus.cc:515] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.677989  9965 tablet_bootstrap.cc:654] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.679023  9971 leader_election.cc:290] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.683727  9966 tablet_bootstrap.cc:492] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.684365  9966 ts_tablet_manager.cc:1403] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.012s
I20260709 13:14:23.688225  9966 raft_consensus.cc:359] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.689003  9966 raft_consensus.cc:385] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.689303  9966 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.689956  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffcb5f242f542e28b0fb4d3c940a5e1" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:23.690053  9966 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.691650  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
W20260709 13:14:23.691901  9740 leader_election.cc:343] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.692325  9849 raft_consensus.cc:2468] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 0.
I20260709 13:14:23.692914  9966 ts_tablet_manager.cc:1434] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:23.693629  9740 leader_election.cc:304] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:23.693949  9966 tablet_bootstrap.cc:492] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.694408  9971 raft_consensus.cc:2804] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.694756  9964 tablet_bootstrap.cc:492] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:23.694846  9971 raft_consensus.cc:493] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.689958  9965 tablet_bootstrap.cc:492] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.695267  9971 raft_consensus.cc:3060] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.695859  9965 ts_tablet_manager.cc:1403] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 13:14:23.695286  9964 ts_tablet_manager.cc:1403] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.006s
I20260709 13:14:23.698947  9965 raft_consensus.cc:359] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.699911  9965 raft_consensus.cc:385] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.700270  9965 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.699460  9964 raft_consensus.cc:359] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.700734  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.701107  9966 tablet_bootstrap.cc:654] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.701387  9965 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.702265  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffcb5f242f542e28b0fb4d3c940a5e1" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.702946  9924 raft_consensus.cc:2468] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 0.
I20260709 13:14:23.701107  9964 raft_consensus.cc:385] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.704082  9965 ts_tablet_manager.cc:1434] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:14:23.704401  9964 raft_consensus.cc:740] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.705681  9964 consensus_queue.cc:260] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.709159  9971 raft_consensus.cc:515] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
W20260709 13:14:23.703042  9739 leader_election.cc:343] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.711621  9739 leader_election.cc:304] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:23.712378  9964 ts_tablet_manager.cc:1434] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:14:23.714303  9964 tablet_bootstrap.cc:492] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:23.720497  9965 tablet_bootstrap.cc:492] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.724187  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.724920  9849 raft_consensus.cc:3060] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.730162  9965 tablet_bootstrap.cc:654] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.730401  9970 raft_consensus.cc:493] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.730849  9970 raft_consensus.cc:515] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.733771  9970 leader_election.cc:290] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.736141  9966 tablet_bootstrap.cc:492] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.736728  9966 ts_tablet_manager.cc:1403] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.017s
I20260709 13:14:23.740402  9964 tablet_bootstrap.cc:654] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.740082  9966 raft_consensus.cc:359] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.740865  9966 raft_consensus.cc:385] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.741256  9966 raft_consensus.cc:740] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.742218  9966 consensus_queue.cc:260] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.746068  9965 tablet_bootstrap.cc:492] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.746130  9849 raft_consensus.cc:2468] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 1.
I20260709 13:14:23.746749  9965 ts_tablet_manager.cc:1403] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.004s
I20260709 13:14:23.750468  9965 raft_consensus.cc:359] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.751248  9965 raft_consensus.cc:385] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.751633  9965 raft_consensus.cc:740] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.752743  9971 leader_election.cc:290] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.755671  9971 raft_consensus.cc:2804] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.759045  9971 raft_consensus.cc:493] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.752426  9965 consensus_queue.cc:260] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.758025  9740 leader_election.cc:304] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:23.759618  9966 ts_tablet_manager.cc:1434] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.013s
I20260709 13:14:23.759537  9971 raft_consensus.cc:3060] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.757293  9964 tablet_bootstrap.cc:492] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:23.760741  9964 ts_tablet_manager.cc:1403] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.002s
I20260709 13:14:23.761355  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:23.762814  9986 raft_consensus.cc:2804] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.765056  9986 raft_consensus.cc:697] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:23.765940  9986 consensus_queue.cc:237] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.768095  9965 ts_tablet_manager.cc:1434] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:14:23.769220  9965 tablet_bootstrap.cc:492] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.768954  9971 raft_consensus.cc:515] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
W20260709 13:14:23.770090  9739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:39209, user_credentials={real_user=slave}} blocked reactor thread for 58531.4us
I20260709 13:14:23.772060  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:23.773016  9974 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.773530  9974 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.776322  9974 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
W20260709 13:14:23.764138  9814 leader_election.cc:343] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.763916  9964 raft_consensus.cc:359] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.775826  9971 leader_election.cc:290] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.783811  9964 raft_consensus.cc:385] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.784209  9964 raft_consensus.cc:740] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.784370  9971 raft_consensus.cc:493] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.784957  9971 raft_consensus.cc:515] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.785092  9964 consensus_queue.cc:260] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.787575  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffcb5f242f542e28b0fb4d3c940a5e1" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.788116  9964 ts_tablet_manager.cc:1434] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 13:14:23.789184  9964 tablet_bootstrap.cc:492] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
W20260709 13:14:23.789322  9740 leader_election.cc:343] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.760763  9966 tablet_bootstrap.cc:492] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.790918  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
W20260709 13:14:23.794549  9814 leader_election.cc:343] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.795063  9814 leader_election.cc:304] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:23.795917  9970 raft_consensus.cc:2749] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:23.796227  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
W20260709 13:14:23.799873  9889 leader_election.cc:343] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.801308  9966 tablet_bootstrap.cc:654] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.802474  9965 tablet_bootstrap.cc:654] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.807729  9964 tablet_bootstrap.cc:654] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:23.809049  9721 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:23.812676  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:23.813164  9966 tablet_bootstrap.cc:492] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:23.813519  9971 leader_election.cc:290] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.813860  9966 ts_tablet_manager.cc:1403] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.006s
I20260709 13:14:23.814324  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c32ea8fcce4970b3dffade8d5fe11b" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
W20260709 13:14:23.815832  9739 leader_election.cc:343] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:23.816049  9740 leader_election.cc:343] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.813457  9775 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 0.
I20260709 13:14:23.817785  9888 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:23.818673  9974 raft_consensus.cc:2804] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.819059  9974 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.819278  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffcb5f242f542e28b0fb4d3c940a5e1" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:23.819444  9974 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.819927  9924 raft_consensus.cc:3060] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.821791  9965 tablet_bootstrap.cc:492] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.822335  9965 ts_tablet_manager.cc:1403] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.005s
I20260709 13:14:23.825318  9965 raft_consensus.cc:359] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.826100  9965 raft_consensus.cc:385] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.826550  9965 raft_consensus.cc:740] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.827567  9924 raft_consensus.cc:2468] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 1.
I20260709 13:14:23.827430  9965 consensus_queue.cc:260] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.829759  9739 leader_election.cc:304] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:23.829834  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c32ea8fcce4970b3dffade8d5fe11b" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.833027  9970 raft_consensus.cc:493] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.833724  9970 raft_consensus.cc:515] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.835920  9970 leader_election.cc:290] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.836123  9993 raft_consensus.cc:2804] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.836709  9993 raft_consensus.cc:697] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:23.838186  9965 ts_tablet_manager.cc:1434] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:14:23.838308  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:23.839025  9775 raft_consensus.cc:2468] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 0.
I20260709 13:14:23.832998  9923 raft_consensus.cc:2468] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 0.
I20260709 13:14:23.839388  9671 catalog_manager.cc:5697] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.840488  9814 leader_election.cc:304] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:23.840799  9739 leader_election.cc:304] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:23.841476  9970 raft_consensus.cc:2804] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.841895  9970 raft_consensus.cc:493] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.841940  9971 raft_consensus.cc:2804] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.842446  9970 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.842545  9971 raft_consensus.cc:493] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.843380  9971 raft_consensus.cc:3060] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.846482  9965 tablet_bootstrap.cc:492] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.839232  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.838025  9993 consensus_queue.cc:237] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.853746  9965 tablet_bootstrap.cc:654] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.819550  9966 raft_consensus.cc:359] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.855790  9966 raft_consensus.cc:385] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.856220  9966 raft_consensus.cc:740] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.857132  9966 consensus_queue.cc:260] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.859154  9964 tablet_bootstrap.cc:492] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:23.859661  9964 ts_tablet_manager.cc:1403] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.006s
I20260709 13:14:23.858464  9974 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.862694  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:23.863252  9966 ts_tablet_manager.cc:1434] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:14:23.863371  9775 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.864384  9966 tablet_bootstrap.cc:492] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:23.863771  9964 raft_consensus.cc:359] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.864884  9964 raft_consensus.cc:385] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.865324  9964 raft_consensus.cc:740] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.866572  9964 consensus_queue.cc:260] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.867835  9974 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:23.870092  9993 raft_consensus.cc:493] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.871623  9993 raft_consensus.cc:515] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.877087  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.853646  9971 raft_consensus.cc:515] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.878005  9966 tablet_bootstrap.cc:654] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.880477  9993 leader_election.cc:290] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.882510  9974 raft_consensus.cc:493] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.883070  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021c16e5d904c41a84dc1e103f2e11c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.883060  9974 raft_consensus.cc:515] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.885969  9971 leader_election.cc:290] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.887851  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c32ea8fcce4970b3dffade8d5fe11b" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:23.888682  9923 raft_consensus.cc:3060] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.888548  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
W20260709 13:14:23.884115  9889 leader_election.cc:343] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:23.893651  9888 leader_election.cc:343] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:23.894809  9739 leader_election.cc:343] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.897903  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:23.899091  9849 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 0.
I20260709 13:14:23.899941  9923 raft_consensus.cc:2468] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 1.
I20260709 13:14:23.901140  9889 leader_election.cc:304] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:23.902942  9739 leader_election.cc:304] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 
I20260709 13:14:23.904098  9971 raft_consensus.cc:2804] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.904711  9971 raft_consensus.cc:697] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:23.905823  9971 consensus_queue.cc:237] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.907521  9974 leader_election.cc:290] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:23.908708  9974 raft_consensus.cc:2804] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.909574  9775 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 1.
I20260709 13:14:23.910256  9974 raft_consensus.cc:493] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.912967  9974 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.913323  9888 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:23.913589  9970 raft_consensus.cc:515] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.917346  9970 leader_election.cc:290] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.918104  9970 raft_consensus.cc:493] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.918417  9965 tablet_bootstrap.cc:492] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:23.919078  9965 ts_tablet_manager.cc:1403] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.008s
I20260709 13:14:23.918738  9970 raft_consensus.cc:515] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.921535  9970 leader_election.cc:290] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.925392  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:23.926113  9775 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.927330  9965 raft_consensus.cc:359] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.928165  9965 raft_consensus.cc:385] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:23.928530  9965 raft_consensus.cc:740] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:23.931718  9775 raft_consensus.cc:2468] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 1.
I20260709 13:14:23.932282  9971 raft_consensus.cc:493] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.932521  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c32ea8fcce4970b3dffade8d5fe11b" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:23.932930  9971 raft_consensus.cc:515] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.934701  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c32ea8fcce4970b3dffade8d5fe11b" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.935550  9924 raft_consensus.cc:2393] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95f5fe3584c844058f971777c75ddfb2 in current term 1: Already voted for candidate 2b2c1f1edc05483e96e568426b620118 in this term.
I20260709 13:14:23.935456  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c32ea8fcce4970b3dffade8d5fe11b" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.936058  9850 raft_consensus.cc:3060] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:23.936347  9814 leader_election.cc:343] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.936558  9971 leader_election.cc:290] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.934706  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021c16e5d904c41a84dc1e103f2e11c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:23.937438  9814 leader_election.cc:304] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:23.939293  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:23.939966  9848 raft_consensus.cc:2468] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 0.
I20260709 13:14:23.939989  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:23.941161  9740 leader_election.cc:304] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
W20260709 13:14:23.941843  9739 leader_election.cc:343] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.942117  9971 raft_consensus.cc:2804] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.942525  9971 raft_consensus.cc:493] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.942920  9971 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.942644 10000 raft_consensus.cc:2804] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.946748 10000 raft_consensus.cc:697] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:23.946988  9814 leader_election.cc:304] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:23.948098  9971 raft_consensus.cc:515] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.948073 10000 consensus_queue.cc:237] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.953344  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
W20260709 13:14:23.955258  9739 leader_election.cc:343] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.955996  9971 leader_election.cc:290] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.936049  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:23.929421  9965 consensus_queue.cc:260] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.958616  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.959262  9848 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:23.959306  9814 leader_election.cc:343] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.960121  9965 ts_tablet_manager.cc:1434] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:14:23.960402  9849 raft_consensus.cc:2468] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 0.
I20260709 13:14:23.961050  9965 tablet_bootstrap.cc:492] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:23.964097  9740 leader_election.cc:304] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479
I20260709 13:14:23.965070  9971 raft_consensus.cc:2804] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:23.965468  9971 raft_consensus.cc:493] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.965791  9971 raft_consensus.cc:3060] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.967542  9848 raft_consensus.cc:2468] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 1.
I20260709 13:14:23.969079  9740 leader_election.cc:304] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479
I20260709 13:14:23.969045  9974 raft_consensus.cc:515] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.970433  9993 raft_consensus.cc:2804] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.971030  9993 raft_consensus.cc:697] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:23.972072  9993 consensus_queue.cc:237] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.972489  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:23.972813  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.973488  9848 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:23.974291  9888 leader_election.cc:343] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.975315  9971 raft_consensus.cc:515] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.977067  9971 leader_election.cc:290] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:23.972932  9974 leader_election.cc:290] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:23.978554  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021c16e5d904c41a84dc1e103f2e11c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:23.978834  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021c16e5d904c41a84dc1e103f2e11c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:23.979240  9964 ts_tablet_manager.cc:1434] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.119s	user 0.010s	sys 0.009s
W20260709 13:14:23.980212  9739 leader_election.cc:343] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:23.981148  9964 tablet_bootstrap.cc:492] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:23.979437  9849 raft_consensus.cc:3060] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:23.984695  9848 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 1.
I20260709 13:14:23.986361  9889 leader_election.cc:304] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:23.987594  9974 raft_consensus.cc:2804] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.988433  9964 tablet_bootstrap.cc:654] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:23.985617  9673 catalog_manager.cc:5697] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.989600  9849 raft_consensus.cc:2468] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 1.
I20260709 13:14:23.990942  9740 leader_election.cc:304] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479
I20260709 13:14:23.991851  9971 raft_consensus.cc:2804] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.992528  9971 raft_consensus.cc:697] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:23.993690  9971 consensus_queue.cc:237] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:23.972779 10003 raft_consensus.cc:2804] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:23.967573  9850 raft_consensus.cc:2468] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 1.
I20260709 13:14:24.002924  9970 raft_consensus.cc:2749] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.006173  9974 raft_consensus.cc:697] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.007565  9974 consensus_queue.cc:237] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.032294  9965 tablet_bootstrap.cc:654] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.027675  9966 tablet_bootstrap.cc:492] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:24.037590  9966 ts_tablet_manager.cc:1403] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.003s
I20260709 13:14:24.041378  9966 raft_consensus.cc:359] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.046940  9966 raft_consensus.cc:385] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.051636 10003 raft_consensus.cc:697] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.052021  9966 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.052752 10003 consensus_queue.cc:237] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.052922  9966 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.054181  9964 tablet_bootstrap.cc:492] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:24.054746  9964 ts_tablet_manager.cc:1403] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.047s
I20260709 13:14:24.055187  9966 ts_tablet_manager.cc:1434] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:14:24.056092  9966 tablet_bootstrap.cc:492] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:24.058343  9964 raft_consensus.cc:359] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.059602  9964 raft_consensus.cc:385] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.058391  9673 catalog_manager.cc:5697] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.060019  9964 raft_consensus.cc:740] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.061679 10014 raft_consensus.cc:493] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.061093  9964 consensus_queue.cc:260] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.062208 10014 raft_consensus.cc:515] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.065584  9964 ts_tablet_manager.cc:1434] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:14:24.065878  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:24.067059  9964 tablet_bootstrap.cc:492] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
W20260709 13:14:24.067752  9888 leader_election.cc:343] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.068919  9966 tablet_bootstrap.cc:654] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.070026  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:24.070735  9850 raft_consensus.cc:2468] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 0.
I20260709 13:14:24.072127  9965 tablet_bootstrap.cc:492] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:24.072213  9889 leader_election.cc:304] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:24.072657  9965 ts_tablet_manager.cc:1403] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.003s
I20260709 13:14:24.073112  9974 raft_consensus.cc:2804] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.073501  9974 raft_consensus.cc:493] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.073838  9974 raft_consensus.cc:3060] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.075879  9964 tablet_bootstrap.cc:654] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.075942  9965 raft_consensus.cc:359] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.076812  9965 raft_consensus.cc:385] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.077085  9965 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.079315  9965 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.080080 10014 leader_election.cc:290] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:24.061100  9673 catalog_manager.cc:5697] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.081753  9673 catalog_manager.cc:5697] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.086045  9673 catalog_manager.cc:5697] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.091643  9965 ts_tablet_manager.cc:1434] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:14:24.094563  9970 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.088128  9974 raft_consensus.cc:515] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.095863  9966 tablet_bootstrap.cc:492] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:24.095773  9970 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.101603  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:24.102135  9970 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.101734  9671 catalog_manager.cc:5697] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.098825  9974 leader_election.cc:290] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:24.099772  9966 ts_tablet_manager.cc:1403] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
W20260709 13:14:24.103317  9888 leader_election.cc:343] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.104636  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:24.099891  9965 tablet_bootstrap.cc:492] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2: Bootstrap starting.
I20260709 13:14:24.104089  9671 catalog_manager.cc:5697] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.105542  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:24.106069  9774 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 0.
I20260709 13:14:24.106884  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:24.107458  9850 raft_consensus.cc:3060] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.107544  9814 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:24.105902  9966 raft_consensus.cc:359] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.108646  9966 raft_consensus.cc:385] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.108945  9966 raft_consensus.cc:740] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
W20260709 13:14:24.109414  9814 leader_election.cc:343] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.109579  9966 consensus_queue.cc:260] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.111651  9966 ts_tablet_manager.cc:1434] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:24.108422  9970 raft_consensus.cc:2804] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:24.112986  9970 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.113569  9970 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.115464  9966 tablet_bootstrap.cc:492] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: Bootstrap starting.
I20260709 13:14:24.119114  9850 raft_consensus.cc:2468] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 1.
I20260709 13:14:24.120621  9970 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.123461  9965 tablet_bootstrap.cc:654] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.125180  9970 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.121711  9966 tablet_bootstrap.cc:654] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.126400  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:24.123253  9889 leader_election.cc:304] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:24.127115  9774 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.128604  9974 raft_consensus.cc:2804] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.129241  9974 raft_consensus.cc:697] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.130373  9974 consensus_queue.cc:237] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.134186  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:24.123477  9964 tablet_bootstrap.cc:492] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:24.136760  9964 ts_tablet_manager.cc:1403] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.012s
W20260709 13:14:24.137346  9814 leader_election.cc:343] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:24.140903  9964 raft_consensus.cc:359] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.141987  9964 raft_consensus.cc:385] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.142349  9774 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 1.
I20260709 13:14:24.144871  9964 raft_consensus.cc:740] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.145746  9965 tablet_bootstrap.cc:492] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2: No bootstrap required, opened a new log
I20260709 13:14:24.145879  9814 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479
I20260709 13:14:24.145705  9964 consensus_queue.cc:260] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.146526  9965 ts_tablet_manager.cc:1403] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.012s
I20260709 13:14:24.147433  9970 raft_consensus.cc:2804] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:24.147944  9970 raft_consensus.cc:697] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:24.148100  9964 ts_tablet_manager.cc:1434] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:14:24.149032  9964 tablet_bootstrap.cc:492] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:24.148818  9970 consensus_queue.cc:237] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.149554  9965 raft_consensus.cc:359] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.150188  9965 raft_consensus.cc:385] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.150545  9965 raft_consensus.cc:740] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.151335  9965 consensus_queue.cc:260] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.153967  9965 ts_tablet_manager.cc:1434] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:24.155323  9966 tablet_bootstrap.cc:492] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: No bootstrap required, opened a new log
I20260709 13:14:24.156912  9966 ts_tablet_manager.cc:1403] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.004s
I20260709 13:14:24.157018  9964 tablet_bootstrap.cc:654] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.159406  9966 raft_consensus.cc:359] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.160187  9966 raft_consensus.cc:385] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.160522  9966 raft_consensus.cc:740] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.161294  9966 consensus_queue.cc:260] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.162027  9671 catalog_manager.cc:5697] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.167860  9673 catalog_manager.cc:5697] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.169011  9966 ts_tablet_manager.cc:1434] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:14:24.179086  9964 tablet_bootstrap.cc:492] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:24.179704  9964 ts_tablet_manager.cc:1403] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.010s
I20260709 13:14:24.191231  9964 raft_consensus.cc:359] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.191952  9964 raft_consensus.cc:385] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.192281  9964 raft_consensus.cc:740] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.192978  9964 consensus_queue.cc:260] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.195120  9964 ts_tablet_manager.cc:1434] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:24.195986  9964 tablet_bootstrap.cc:492] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:24.197180  9974 raft_consensus.cc:493] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.197611  9974 raft_consensus.cc:515] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.199779  9974 leader_election.cc:290] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:24.200589  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:24.200999  9964 tablet_bootstrap.cc:654] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.201380  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:24.202162  9850 raft_consensus.cc:2393] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20a79ac461c34734abd4f11320fde479 in current term 1: Already voted for candidate 2b2c1f1edc05483e96e568426b620118 in this term.
I20260709 13:14:24.203516  9889 leader_election.cc:304] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20a79ac461c34734abd4f11320fde479; no voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.204511  9974 raft_consensus.cc:3060] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.205891  9964 tablet_bootstrap.cc:492] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:24.206329  9964 ts_tablet_manager.cc:1403] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:14:24.208397  9964 raft_consensus.cc:359] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.208945  9964 raft_consensus.cc:385] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.209184  9964 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.209743  9964 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.209964  9974 raft_consensus.cc:2749] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.211632  9964 ts_tablet_manager.cc:1434] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:24.212600  9964 tablet_bootstrap.cc:492] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479: Bootstrap starting.
I20260709 13:14:24.217077  9964 tablet_bootstrap.cc:654] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:24.221973  9964 tablet_bootstrap.cc:492] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479: No bootstrap required, opened a new log
I20260709 13:14:24.222455  9964 ts_tablet_manager.cc:1403] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:14:24.224268  9964 raft_consensus.cc:359] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.224788  9964 raft_consensus.cc:385] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:24.225021  9964 raft_consensus.cc:740] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Initialized, Role: FOLLOWER
I20260709 13:14:24.225533  9964 consensus_queue.cc:260] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.226979  9964 ts_tablet_manager.cc:1434] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:24.259923  9923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:14:24.260479  9923 raft_consensus.cc:606] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:24.260454  9970 raft_consensus.cc:493] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.260459  9993 consensus_queue.cc:1048] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.261202  9970 raft_consensus.cc:515] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.263370  9970 leader_election.cc:290] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.264329  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffcb5f242f542e28b0fb4d3c940a5e1" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:24.264608  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffcb5f242f542e28b0fb4d3c940a5e1" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:24.265337  9923 raft_consensus.cc:2393] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95f5fe3584c844058f971777c75ddfb2 in current term 1: Already voted for candidate 2b2c1f1edc05483e96e568426b620118 in this term.
I20260709 13:14:24.266553  9814 leader_election.cc:304] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:24.267463  9970 raft_consensus.cc:3060] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.274911  9970 raft_consensus.cc:2749] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.277072  9986 raft_consensus.cc:493] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.277629  9986 raft_consensus.cc:515] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.279706  9986 leader_election.cc:290] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.281219  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:24.282171  9850 raft_consensus.cc:2393] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2c1f1edc05483e96e568426b620118 in current term 1: Already voted for candidate 20a79ac461c34734abd4f11320fde479 in this term.
I20260709 13:14:24.282384  9848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:41328
I20260709 13:14:24.282974  9848 raft_consensus.cc:606] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:24.281311  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:24.285548  9739 leader_election.cc:304] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118; no voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.286702  9986 raft_consensus.cc:3060] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.288545  9971 consensus_queue.cc:1048] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.289698  9923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
mode: GRACEFUL
new_leader_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:14:24.290350  9923 raft_consensus.cc:606] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Received request to transfer leadership to TS 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.295610  9986 raft_consensus.cc:2749] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.307173 10003 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.307715 10003 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.309811 10003 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:24.311280  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:37368
I20260709 13:14:24.311918  9774 raft_consensus.cc:606] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Received request to transfer leadership to TS 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.312557  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:24.313329  9775 raft_consensus.cc:2393] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20a79ac461c34734abd4f11320fde479 in current term 1: Already voted for candidate 95f5fe3584c844058f971777c75ddfb2 in this term.
I20260709 13:14:24.313476 10032 consensus_queue.cc:1048] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.319636  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:24.321095  9986 consensus_queue.cc:1048] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.321825  9889 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20a79ac461c34734abd4f11320fde479; no voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.323021 10003 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.332219 10003 raft_consensus.cc:2749] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.332774  9922 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.332562  9921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
mode: GRACEFUL
new_leader_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:14:24.333561  9921 raft_consensus.cc:606] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Received request to transfer leadership to TS 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.341545  9775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:37368
I20260709 13:14:24.342181  9775 raft_consensus.cc:606] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Received request to transfer leadership to TS 20a79ac461c34734abd4f11320fde479
I20260709 13:14:24.342557  9970 consensus_queue.cc:1048] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.355325 10006 consensus_queue.cc:1048] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.358202 10006 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.358987 10006 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.363722  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b2c1f1edc05483e96e568426b620118" is_pre_election: true
I20260709 13:14:24.364573  9774 raft_consensus.cc:2393] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95f5fe3584c844058f971777c75ddfb2 in current term 1: Already voted for candidate 20a79ac461c34734abd4f11320fde479 in this term.
I20260709 13:14:24.364892 10006 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.366729  9986 raft_consensus.cc:493] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.366627  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:24.368597  9986 raft_consensus.cc:515] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.369716  9814 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:24.370621  9986 leader_election.cc:290] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.371475  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95f5fe3584c844058f971777c75ddfb2" is_pre_election: true
I20260709 13:14:24.371711 10006 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.372265  9848 raft_consensus.cc:2393] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b2c1f1edc05483e96e568426b620118 in current term 1: Already voted for candidate 20a79ac461c34734abd4f11320fde479 in this term.
I20260709 13:14:24.374182  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20a79ac461c34734abd4f11320fde479" is_pre_election: true
I20260709 13:14:24.375980  9739 leader_election.cc:304] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118; no voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:24.376649  9986 consensus_queue.cc:1048] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.377063 10032 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.379390 10006 raft_consensus.cc:2749] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.382532  9971 consensus_queue.cc:1048] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.384106 10032 raft_consensus.cc:2749] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:24.391481  9986 consensus_queue.cc:1048] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.392371  9993 raft_consensus.cc:993] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:24.392833  9993 raft_consensus.cc:1081] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Signalling peer 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:24.398854  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:14:24.400388  9848 raft_consensus.cc:493] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.400987  9848 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.401630  9923 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.410485  9848 raft_consensus.cc:515] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.411867  9850 raft_consensus.cc:1240] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Rejecting Update request from peer 2b2c1f1edc05483e96e568426b620118 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:24.411831  9971 consensus_queue.cc:1048] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:24.412537  9986 consensus_queue.cc:1048] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.415820  9775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:24.416430  9775 raft_consensus.cc:3055] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.416687  9848 leader_election.cc:290] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.416791  9775 raft_consensus.cc:740] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:24.417320  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:24.417661  9775 consensus_queue.cc:260] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.418810  9986 consensus_queue.cc:1059] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.422092  9775 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.433100 10003 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.435681  9775 raft_consensus.cc:2468] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 2.
I20260709 13:14:24.437412  9814 leader_election.cc:304] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 20a79ac461c34734abd4f11320fde479
I20260709 13:14:24.439136 10006 raft_consensus.cc:2804] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.439823 10006 raft_consensus.cc:697] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:24.440976 10006 consensus_queue.cc:237] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.449376 10003 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.462033  9923 raft_consensus.cc:3060] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:24.465910  9673 catalog_manager.cc:5697] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 1 to 2, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.468211 10014 raft_consensus.cc:993] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: : Instructing follower 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:24.468739  9974 raft_consensus.cc:1081] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Signalling peer 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:24.470712  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:14:24.471220  9848 raft_consensus.cc:493] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.471549  9848 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.479094  9848 raft_consensus.cc:515] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.479808  9986 consensus_queue.cc:1048] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.480219  9850 raft_consensus.cc:1240] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Rejecting Update request from peer 20a79ac461c34734abd4f11320fde479 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:24.482547  9848 leader_election.cc:290] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.483790  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:24.484422  9922 raft_consensus.cc:3055] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.484760  9922 raft_consensus.cc:740] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.485631  9922 consensus_queue.cc:260] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.486913  9922 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.493618  9974 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.493978  9922 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 2.
I20260709 13:14:24.482477  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:24.494943  9774 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.495671  9814 leader_election.cc:304] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:24.496567 10006 raft_consensus.cc:2804] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.497066 10006 raft_consensus.cc:697] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:24.497898 10006 consensus_queue.cc:237] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.502926  9774 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 2.
I20260709 13:14:24.507393 10003 raft_consensus.cc:993] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:24.507867 10003 raft_consensus.cc:1081] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:24.510377  9774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37356
I20260709 13:14:24.512171  9774 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.512607  9774 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.507757  9672 catalog_manager.cc:5697] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 1 to 2, leader changed from 20a79ac461c34734abd4f11320fde479 (127.8.238.195) to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.518466 10003 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.519065  9774 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.522029  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:24.522648  9850 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.526384  9774 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 2 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.526376  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:24.527511  9922 raft_consensus.cc:3055] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.527832  9922 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.528666  9850 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 2.
I20260709 13:14:24.528666  9922 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.529633  9848 raft_consensus.cc:1240] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Rejecting Update request from peer 20a79ac461c34734abd4f11320fde479 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:14:24.530005  9922 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.530262  9740 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:24.531158  9986 raft_consensus.cc:2804] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.531643  9986 raft_consensus.cc:697] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:24.532473  9986 consensus_queue.cc:237] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.536746  9922 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 2.
I20260709 13:14:24.539623  9672 catalog_manager.cc:5697] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 1 to 2, leader changed from 20a79ac461c34734abd4f11320fde479 (127.8.238.195) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.593509 10003 consensus_queue.cc:1048] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.601223  9974 raft_consensus.cc:993] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: : Instructing follower 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:24.601706  9974 raft_consensus.cc:1081] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Signalling peer 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:24.602993 10006 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.605966  9850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:41322
I20260709 13:14:24.606663  9850 raft_consensus.cc:493] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.606988  9850 raft_consensus.cc:3060] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.606781  9974 consensus_queue.cc:1048] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.613555  9850 raft_consensus.cc:515] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.627568  9850 leader_election.cc:290] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.628408  9970 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.628901  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:24.629467  9923 raft_consensus.cc:3055] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.623591  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec2035d440e4ea78413f2bc9d739399" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:24.629799  9923 raft_consensus.cc:740] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.630136  9774 raft_consensus.cc:3060] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.630646  9923 consensus_queue.cc:260] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.631832  9923 raft_consensus.cc:3060] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.638634  9970 raft_consensus.cc:993] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:24.639106  9923 raft_consensus.cc:2468] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 2.
I20260709 13:14:24.639139  9970 raft_consensus.cc:1081] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:24.641371  9775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37350
I20260709 13:14:24.641983  9775 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.642616  9775 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.643383  9774 raft_consensus.cc:2468] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 2.
I20260709 13:14:24.641369  9814 leader_election.cc:304] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:24.645008  9970 raft_consensus.cc:2804] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.645519  9970 raft_consensus.cc:697] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:24.646354  9970 consensus_queue.cc:237] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.649963  9775 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.653079  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:24.653079  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:24.653820  9923 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.653895  9850 raft_consensus.cc:3055] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.654321  9850 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:24.654327  9673 catalog_manager.cc:5697] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 1 to 2, leader changed from 20a79ac461c34734abd4f11320fde479 (127.8.238.195) to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.655113  9850 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.656147  9850 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.660292  9923 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 2.
I20260709 13:14:24.661010  9775 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 2 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:24.661484  9850 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 2.
I20260709 13:14:24.661445  9739 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 
I20260709 13:14:24.662499  9986 raft_consensus.cc:2804] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.663002  9986 raft_consensus.cc:697] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:24.663811  9986 consensus_queue.cc:237] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.670809  9672 catalog_manager.cc:5697] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 1 to 2, leader changed from 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.878464  9923 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.883540  9923 raft_consensus.cc:1275] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.884955  9970 consensus_queue.cc:1048] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.890800  9993 raft_consensus.cc:993] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:24.891276  9993 raft_consensus.cc:1081] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Signalling peer 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:24.894134  9923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:60922
I20260709 13:14:24.895521  9775 raft_consensus.cc:1275] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.895568  9923 raft_consensus.cc:493] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.899555  9923 raft_consensus.cc:3060] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.898483 10006 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:24.898984  9775 raft_consensus.cc:1275] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.905998 10000 consensus_queue.cc:1048] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.909106  9923 raft_consensus.cc:515] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.911448  9923 leader_election.cc:290] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 2 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:24.912134  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:24.912767  9774 raft_consensus.cc:3055] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.913091  9774 raft_consensus.cc:740] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:24.913875  9774 consensus_queue.cc:260] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.915226  9774 raft_consensus.cc:3060] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.917605  9923 raft_consensus.cc:1275] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.917605  9922 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.919283 10052 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.919687  9986 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.923817  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f6825f842aa49aebda3e2ce0970db5d" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:24.924438  9850 raft_consensus.cc:3060] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.924908  9774 raft_consensus.cc:2468] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 2.
I20260709 13:14:24.926146  9888 leader_election.cc:304] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 
I20260709 13:14:24.927398  9974 raft_consensus.cc:2804] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.927865  9974 raft_consensus.cc:697] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 2 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:24.928674  9974 consensus_queue.cc:237] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:24.933904  9850 raft_consensus.cc:2468] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 2.
I20260709 13:14:24.934505  9848 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.935922 10032 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:24.945624  9672 catalog_manager.cc:5697] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 1 to 2, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.091929  9774 raft_consensus.cc:1275] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.093279 10052 consensus_queue.cc:1048] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.101581  9923 raft_consensus.cc:1275] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.103994 10006 consensus_queue.cc:1048] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.222471  9848 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.223764 10032 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.233439  9923 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.234777  9971 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.404738  9848 raft_consensus.cc:1275] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.406049  9974 consensus_queue.cc:1048] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.416302  9774 raft_consensus.cc:1275] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.418002 10014 consensus_queue.cc:1048] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:27.374295  9147 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:14:27.375046  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:27.395426  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:14:27.395975  9774 raft_consensus.cc:606] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Received request to transfer leadership to TS 20a79ac461c34734abd4f11320fde479
I20260709 13:14:27.398525  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:14:27.399041  9774 raft_consensus.cc:606] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Received request to transfer leadership to TS 20a79ac461c34734abd4f11320fde479
I20260709 13:14:27.400151  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:27.400602  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:27.765318 10032 raft_consensus.cc:993] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:27.765766 10032 raft_consensus.cc:1081] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Signalling peer 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:27.767212  9923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:60922
I20260709 13:14:27.767643  9923 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.767889  9923 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:27.772305  9923 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:27.773684  9923 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:27.774727  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:27.774727  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:27.775496  9848 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:27.775570  9774 raft_consensus.cc:3055] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:27.776028  9774 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:27.776854  9774 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:27.778062  9774 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:27.783037  9848 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 3.
I20260709 13:14:27.784571  9889 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:27.785287 10014 raft_consensus.cc:2804] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:27.785257  9774 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 3.
I20260709 13:14:27.786839 10014 raft_consensus.cc:697] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:27.787832 10014 consensus_queue.cc:237] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:27.794832  9672 catalog_manager.cc:5697] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 2 to 3, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:27.977577 10060 raft_consensus.cc:993] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:27.978005 10032 raft_consensus.cc:1081] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Signalling peer 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:27.979491  9923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:60922
I20260709 13:14:27.979951  9923 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:27.980242  9923 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:27.984543  9923 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:27.986001  9923 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:27.987072  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:27.987021  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:27.987742  9848 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:27.987776  9774 raft_consensus.cc:3055] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:27.988281  9774 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:27.989090  9774 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:27.990348  9774 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:27.995357  9848 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 3.
I20260709 13:14:27.996613  9889 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:27.997465 10014 raft_consensus.cc:2804] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:27.997435  9774 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 3.
I20260709 13:14:27.998126 10014 raft_consensus.cc:697] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:27.999034 10014 consensus_queue.cc:237] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.005813  9672 catalog_manager.cc:5697] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 2 to 3, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:28.243434  9850 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:28.244721 10014 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:28.254457  9774 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:28.256145 10014 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:28.401420  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:28.421432  9923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:14:28.421954  9923 raft_consensus.cc:606] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:28.426847  9923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:60944
I20260709 13:14:28.427335  9923 raft_consensus.cc:606] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:28.432240  9850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:41328
I20260709 13:14:28.432789  9850 raft_consensus.cc:606] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:28.437886  9850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:41328
I20260709 13:14:28.438423  9850 raft_consensus.cc:606] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:28.443476  9850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
mode: GRACEFUL
new_leader_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:41328
I20260709 13:14:28.443943  9850 raft_consensus.cc:606] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Received request to transfer leadership to TS 2b2c1f1edc05483e96e568426b620118
I20260709 13:14:28.471390  9850 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:28.472687 10014 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:28.484243  9774 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:28.485834 10014 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:28.496692 10061 raft_consensus.cc:993] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.497148 10014 raft_consensus.cc:1081] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.498854  9774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37356
I20260709 13:14:28.499432  9774 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.500363  9774 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.504884  9774 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.507659  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:28.507120  9774 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 4 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:28.507580  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:28.508289  9923 raft_consensus.cc:3055] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:28.508608  9923 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:28.508896  9850 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.509335  9923 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.510309  9923 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.514796  9850 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 4.
I20260709 13:14:28.515878  9740 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:28.516053  9923 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 4.
I20260709 13:14:28.516607 10032 raft_consensus.cc:2804] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:28.517575 10032 raft_consensus.cc:697] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:28.518405 10032 consensus_queue.cc:237] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.524380  9670 catalog_manager.cc:5697] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 3 to 4, leader changed from 20a79ac461c34734abd4f11320fde479 (127.8.238.195) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 4 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.534134 10080 raft_consensus.cc:993] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.534678 10006 raft_consensus.cc:1081] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.536198  9774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37350
I20260709 13:14:28.536680  9774 raft_consensus.cc:493] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.536996  9774 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.542387  9774 raft_consensus.cc:515] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.543800  9774 leader_election.cc:290] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 3 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:28.544811  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:28.544721  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e76349b7bef4a0dbbdde52d585ffc8c" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:28.545446  9923 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.545521  9850 raft_consensus.cc:3055] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:28.545961  9850 raft_consensus.cc:740] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:28.546686  9850 consensus_queue.cc:260] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.547590  9850 raft_consensus.cc:3060] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.549780  9923 raft_consensus.cc:2468] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 3.
I20260709 13:14:28.550841  9739 leader_election.cc:304] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 
I20260709 13:14:28.551553 10032 raft_consensus.cc:2804] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:28.551977 10032 raft_consensus.cc:697] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:28.552579  9850 raft_consensus.cc:2468] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 3.
I20260709 13:14:28.552763 10032 consensus_queue.cc:237] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.560078  9670 catalog_manager.cc:5697] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 2 to 3, leader changed from 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.721915 10080 raft_consensus.cc:993] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.722358 10006 raft_consensus.cc:1081] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.723825  9774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37350
I20260709 13:14:28.724308  9774 raft_consensus.cc:493] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.724592  9774 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.728713  9774 raft_consensus.cc:515] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.730208  9774 leader_election.cc:290] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 3 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:28.731202  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:28.731400  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:28.731844  9923 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.731854  9850 raft_consensus.cc:3055] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:28.732388  9850 raft_consensus.cc:740] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:28.733192  9850 consensus_queue.cc:260] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.734458  9850 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.738678  9923 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 3.
I20260709 13:14:28.739823  9739 leader_election.cc:304] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 
I20260709 13:14:28.740614 10032 raft_consensus.cc:2804] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:28.741225  9850 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 3.
I20260709 13:14:28.741879 10032 raft_consensus.cc:697] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:28.742705 10032 consensus_queue.cc:237] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.749730  9670 catalog_manager.cc:5697] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 2 to 3, leader changed from 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.788462 10014 raft_consensus.cc:993] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.788908 10074 raft_consensus.cc:1081] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.790503  9774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37356
I20260709 13:14:28.791062  9774 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.791396  9774 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.795768  9774 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.797235  9774 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 4 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:28.798275  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:28.798174  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:28.798954  9922 raft_consensus.cc:3055] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:28.799091  9850 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.799362  9922 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:28.800220  9922 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.801469  9922 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:28.806313  9850 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 4.
I20260709 13:14:28.807663  9740 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b2c1f1edc05483e96e568426b620118, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:28.808338  9922 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 4.
I20260709 13:14:28.808389 10032 raft_consensus.cc:2804] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:28.808954 10032 raft_consensus.cc:697] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:28.809785 10032 consensus_queue.cc:237] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.815757  9670 catalog_manager.cc:5697] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 3 to 4, leader changed from 20a79ac461c34734abd4f11320fde479 (127.8.238.195) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 4 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.917301 10080 raft_consensus.cc:993] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: : Instructing follower 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.917732 10006 raft_consensus.cc:1081] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Signalling peer 2b2c1f1edc05483e96e568426b620118 to start an election
I20260709 13:14:28.919237  9774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
 from {username='slave'} at 127.0.0.1:37350
I20260709 13:14:28.919692  9774 raft_consensus.cc:493] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.919975  9774 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.924149  9774 raft_consensus.cc:515] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.925578  9774 leader_election.cc:290] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 2 election: Requested vote from peers 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:28.926482  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:28.926633  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "2b2c1f1edc05483e96e568426b620118" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:28.927031  9850 raft_consensus.cc:3055] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:28.927160  9922 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.927351  9850 raft_consensus.cc:740] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:28.928083  9850 consensus_queue.cc:260] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.929010  9850 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.932482  9922 raft_consensus.cc:2468] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 2.
I20260709 13:14:28.933632  9850 raft_consensus.cc:2468] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b2c1f1edc05483e96e568426b620118 in term 2.
I20260709 13:14:28.933597  9739 leader_election.cc:304] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 2b2c1f1edc05483e96e568426b620118; no voters: 
I20260709 13:14:28.934566 10032 raft_consensus.cc:2804] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:28.935006 10032 raft_consensus.cc:697] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Becoming Leader. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:28.935736 10032 consensus_queue.cc:237] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:28.942386  9670 catalog_manager.cc:5697] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 reported cstate change: term changed from 1 to 2, leader changed from 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194) to 2b2c1f1edc05483e96e568426b620118 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "2b2c1f1edc05483e96e568426b620118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.063513  9850 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:29.064769 10032 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.073174  9922 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:29.075416 10082 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.104045  9922 raft_consensus.cc:1275] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.105269 10082 consensus_queue.cc:1048] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.111632  9850 raft_consensus.cc:1275] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.113487 10076 consensus_queue.cc:1048] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.127084  9922 raft_consensus.cc:1275] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.128522 10076 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.138289  9848 raft_consensus.cc:1275] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.140760 10076 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.227856  9922 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:29.229164 10082 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.236718  9848 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:29.238787 10076 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:29.530815  9848 raft_consensus.cc:1275] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:29.532265 10076 consensus_queue.cc:1048] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:29.538688  9922 raft_consensus.cc:1275] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Refusing update from remote peer 2b2c1f1edc05483e96e568426b620118: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:29.540418 10082 consensus_queue.cc:1048] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.451377  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:31.459362  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:14:31.460055  9774 raft_consensus.cc:606] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Received request to transfer leadership to TS 20a79ac461c34734abd4f11320fde479
I20260709 13:14:31.462916  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:14:31.463503  9774 raft_consensus.cc:606] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Received request to transfer leadership to TS 20a79ac461c34734abd4f11320fde479
I20260709 13:14:31.466115  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:14:31.466655  9774 raft_consensus.cc:606] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Received request to transfer leadership to TS 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:31.469844  9774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7"
dest_uuid: "2b2c1f1edc05483e96e568426b620118"
mode: GRACEFUL
new_leader_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:14:31.470324  9774 raft_consensus.cc:606] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Received request to transfer leadership to TS 95f5fe3584c844058f971777c75ddfb2
I20260709 13:14:31.471316  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:31.471719  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:31.840793 10095 raft_consensus.cc:993] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:31.841327 10096 raft_consensus.cc:1081] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Signalling peer 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:31.843053  9922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:60922
I20260709 13:14:31.843587  9922 raft_consensus.cc:493] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.843923  9922 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.849741  9922 raft_consensus.cc:515] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.851979  9922 leader_election.cc:290] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 5 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:31.853220  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:31.853022  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af87af0b4eec4c4cb597b2984d0a3311" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:31.853847  9848 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.853876  9774 raft_consensus.cc:3055] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:31.854279  9774 raft_consensus.cc:740] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:31.855038  9774 consensus_queue.cc:260] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.856092  9774 raft_consensus.cc:3060] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.860066 10095 raft_consensus.cc:993] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:31.860004  9848 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 5.
I20260709 13:14:31.860632 10095 raft_consensus.cc:1081] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Signalling peer 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:31.861531  9889 leader_election.cc:304] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:31.862636 10074 raft_consensus.cc:2804] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:31.862955  9774 raft_consensus.cc:2468] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 5.
I20260709 13:14:31.863744 10074 raft_consensus.cc:697] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 5 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:31.864612 10074 consensus_queue.cc:237] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.862545  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:14:31.866923  9848 raft_consensus.cc:493] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.867244  9848 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.872318  9670 catalog_manager.cc:5697] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 4 to 5, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.872694  9848 raft_consensus.cc:515] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.874711  9848 leader_election.cc:290] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 4 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:31.875953  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:31.876588  9774 raft_consensus.cc:3055] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:31.876900  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f0fa8f7e9444368d479a913c39f2ed" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:31.876966  9774 raft_consensus.cc:740] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:31.877669  9922 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.878475  9774 consensus_queue.cc:260] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.879760  9774 raft_consensus.cc:3060] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:31.885020  9922 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 4.
I20260709 13:14:31.886642  9774 raft_consensus.cc:2468] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 4.
I20260709 13:14:31.886613  9814 leader_election.cc:304] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:31.887868 10006 raft_consensus.cc:2804] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:31.890132 10006 raft_consensus.cc:697] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 4 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:31.891189 10006 consensus_queue.cc:237] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.900069  9670 catalog_manager.cc:5697] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 3 to 4, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.930140 10096 raft_consensus.cc:993] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:31.930686 10095 raft_consensus.cc:1081] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Signalling peer 20a79ac461c34734abd4f11320fde479 to start an election
I20260709 13:14:31.932119  9922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18c34ce0605b46bb94603154341ea026"
dest_uuid: "20a79ac461c34734abd4f11320fde479"
 from {username='slave'} at 127.0.0.1:60922
I20260709 13:14:31.932689  9922 raft_consensus.cc:493] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.932984  9922 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.937191  9922 raft_consensus.cc:515] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.938803  9922 leader_election.cc:290] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 5 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194:38719)
I20260709 13:14:31.939867  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:31.939999  9848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c34ce0605b46bb94603154341ea026" candidate_uuid: "20a79ac461c34734abd4f11320fde479" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
I20260709 13:14:31.940402  9774 raft_consensus.cc:3055] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:31.940541  9848 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.940708  9774 raft_consensus.cc:740] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:31.941431  9774 consensus_queue.cc:260] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.942446  9774 raft_consensus.cc:3060] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:31.945000  9848 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 5.
I20260709 13:14:31.946135  9889 leader_election.cc:304] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:31.947070 10074 raft_consensus.cc:2804] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:31.947324  9774 raft_consensus.cc:2468] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20a79ac461c34734abd4f11320fde479 in term 5.
I20260709 13:14:31.947507 10074 raft_consensus.cc:697] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 5 LEADER]: Becoming Leader. State: Replica: 20a79ac461c34734abd4f11320fde479, State: Running, Role: LEADER
I20260709 13:14:31.948549 10074 consensus_queue.cc:237] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.955163  9670 catalog_manager.cc:5697] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 reported cstate change: term changed from 4 to 5, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 20a79ac461c34734abd4f11320fde479 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "20a79ac461c34734abd4f11320fde479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.986141 10096 raft_consensus.cc:993] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: : Instructing follower 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:31.986689 10095 raft_consensus.cc:1081] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Signalling peer 95f5fe3584c844058f971777c75ddfb2 to start an election
I20260709 13:14:31.988128  9848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7"
dest_uuid: "95f5fe3584c844058f971777c75ddfb2"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:14:31.988529  9848 raft_consensus.cc:493] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.988770  9848 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.992754  9848 raft_consensus.cc:515] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.994349  9848 leader_election.cc:290] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 3 election: Requested vote from peers 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253), 20a79ac461c34734abd4f11320fde479 (127.8.238.195:39209)
I20260709 13:14:31.995049  9774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b2c1f1edc05483e96e568426b620118"
I20260709 13:14:31.995476  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daaa21a67e114fe58405c6495031b3c7" candidate_uuid: "95f5fe3584c844058f971777c75ddfb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20a79ac461c34734abd4f11320fde479"
I20260709 13:14:31.995620  9774 raft_consensus.cc:3055] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.995929  9922 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.995976  9774 raft_consensus.cc:740] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b2c1f1edc05483e96e568426b620118, State: Running, Role: LEADER
I20260709 13:14:31.996815  9774 consensus_queue.cc:260] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:31.997758  9774 raft_consensus.cc:3060] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:32.000790  9922 raft_consensus.cc:2468] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 3.
I20260709 13:14:32.001917  9814 leader_election.cc:304] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20a79ac461c34734abd4f11320fde479, 95f5fe3584c844058f971777c75ddfb2; no voters: 
I20260709 13:14:32.002714 10006 raft_consensus.cc:2804] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:32.003114 10006 raft_consensus.cc:697] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 3 LEADER]: Becoming Leader. State: Replica: 95f5fe3584c844058f971777c75ddfb2, State: Running, Role: LEADER
I20260709 13:14:32.003124  9774 raft_consensus.cc:2468] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f5fe3584c844058f971777c75ddfb2 in term 3.
I20260709 13:14:32.004060 10006 consensus_queue.cc:237] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } }
I20260709 13:14:32.010788  9670 catalog_manager.cc:5697] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 reported cstate change: term changed from 2 to 3, leader changed from 2b2c1f1edc05483e96e568426b620118 (127.8.238.193) to 95f5fe3584c844058f971777c75ddfb2 (127.8.238.194). New cstate: current_term: 3 leader_uuid: "95f5fe3584c844058f971777c75ddfb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.354574  9848 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:32.355767 10074 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:32.366811  9774 raft_consensus.cc:1275] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:32.368672 10109 consensus_queue.cc:1048] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:32.428467  9774 raft_consensus.cc:1275] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:32.429984 10006 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:32.439750  9922 raft_consensus.cc:1275] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:32.441382 10006 consensus_queue.cc:1048] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:32.460767  9922 raft_consensus.cc:1275] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:32.463172 10114 consensus_queue.cc:1048] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20a79ac461c34734abd4f11320fde479" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:32.472530  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:32.475898  9774 raft_consensus.cc:1275] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Refusing update from remote peer 95f5fe3584c844058f971777c75ddfb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:32.477623 10114 consensus_queue.cc:1048] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b2c1f1edc05483e96e568426b620118" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.478638  9848 raft_consensus.cc:1275] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Refusing update from remote peer 20a79ac461c34734abd4f11320fde479: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:32.480474 10109 consensus_queue.cc:1048] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95f5fe3584c844058f971777c75ddfb2" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:32.485070  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
W20260709 13:14:32.503587  9888 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:14:32.513376  9888 consensus_peers.cc:597] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 -> Peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Couldn't send request to peer 2b2c1f1edc05483e96e568426b620118. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.541643  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:32.542469  9147 tablet_replica.cc:333] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.543119  9147 raft_consensus.cc:2243] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.543627  9147 raft_consensus.cc:2272] T 8ec2035d440e4ea78413f2bc9d739399 P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.545545  9147 tablet_replica.cc:333] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.546118  9147 raft_consensus.cc:2243] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.546615  9147 raft_consensus.cc:2272] T af87af0b4eec4c4cb597b2984d0a3311 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.548719  9147 tablet_replica.cc:333] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.549263  9147 raft_consensus.cc:2243] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.550045  9147 raft_consensus.cc:2272] T 2e76349b7bef4a0dbbdde52d585ffc8c P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.551780  9147 tablet_replica.cc:333] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.552299  9147 raft_consensus.cc:2243] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.552711  9147 raft_consensus.cc:2272] T daaa21a67e114fe58405c6495031b3c7 P 2b2c1f1edc05483e96e568426b620118 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.555040  9147 tablet_replica.cc:333] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.555567  9147 raft_consensus.cc:2243] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.555997  9147 raft_consensus.cc:2272] T c7f0fa8f7e9444368d479a913c39f2ed P 2b2c1f1edc05483e96e568426b620118 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.558115  9147 tablet_replica.cc:333] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.558709  9147 raft_consensus.cc:2243] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.559104  9147 raft_consensus.cc:2272] T 18c34ce0605b46bb94603154341ea026 P 2b2c1f1edc05483e96e568426b620118 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.561040  9147 tablet_replica.cc:333] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.561681  9147 raft_consensus.cc:2243] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.562320  9147 raft_consensus.cc:2272] T 3f6825f842aa49aebda3e2ce0970db5d P 2b2c1f1edc05483e96e568426b620118 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.564447  9147 tablet_replica.cc:333] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.564980  9147 raft_consensus.cc:2243] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.565745  9147 raft_consensus.cc:2272] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.567724  9147 tablet_replica.cc:333] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.568187  9147 raft_consensus.cc:2243] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.568946  9147 raft_consensus.cc:2272] T e021c16e5d904c41a84dc1e103f2e11c P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.570739  9147 tablet_replica.cc:333] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118: stopping tablet replica
I20260709 13:14:32.571197  9147 raft_consensus.cc:2243] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.571928  9147 raft_consensus.cc:2272] T 19c32ea8fcce4970b3dffade8d5fe11b P 2b2c1f1edc05483e96e568426b620118 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:32.584697  9738 connection.cc:466] server connection from 127.0.0.1:37350 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37350 (request call id 73) could send its response
W20260709 13:14:32.585636  9814 consensus_peers.cc:597] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 -> Peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Couldn't send request to peer 2b2c1f1edc05483e96e568426b620118. Status: Network error: recv got EOF from 127.8.238.193:42253 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.602861  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
W20260709 13:14:32.622366  9888 consensus_peers.cc:597] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 -> Peer 2b2c1f1edc05483e96e568426b620118 (127.8.238.193:42253): Couldn't send request to peer 2b2c1f1edc05483e96e568426b620118. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:42253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.626592  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
I20260709 13:14:32.651099  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:32.651865  9147 tablet_replica.cc:333] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.652899  9147 raft_consensus.cc:2243] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.653537  9147 raft_consensus.cc:2272] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.655411  9147 tablet_replica.cc:333] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.655928  9147 raft_consensus.cc:2243] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.656333  9147 raft_consensus.cc:2272] T e021c16e5d904c41a84dc1e103f2e11c P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.657989  9147 tablet_replica.cc:333] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.658546  9147 raft_consensus.cc:2243] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.658926  9147 raft_consensus.cc:2272] T 19c32ea8fcce4970b3dffade8d5fe11b P 95f5fe3584c844058f971777c75ddfb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.660565  9147 tablet_replica.cc:333] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.661033  9147 raft_consensus.cc:2243] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.661433  9147 raft_consensus.cc:2272] T 18c34ce0605b46bb94603154341ea026 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.663501  9147 tablet_replica.cc:333] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.663986  9147 raft_consensus.cc:2243] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.664688  9147 raft_consensus.cc:2272] T c7f0fa8f7e9444368d479a913c39f2ed P 95f5fe3584c844058f971777c75ddfb2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.666883  9147 tablet_replica.cc:333] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.667356  9147 raft_consensus.cc:2243] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.668067  9147 raft_consensus.cc:2272] T 8ec2035d440e4ea78413f2bc9d739399 P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.669775  9147 tablet_replica.cc:333] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.670305  9147 raft_consensus.cc:2243] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.670735  9147 raft_consensus.cc:2272] T af87af0b4eec4c4cb597b2984d0a3311 P 95f5fe3584c844058f971777c75ddfb2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.672639  9147 tablet_replica.cc:333] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.673089  9147 raft_consensus.cc:2243] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.673453  9147 raft_consensus.cc:2272] T 2e76349b7bef4a0dbbdde52d585ffc8c P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.675122  9147 tablet_replica.cc:333] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.675529  9147 raft_consensus.cc:2243] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.676187  9147 raft_consensus.cc:2272] T daaa21a67e114fe58405c6495031b3c7 P 95f5fe3584c844058f971777c75ddfb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.678129  9147 tablet_replica.cc:333] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2: stopping tablet replica
I20260709 13:14:32.678589  9147 raft_consensus.cc:2243] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.678942  9147 raft_consensus.cc:2272] T 3f6825f842aa49aebda3e2ce0970db5d P 95f5fe3584c844058f971777c75ddfb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.707420  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
I20260709 13:14:32.726349  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
I20260709 13:14:32.756920  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:32.757705  9147 tablet_replica.cc:333] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.758651  9147 raft_consensus.cc:2243] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.759711  9147 raft_consensus.cc:2272] T 3f6825f842aa49aebda3e2ce0970db5d P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.761456  9147 tablet_replica.cc:333] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.761934  9147 raft_consensus.cc:2243] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.762458  9147 raft_consensus.cc:2272] T 2e76349b7bef4a0dbbdde52d585ffc8c P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.764074  9147 tablet_replica.cc:333] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.764523  9147 raft_consensus.cc:2243] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.764909  9147 raft_consensus.cc:2272] T daaa21a67e114fe58405c6495031b3c7 P 20a79ac461c34734abd4f11320fde479 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.767007  9147 tablet_replica.cc:333] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.767534  9147 raft_consensus.cc:2243] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.767936  9147 raft_consensus.cc:2272] T 19c32ea8fcce4970b3dffade8d5fe11b P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.769680  9147 tablet_replica.cc:333] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.770139  9147 raft_consensus.cc:2243] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.770932  9147 raft_consensus.cc:2272] T 18c34ce0605b46bb94603154341ea026 P 20a79ac461c34734abd4f11320fde479 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.773151  9147 tablet_replica.cc:333] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.773648  9147 raft_consensus.cc:2243] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.774089  9147 raft_consensus.cc:2272] T c7f0fa8f7e9444368d479a913c39f2ed P 20a79ac461c34734abd4f11320fde479 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.776237  9147 tablet_replica.cc:333] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.776723  9147 raft_consensus.cc:2243] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.777101  9147 raft_consensus.cc:2272] T e021c16e5d904c41a84dc1e103f2e11c P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.778847  9147 tablet_replica.cc:333] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.779325  9147 raft_consensus.cc:2243] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.779708  9147 raft_consensus.cc:2272] T 9ffcb5f242f542e28b0fb4d3c940a5e1 P 20a79ac461c34734abd4f11320fde479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.781261  9147 tablet_replica.cc:333] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.781769  9147 raft_consensus.cc:2243] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.782544  9147 raft_consensus.cc:2272] T af87af0b4eec4c4cb597b2984d0a3311 P 20a79ac461c34734abd4f11320fde479 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.784384  9147 tablet_replica.cc:333] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479: stopping tablet replica
I20260709 13:14:32.784804  9147 raft_consensus.cc:2243] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:32.785185  9147 raft_consensus.cc:2272] T 8ec2035d440e4ea78413f2bc9d739399 P 20a79ac461c34734abd4f11320fde479 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.813443  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:14:32.831382  9147 master.cc:562] Master@127.8.238.254:34617 shutting down...
I20260709 13:14:32.850147  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:32.850778  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:32.851115  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P 865a55a807384888a9bfe7160135c5b6: stopping tablet replica
I20260709 13:14:32.871012  9147 master.cc:584] Master@127.8.238.254:34617 shutdown complete.
20a79ac461c34734abd4f11320fde479  1
2b2c1f1edc05483e96e568426b620118  5
95f5fe3584c844058f971777c75ddfb2  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10237 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:14:32.911628  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:38317
I20260709 13:14:32.912804  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:32.918774 10123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:32.919245 10126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:32.918776 10124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:32.923089  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:32.926708  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:32.926966  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:32.927143  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602872927125 us; error 0 us; skew 500 ppm
I20260709 13:14:32.927657  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:32.930125  9147 webserver.cc:533] Webserver started at http://127.8.238.254:46635/ using document root <none> and password file <none>
I20260709 13:14:32.930711  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:32.930932  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:32.931231  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:32.932410  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "07026dacaf3c454eb902b449c5c122fe"
format_stamp: "Formatted at 2026-07-09 13:14:32 on dist-test-slave-ml7r"
I20260709 13:14:32.937062  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:14:32.940515 10131 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:32.941282  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:14:32.941577  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "07026dacaf3c454eb902b449c5c122fe"
format_stamp: "Formatted at 2026-07-09 13:14:32 on dist-test-slave-ml7r"
I20260709 13:14:32.941877  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:32.960764  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:32.962105  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:33.000226  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:38317
I20260709 13:14:33.000319 10182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:38317 every 8 connection(s)
I20260709 13:14:33.004176 10183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.013989 10183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Bootstrap starting.
I20260709 13:14:33.018779 10183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.023288 10183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: No bootstrap required, opened a new log
I20260709 13:14:33.025449 10183 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07026dacaf3c454eb902b449c5c122fe" member_type: VOTER }
I20260709 13:14:33.025840 10183 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.026113 10183 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07026dacaf3c454eb902b449c5c122fe, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.026741 10183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07026dacaf3c454eb902b449c5c122fe" member_type: VOTER }
I20260709 13:14:33.027227 10183 raft_consensus.cc:399] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:33.027458 10183 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:33.027727 10183 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:33.032011 10183 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07026dacaf3c454eb902b449c5c122fe" member_type: VOTER }
I20260709 13:14:33.032611 10183 leader_election.cc:304] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07026dacaf3c454eb902b449c5c122fe; no voters: 
I20260709 13:14:33.033823 10183 leader_election.cc:290] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:33.034096 10186 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:33.035838 10186 raft_consensus.cc:697] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 1 LEADER]: Becoming Leader. State: Replica: 07026dacaf3c454eb902b449c5c122fe, State: Running, Role: LEADER
I20260709 13:14:33.036571 10186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07026dacaf3c454eb902b449c5c122fe" member_type: VOTER }
I20260709 13:14:33.037154 10183 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:33.041800 10187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07026dacaf3c454eb902b449c5c122fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07026dacaf3c454eb902b449c5c122fe" member_type: VOTER } }
I20260709 13:14:33.041755 10188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07026dacaf3c454eb902b449c5c122fe. Latest consensus state: current_term: 1 leader_uuid: "07026dacaf3c454eb902b449c5c122fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07026dacaf3c454eb902b449c5c122fe" member_type: VOTER } }
I20260709 13:14:33.042565 10187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:33.042635 10188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:33.048202 10195 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:33.053231 10195 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:33.054397  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:33.062122 10195 catalog_manager.cc:1383] Generated new cluster ID: 0deec0f1c19b4dc59a1617d84ee8fd03
I20260709 13:14:33.062554 10195 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:33.088546 10195 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:33.089856 10195 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:33.102586 10195 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Generated new TSK 0
I20260709 13:14:33.103201 10195 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:33.121285  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:33.126896 10204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:33.128012 10205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:33.129742 10207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:33.129966  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:33.130935  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:33.131121  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:33.131242  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602873131225 us; error 0 us; skew 500 ppm
I20260709 13:14:33.131713  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:33.134020  9147 webserver.cc:533] Webserver started at http://127.8.238.193:45125/ using document root <none> and password file <none>
I20260709 13:14:33.134560  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:33.134730  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:33.134951  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:33.136004  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
format_stamp: "Formatted at 2026-07-09 13:14:33 on dist-test-slave-ml7r"
I20260709 13:14:33.140904  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:33.144361 10212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.145085  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:33.145396  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
format_stamp: "Formatted at 2026-07-09 13:14:33 on dist-test-slave-ml7r"
I20260709 13:14:33.145673  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:33.156212  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:33.157480  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:33.159029  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:33.161360  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:33.161604  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.161867  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:33.162065  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.202144  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:40671
I20260709 13:14:33.202282 10274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:40671 every 8 connection(s)
I20260709 13:14:33.207579  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:33.215366 10279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:33.218922 10280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:33.220615 10282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:33.221442  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:33.222728  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:33.223030  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:33.223066 10275 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38317
I20260709 13:14:33.223229  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602873223214 us; error 0 us; skew 500 ppm
I20260709 13:14:33.223569 10275 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:33.223836  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:33.224438 10275 heartbeater.cc:507] Master 127.8.238.254:38317 requested a full tablet report, sending...
I20260709 13:14:33.226608  9147 webserver.cc:533] Webserver started at http://127.8.238.194:42477/ using document root <none> and password file <none>
I20260709 13:14:33.227010 10148 ts_manager.cc:194] Registered new tserver with Master: ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:33.227298  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:33.227578  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:33.227905  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:33.229557 10148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38856
I20260709 13:14:33.229684  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "cb71def93f904f619a1527aa48a32294"
format_stamp: "Formatted at 2026-07-09 13:14:33 on dist-test-slave-ml7r"
I20260709 13:14:33.234644  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:14:33.237916 10287 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.238824  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:33.239102  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "cb71def93f904f619a1527aa48a32294"
format_stamp: "Formatted at 2026-07-09 13:14:33 on dist-test-slave-ml7r"
I20260709 13:14:33.239346  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:33.259891  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:33.261075  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:33.262529  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:33.264834  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:33.265059  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.265342  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:33.265506  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.304927  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:44995
I20260709 13:14:33.305033 10349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:44995 every 8 connection(s)
I20260709 13:14:33.310295  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:33.317408 10354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:33.318323 10353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:33.321300 10356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:33.322476  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:33.322944 10350 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38317
I20260709 13:14:33.323292 10350 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:33.323529  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:33.323773  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:33.323951  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602873323931 us; error 0 us; skew 500 ppm
I20260709 13:14:33.323967 10350 heartbeater.cc:507] Master 127.8.238.254:38317 requested a full tablet report, sending...
I20260709 13:14:33.324642  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:33.326375 10148 ts_manager.cc:194] Registered new tserver with Master: cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:33.327479  9147 webserver.cc:533] Webserver started at http://127.8.238.195:40323/ using document root <none> and password file <none>
I20260709 13:14:33.328006  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:33.327975 10148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38872
I20260709 13:14:33.328346  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:33.328644  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:33.329977  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "73825599c2644b898cebaafbccd86e99"
format_stamp: "Formatted at 2026-07-09 13:14:33 on dist-test-slave-ml7r"
I20260709 13:14:33.334563  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:14:33.337774 10361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.338688  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:33.339036  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "73825599c2644b898cebaafbccd86e99"
format_stamp: "Formatted at 2026-07-09 13:14:33 on dist-test-slave-ml7r"
I20260709 13:14:33.339305  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:33.351325  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:33.352605  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:33.354086  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:33.356491  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:33.356686  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.356982  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:33.357137  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:33.397272  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:40329
I20260709 13:14:33.397347 10423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:40329 every 8 connection(s)
I20260709 13:14:33.411504 10424 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38317
I20260709 13:14:33.411849 10424 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:33.412616 10424 heartbeater.cc:507] Master 127.8.238.254:38317 requested a full tablet report, sending...
I20260709 13:14:33.414628 10148 ts_manager.cc:194] Registered new tserver with Master: 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:33.415587  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015125454s
I20260709 13:14:33.415897 10148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38876
I20260709 13:14:33.443881 10148 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38878:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:33.450356 10148 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:33.649413 10315 tablet_service.cc:1511] Processing CreateTablet for tablet 07947046eb9e42ae8ccb9083210f95f0 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:33.651403 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07947046eb9e42ae8ccb9083210f95f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.653637 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 525196bf91b04b748ae03b3fac9f4364 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:33.654822 10240 tablet_service.cc:1511] Processing CreateTablet for tablet 07947046eb9e42ae8ccb9083210f95f0 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:33.655052 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 62fd7f6040dd4ff1b75922910732a441 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:33.655428 10237 tablet_service.cc:1511] Processing CreateTablet for tablet d97c1a2214d54cff9377d68a3d00054b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:33.655827 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525196bf91b04b748ae03b3fac9f4364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.656221 10240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07947046eb9e42ae8ccb9083210f95f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.656885 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c1a2214d54cff9377d68a3d00054b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.657634 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62fd7f6040dd4ff1b75922910732a441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.659646 10238 tablet_service.cc:1511] Processing CreateTablet for tablet 62fd7f6040dd4ff1b75922910732a441 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:33.661144 10238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62fd7f6040dd4ff1b75922910732a441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.666612 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 525196bf91b04b748ae03b3fac9f4364 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:33.668104 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525196bf91b04b748ae03b3fac9f4364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.677053 10312 tablet_service.cc:1511] Processing CreateTablet for tablet d97c1a2214d54cff9377d68a3d00054b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:33.678601 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c1a2214d54cff9377d68a3d00054b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.679550 10236 tablet_service.cc:1511] Processing CreateTablet for tablet cfd747d82d6d447e9c04851a4163a863 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:33.680985 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd747d82d6d447e9c04851a4163a863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.685604 10311 tablet_service.cc:1511] Processing CreateTablet for tablet cfd747d82d6d447e9c04851a4163a863 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:33.686108 10235 tablet_service.cc:1511] Processing CreateTablet for tablet bdf450e3110e486088b3d5c7e2c7cef7 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:33.687122 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd747d82d6d447e9c04851a4163a863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.687611 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf450e3110e486088b3d5c7e2c7cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.687541 10310 tablet_service.cc:1511] Processing CreateTablet for tablet bdf450e3110e486088b3d5c7e2c7cef7 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:33.689013 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf450e3110e486088b3d5c7e2c7cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.691784 10386 tablet_service.cc:1511] Processing CreateTablet for tablet d97c1a2214d54cff9377d68a3d00054b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:14:33.692138 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 07947046eb9e42ae8ccb9083210f95f0 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:14:33.693393 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c1a2214d54cff9377d68a3d00054b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.694716 10388 tablet_service.cc:1511] Processing CreateTablet for tablet 525196bf91b04b748ae03b3fac9f4364 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:14:33.696228 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525196bf91b04b748ae03b3fac9f4364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.699923 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07947046eb9e42ae8ccb9083210f95f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.699515 10385 tablet_service.cc:1511] Processing CreateTablet for tablet cfd747d82d6d447e9c04851a4163a863 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:14:33.701076 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd747d82d6d447e9c04851a4163a863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.699515 10387 tablet_service.cc:1511] Processing CreateTablet for tablet 62fd7f6040dd4ff1b75922910732a441 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:14:33.707850 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62fd7f6040dd4ff1b75922910732a441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.728965 10384 tablet_service.cc:1511] Processing CreateTablet for tablet bdf450e3110e486088b3d5c7e2c7cef7 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:14:33.730448 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf450e3110e486088b3d5c7e2c7cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.733583 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed60181ed2d4e3782c0247f5c8a145f (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:33.727962 10234 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4768f1c2494e8e91598dcb7cfa3556 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:33.738523 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed60181ed2d4e3782c0247f5c8a145f (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:33.740283 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed60181ed2d4e3782c0247f5c8a145f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.740422 10232 tablet_service.cc:1511] Processing CreateTablet for tablet e6fa99a4824140528f1f002c969d567c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:33.738524 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4768f1c2494e8e91598dcb7cfa3556 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:33.745229 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4768f1c2494e8e91598dcb7cfa3556 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:14:33.747424 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed60181ed2d4e3782c0247f5c8a145f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.747828 10382 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed60181ed2d4e3782c0247f5c8a145f (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:14:33.749796 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fa99a4824140528f1f002c969d567c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.754904 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4768f1c2494e8e91598dcb7cfa3556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.754992 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4768f1c2494e8e91598dcb7cfa3556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.756856 10310 tablet_service.cc:1511] Processing CreateTablet for tablet e6fa99a4824140528f1f002c969d567c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:33.758340 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fa99a4824140528f1f002c969d567c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.758831 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4768f1c2494e8e91598dcb7cfa3556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.759496 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed60181ed2d4e3782c0247f5c8a145f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.759737 10439 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:33.784461 10439 tablet_bootstrap.cc:654] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.807477 10383 tablet_service.cc:1511] Processing CreateTablet for tablet e6fa99a4824140528f1f002c969d567c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:14:33.808996 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fa99a4824140528f1f002c969d567c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.809433 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 75f247057a16492c8757cbf337e8b240 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:33.814880 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f247057a16492c8757cbf337e8b240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.816738 10441 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:33.817441 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 75f247057a16492c8757cbf337e8b240 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:33.818843 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f247057a16492c8757cbf337e8b240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.819092 10440 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:33.821111 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 19b05041c6f947c3bf56f4fc003bfabb (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:33.810335 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 75f247057a16492c8757cbf337e8b240 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:14:33.827920 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f247057a16492c8757cbf337e8b240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.828645 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b05041c6f947c3bf56f4fc003bfabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.833247 10441 tablet_bootstrap.cc:654] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.841192 10439 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:33.841992 10439 ts_tablet_manager.cc:1403] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.008s
I20260709 13:14:33.844386 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 19b05041c6f947c3bf56f4fc003bfabb (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:33.844403 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 19b05041c6f947c3bf56f4fc003bfabb (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:14:33.845553 10439 raft_consensus.cc:359] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.846529 10439 raft_consensus.cc:385] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.845935 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b05041c6f947c3bf56f4fc003bfabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.845901 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b05041c6f947c3bf56f4fc003bfabb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.847077 10439 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.849109 10439 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.849731 10313 tablet_service.cc:1511] Processing CreateTablet for tablet dc2db78b356a4f57af63adec3766d44b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:33.863478 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2db78b356a4f57af63adec3766d44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.864591 10440 tablet_bootstrap.cc:654] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.854777 10233 tablet_service.cc:1511] Processing CreateTablet for tablet dc2db78b356a4f57af63adec3766d44b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:33.875182 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2db78b356a4f57af63adec3766d44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.876986 10441 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:33.877528 10441 ts_tablet_manager.cc:1403] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.013s
I20260709 13:14:33.881448 10384 tablet_service.cc:1511] Processing CreateTablet for tablet dc2db78b356a4f57af63adec3766d44b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:14:33.882714 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 16f38b8c79f844dc83f9505884422f2a (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:33.883189 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2db78b356a4f57af63adec3766d44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.884130 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f38b8c79f844dc83f9505884422f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.887509 10350 heartbeater.cc:499] Master 127.8.238.254:38317 was elected leader, sending a full tablet report...
I20260709 13:14:33.889147 10439 ts_tablet_manager.cc:1434] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.006s
I20260709 13:14:33.890311 10439 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:33.895975 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 16f38b8c79f844dc83f9505884422f2a (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:33.901503 10314 tablet_service.cc:1511] Processing CreateTablet for tablet bb19b1ef417a439c833c0b7627cf7c00 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:33.902951 10385 tablet_service.cc:1511] Processing CreateTablet for tablet bb19b1ef417a439c833c0b7627cf7c00 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:33.903045 10441 raft_consensus.cc:359] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.903882 10441 raft_consensus.cc:385] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.904202 10441 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.904377 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb19b1ef417a439c833c0b7627cf7c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.906563 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f38b8c79f844dc83f9505884422f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.907815 10439 tablet_bootstrap.cc:654] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:33.910640 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb19b1ef417a439c833c0b7627cf7c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.908352 10441 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.903093 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 16f38b8c79f844dc83f9505884422f2a (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:14:33.915632 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f38b8c79f844dc83f9505884422f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.922024 10232 tablet_service.cc:1511] Processing CreateTablet for tablet bb19b1ef417a439c833c0b7627cf7c00 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:14:33.923442 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb19b1ef417a439c833c0b7627cf7c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.923641 10424 heartbeater.cc:499] Master 127.8.238.254:38317 was elected leader, sending a full tablet report...
I20260709 13:14:33.929639 10444 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.930363 10444 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.943398 10440 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:33.944047 10440 ts_tablet_manager.cc:1403] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.000s
I20260709 13:14:33.946802 10444 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:33.949291 10441 ts_tablet_manager.cc:1434] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.071s	user 0.002s	sys 0.007s
I20260709 13:14:33.950846 10440 raft_consensus.cc:359] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.951895 10440 raft_consensus.cc:385] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:33.952277 10440 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.955241 10441 tablet_bootstrap.cc:492] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:33.959512 10440 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.961782 10439 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:33.963917 10275 heartbeater.cc:499] Master 127.8.238.254:38317 was elected leader, sending a full tablet report...
I20260709 13:14:33.975908 10237 tablet_service.cc:1511] Processing CreateTablet for tablet a6d7bac4863c4b958392d525cba4f98b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:33.977355 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d7bac4863c4b958392d525cba4f98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.982937 10440 ts_tablet_manager.cc:1434] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:14:33.996107 10440 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:33.995925 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:33.997037 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:33.999207 10290 leader_election.cc:343] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:33.984403 10439 ts_tablet_manager.cc:1403] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.094s	user 0.029s	sys 0.017s
W20260709 13:14:34.000160 10288 leader_election.cc:343] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.000638 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:34.003147 10439 raft_consensus.cc:359] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:33.992666 10441 tablet_bootstrap.cc:654] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.005134 10314 tablet_service.cc:1511] Processing CreateTablet for tablet a6d7bac4863c4b958392d525cba4f98b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:34.006443 10444 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.005852 10439 raft_consensus.cc:385] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.007102 10439 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:33.993507 10384 tablet_service.cc:1511] Processing CreateTablet for tablet a6d7bac4863c4b958392d525cba4f98b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:14:34.007519 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 2181b7acaa904976917e2c58bc8856c3 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:34.008615 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d7bac4863c4b958392d525cba4f98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.008278 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 15565c698f45442aa353abbe927bfc68 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:34.009027 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2181b7acaa904976917e2c58bc8856c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.008234 10439 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.009667 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15565c698f45442aa353abbe927bfc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.010375 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d7bac4863c4b958392d525cba4f98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.010664 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 15565c698f45442aa353abbe927bfc68 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:34.011951 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15565c698f45442aa353abbe927bfc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.012576 10439 ts_tablet_manager.cc:1434] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:34.023162 10439 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:34.024724 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 15565c698f45442aa353abbe927bfc68 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:14:34.026142 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15565c698f45442aa353abbe927bfc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.020617 10440 tablet_bootstrap.cc:654] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.030277 10439 tablet_bootstrap.cc:654] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.031867 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 2181b7acaa904976917e2c58bc8856c3 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:34.033262 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2181b7acaa904976917e2c58bc8856c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.033190 10233 tablet_service.cc:1511] Processing CreateTablet for tablet ee5a9192e938463ea07352f70853ef2e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:34.034621 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5a9192e938463ea07352f70853ef2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.034904 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 2181b7acaa904976917e2c58bc8856c3 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:14:34.040199 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2181b7acaa904976917e2c58bc8856c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.039860 10313 tablet_service.cc:1511] Processing CreateTablet for tablet ee5a9192e938463ea07352f70853ef2e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:34.041178 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5a9192e938463ea07352f70853ef2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:34.049295 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:34.054838 10383 tablet_service.cc:1511] Processing CreateTablet for tablet ee5a9192e938463ea07352f70853ef2e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:14:34.056169 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5a9192e938463ea07352f70853ef2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.070369 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0293dc4ca94845b6d1f8991514db3e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:34.071733 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0293dc4ca94845b6d1f8991514db3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.079689 10441 tablet_bootstrap.cc:492] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:34.080456 10441 ts_tablet_manager.cc:1403] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.003s
I20260709 13:14:34.080929 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0293dc4ca94845b6d1f8991514db3e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:34.082399 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0293dc4ca94845b6d1f8991514db3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.082192 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4dd97a92804cc6927c6fff64d16f39 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:34.083561 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4dd97a92804cc6927c6fff64d16f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.084148 10441 raft_consensus.cc:359] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.084968 10441 raft_consensus.cc:385] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.085320 10441 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.094696 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4dd97a92804cc6927c6fff64d16f39 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:34.096065 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4dd97a92804cc6927c6fff64d16f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.099005 10239 tablet_service.cc:1511] Processing CreateTablet for tablet f892a371a6e2431ab5718daa82f2b02e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:34.099220 10382 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4dd97a92804cc6927c6fff64d16f39 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:14:34.100415 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892a371a6e2431ab5718daa82f2b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.100502 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4dd97a92804cc6927c6fff64d16f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.092093 10441 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.113204 10440 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:34.113755 10440 ts_tablet_manager.cc:1403] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.009s
I20260709 13:14:34.121356 10386 tablet_service.cc:1511] Processing CreateTablet for tablet f892a371a6e2431ab5718daa82f2b02e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:34.122087 10234 tablet_service.cc:1511] Processing CreateTablet for tablet ab10f00e071642849d7b7c7d29ee29ee (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:34.122694 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892a371a6e2431ab5718daa82f2b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.123031 10439 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:34.123409 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab10f00e071642849d7b7c7d29ee29ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.123540 10439 ts_tablet_manager.cc:1403] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.015s
I20260709 13:14:34.119205 10441 ts_tablet_manager.cc:1434] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:14:34.125773 10313 tablet_service.cc:1511] Processing CreateTablet for tablet f892a371a6e2431ab5718daa82f2b02e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:14:34.127177 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892a371a6e2431ab5718daa82f2b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.129169 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0293dc4ca94845b6d1f8991514db3e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:14:34.130551 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0293dc4ca94845b6d1f8991514db3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.139560 10440 raft_consensus.cc:359] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.140373 10440 raft_consensus.cc:385] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.140693 10440 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.126133 10441 tablet_bootstrap.cc:492] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:34.146471 10314 tablet_service.cc:1511] Processing CreateTablet for tablet ab10f00e071642849d7b7c7d29ee29ee (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:34.150673 10439 raft_consensus.cc:359] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.151472 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab10f00e071642849d7b7c7d29ee29ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.151795 10384 tablet_service.cc:1511] Processing CreateTablet for tablet ab10f00e071642849d7b7c7d29ee29ee (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:14:34.153147 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab10f00e071642849d7b7c7d29ee29ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.161164 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 38076f481679473aac7854c07b22e381 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:34.162632 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38076f481679473aac7854c07b22e381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.162388 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 38076f481679473aac7854c07b22e381 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:34.163707 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38076f481679473aac7854c07b22e381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.149039 10440 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.174678 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 38076f481679473aac7854c07b22e381 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:14:34.179095 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38076f481679473aac7854c07b22e381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.151467 10439 raft_consensus.cc:385] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.175150 10440 ts_tablet_manager.cc:1434] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:14:34.185086 10439 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.188860 10439 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.191524 10439 ts_tablet_manager.cc:1434] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:14:34.192624 10439 tablet_bootstrap.cc:492] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:34.194840 10440 tablet_bootstrap.cc:492] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:34.206979 10440 tablet_bootstrap.cc:654] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.213918 10441 tablet_bootstrap.cc:654] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.214949 10439 tablet_bootstrap.cc:654] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.211028 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 6bab3992733148c582649aac71356232 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:34.218708 10441 tablet_bootstrap.cc:492] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:34.219187 10441 ts_tablet_manager.cc:1403] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.001s
I20260709 13:14:34.219369 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bab3992733148c582649aac71356232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.220124 10439 tablet_bootstrap.cc:492] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:34.220577 10439 ts_tablet_manager.cc:1403] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:14:34.221854 10441 raft_consensus.cc:359] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.222576 10441 raft_consensus.cc:385] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.222986 10441 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.223588 10439 raft_consensus.cc:359] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.224385 10439 raft_consensus.cc:385] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.224691 10439 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.225026 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 6bab3992733148c582649aac71356232 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:34.226996 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bab3992733148c582649aac71356232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.229081 10447 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.229787 10447 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.236176 10439 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.236168 10441 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.241926 10386 tablet_service.cc:1511] Processing CreateTablet for tablet 6bab3992733148c582649aac71356232 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:14:34.243813 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bab3992733148c582649aac71356232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.246153 10439 ts_tablet_manager.cc:1434] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:14:34.249276 10439 tablet_bootstrap.cc:492] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:34.255718 10439 tablet_bootstrap.cc:654] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.258006 10234 tablet_service.cc:1511] Processing CreateTablet for tablet c20e8be888d84cbf954ad2041699a03d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:34.258895 10311 tablet_service.cc:1511] Processing CreateTablet for tablet c20e8be888d84cbf954ad2041699a03d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:34.259430 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20e8be888d84cbf954ad2041699a03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.260191 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20e8be888d84cbf954ad2041699a03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.267515 10439 tablet_bootstrap.cc:492] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:34.268069 10439 ts_tablet_manager.cc:1403] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:14:34.271445 10439 raft_consensus.cc:359] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.272439 10439 raft_consensus.cc:385] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.272635 10447 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:34.272800 10439 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.273686 10439 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.276038 10439 ts_tablet_manager.cc:1434] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:34.277050 10439 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:34.276757 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae4445ee896464a9b9905cf5ca48e67 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:34.278075 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4445ee896464a9b9905cf5ca48e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.277433 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae4445ee896464a9b9905cf5ca48e67 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:34.279896 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4445ee896464a9b9905cf5ca48e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.286972 10450 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.287540 10450 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.290503 10450 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.298302 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 67d43312af804527af89708edfbd9177 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:34.299696 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d43312af804527af89708edfbd9177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.301187 10439 tablet_bootstrap.cc:654] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.305045 10440 tablet_bootstrap.cc:492] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:34.305634 10440 ts_tablet_manager.cc:1403] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.111s	user 0.006s	sys 0.012s
I20260709 13:14:34.308620 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae4445ee896464a9b9905cf5ca48e67 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:14:34.325306 10440 raft_consensus.cc:359] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.326153 10440 raft_consensus.cc:385] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.326526 10440 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.327291 10440 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.308292 10385 tablet_service.cc:1511] Processing CreateTablet for tablet c20e8be888d84cbf954ad2041699a03d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:14:34.337741 10386 tablet_service.cc:1511] Processing CreateTablet for tablet 67d43312af804527af89708edfbd9177 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:34.344094 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4445ee896464a9b9905cf5ca48e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.344812 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d43312af804527af89708edfbd9177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.346189 10458 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.346746 10458 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.348316 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:34.349010 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20e8be888d84cbf954ad2041699a03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.349011 10250 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:34.353364 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:34.354290 10447 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.354631 10447 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.354965 10447 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.356887 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 477291c1a9554fecabe56380eefe7c94 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:34.358383 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477291c1a9554fecabe56380eefe7c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.360421 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 477291c1a9554fecabe56380eefe7c94 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:34.361749 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477291c1a9554fecabe56380eefe7c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.364250 10232 tablet_service.cc:1511] Processing CreateTablet for tablet ebb1d9c88bdd4df9942232a578267aa6 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:34.365621 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1d9c88bdd4df9942232a578267aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.366362 10458 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:34.367220 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:34.367880 10250 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:34.369616 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:34.374395 10440 ts_tablet_manager.cc:1434] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:14:34.388702 10234 tablet_service.cc:1511] Processing CreateTablet for tablet 07abdf4bb17f4efd8947745de6c71c1d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:34.390062 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07abdf4bb17f4efd8947745de6c71c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.391119 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 67d43312af804527af89708edfbd9177 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:14:34.393040 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d43312af804527af89708edfbd9177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.397704 10440 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:34.399753 10239 tablet_service.cc:1511] Processing CreateTablet for tablet f26aceb684204af4b9a75341f4d72c53 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:34.401700 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26aceb684204af4b9a75341f4d72c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.383057 10444 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.402833 10444 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.405616 10444 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.406483 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:34.408221 10290 leader_election.cc:343] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.396224 10386 tablet_service.cc:1511] Processing CreateTablet for tablet 477291c1a9554fecabe56380eefe7c94 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:14:34.409245 10382 tablet_service.cc:1511] Processing CreateTablet for tablet ebb1d9c88bdd4df9942232a578267aa6 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:34.411265 10311 tablet_service.cc:1511] Processing CreateTablet for tablet ebb1d9c88bdd4df9942232a578267aa6 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:14:34.413807 10441 ts_tablet_manager.cc:1434] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.194s	user 0.018s	sys 0.019s
I20260709 13:14:34.414793 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 07abdf4bb17f4efd8947745de6c71c1d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:34.412952 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1d9c88bdd4df9942232a578267aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.419358 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 07abdf4bb17f4efd8947745de6c71c1d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:14:34.421046 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07abdf4bb17f4efd8947745de6c71c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.429034 10310 tablet_service.cc:1511] Processing CreateTablet for tablet f26aceb684204af4b9a75341f4d72c53 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:34.430994 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26aceb684204af4b9a75341f4d72c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.406136 10444 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.438990 10444 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.441248 10444 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.442377 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:34.443760 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:34.444521 10290 leader_election.cc:343] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.444967 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:34.445591 10440 tablet_bootstrap.cc:654] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.379124 10458 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.458077 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:34.458855 10399 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:34.463574 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:14:34.465956 10362 leader_election.cc:343] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:34.470323 10288 leader_election.cc:343] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.471022 10288 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:34.472764 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:34.474215 10444 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.475132 10444 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.475549 10444 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.475975 10444 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.482820 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:34.483891 10325 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:34.485682 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477291c1a9554fecabe56380eefe7c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.487058 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1d9c88bdd4df9942232a578267aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.491075 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07abdf4bb17f4efd8947745de6c71c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.460340 10458 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.502818 10458 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.504595 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 3955117b87304f9c9123136a32ea1aa8 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:34.505852 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3955117b87304f9c9123136a32ea1aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.520989 10441 tablet_bootstrap.cc:492] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:34.524868 10315 tablet_service.cc:1511] Processing CreateTablet for tablet 3955117b87304f9c9123136a32ea1aa8 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:34.526373 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3955117b87304f9c9123136a32ea1aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.528278 10384 tablet_service.cc:1511] Processing CreateTablet for tablet f26aceb684204af4b9a75341f4d72c53 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:14:34.528746 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 3955117b87304f9c9123136a32ea1aa8 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:14:34.529682 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26aceb684204af4b9a75341f4d72c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.529399 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:34.532581 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3955117b87304f9c9123136a32ea1aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.534381 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:14:34.535979 10213 leader_election.cc:343] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.537418 10450 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.538019 10441 tablet_bootstrap.cc:654] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.537901 10450 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.538712 10439 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:34.539565 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:34.543919 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.545665 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 69ce991d35f4413e82e03d5416c73bf2 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:34.546993 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ce991d35f4413e82e03d5416c73bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.547142 10450 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.545699 10240 tablet_service.cc:1511] Processing CreateTablet for tablet b37304bb0f7f411e935e8784db513f5a (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:34.548281 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:34.548786 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.549114 10325 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:34.550523 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:34.551895 10240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37304bb0f7f411e935e8784db513f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.532581 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:14:34.555485 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.545708 10447 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.558646 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:34.559674 10450 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:34.560056 10450 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.560393 10450 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.560941 10387 tablet_service.cc:1511] Processing CreateTablet for tablet 69ce991d35f4413e82e03d5416c73bf2 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:34.562302 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ce991d35f4413e82e03d5416c73bf2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:34.566803 10213 leader_election.cc:343] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.568100 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:34.568742 10250 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.570735 10466 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.571262 10466 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.573483 10466 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.574532 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:34.579622 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:34.582360 10288 leader_election.cc:343] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.586104 10388 tablet_service.cc:1511] Processing CreateTablet for tablet b37304bb0f7f411e935e8784db513f5a (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:34.593271 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37304bb0f7f411e935e8784db513f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.593575 10308 tablet_service.cc:1511] Processing CreateTablet for tablet b37304bb0f7f411e935e8784db513f5a (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:14:34.596702 10447 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:34.597987 10250 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:34.599189 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:34.599325 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:34.600162 10325 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.600528 10447 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.603859 10450 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.605146 10249 raft_consensus.cc:2393] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:34.581728 10439 ts_tablet_manager.cc:1403] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.305s	user 0.058s	sys 0.070s
I20260709 13:14:34.568758 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 69ce991d35f4413e82e03d5416c73bf2 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:14:34.609802 10237 tablet_service.cc:1511] Processing CreateTablet for tablet a07acf0009094d989235d04de13c6c2e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:34.610954 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07acf0009094d989235d04de13c6c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.611634 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37304bb0f7f411e935e8784db513f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.621556 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ce991d35f4413e82e03d5416c73bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.612865 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:34.614910 10307 tablet_service.cc:1511] Processing CreateTablet for tablet a07acf0009094d989235d04de13c6c2e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:34.625080 10324 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.615435 10290 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:34.618628 10387 tablet_service.cc:1511] Processing CreateTablet for tablet a07acf0009094d989235d04de13c6c2e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:14:34.630759 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07acf0009094d989235d04de13c6c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.641891 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 7df30c54c90e4fcfaeb14736ccbcec7c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:34.643996 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df30c54c90e4fcfaeb14736ccbcec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.648650 10450 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.649394 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:34.612071 10444 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:34.651050 10213 leader_election.cc:343] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.653337 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:14:34.654928 10290 leader_election.cc:343] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.655437 10440 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:34.655937 10440 ts_tablet_manager.cc:1403] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.259s	user 0.027s	sys 0.010s
I20260709 13:14:34.656869 10444 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.657100 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 7df30c54c90e4fcfaeb14736ccbcec7c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:34.658627 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df30c54c90e4fcfaeb14736ccbcec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.659315 10458 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.660594 10398 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:34.661549 10458 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:34.661916 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:34.662534 10399 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.663405 10447 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:34.674571 10307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07acf0009094d989235d04de13c6c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.675468 10447 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.676017 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:34.675503 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:34.678418 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:14:34.678551 10362 leader_election.cc:343] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.679075 10249 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:34.672956 10324 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:34.682843 10466 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.683575 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:34.698593 10249 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:34.698871 10439 raft_consensus.cc:359] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.699851 10439 raft_consensus.cc:385] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.700274 10439 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.701642 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:34.703045 10469 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.701299 10439 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.703554 10469 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:34.711611 10399 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:34.712553 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 7df30c54c90e4fcfaeb14736ccbcec7c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:14:34.705328 10450 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.726122 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:34.727417 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df30c54c90e4fcfaeb14736ccbcec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.727319 10466 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.727980 10466 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:34.728816 10466 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.732627 10469 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.733734 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1231f6d6fa45119f3f855900d3113b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:34.735132 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1231f6d6fa45119f3f855900d3113b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.735311 10450 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:34.736989 10450 raft_consensus.cc:697] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:34.737035 10381 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1231f6d6fa45119f3f855900d3113b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:34.738400 10441 tablet_bootstrap.cc:492] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:34.737927 10450 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.738922 10441 ts_tablet_manager.cc:1403] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.012s
I20260709 13:14:34.740916 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 002cc8ee6e9043929d5cd5532317aab7 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:34.742332 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002cc8ee6e9043929d5cd5532317aab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.742170 10441 raft_consensus.cc:359] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.742983 10441 raft_consensus.cc:385] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.743283 10441 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.744071 10441 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.746670 10440 raft_consensus.cc:359] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.747478 10440 raft_consensus.cc:385] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.747144 10240 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1231f6d6fa45119f3f855900d3113b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:14:34.747794 10440 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.748632 10440 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.750555 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1231f6d6fa45119f3f855900d3113b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.752759 10325 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:34.755193 10441 ts_tablet_manager.cc:1434] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:14:34.727344 10439 ts_tablet_manager.cc:1434] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.000s
I20260709 13:14:34.748652 10240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1231f6d6fa45119f3f855900d3113b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.768045 10441 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:34.771545 10439 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:34.812337 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 4262070044b6403dbc7cebd32cfebe0c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:34.812903 10382 tablet_service.cc:1511] Processing CreateTablet for tablet 002cc8ee6e9043929d5cd5532317aab7 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:34.817035 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262070044b6403dbc7cebd32cfebe0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.820151 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002cc8ee6e9043929d5cd5532317aab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.831154 10146 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.836596 10440 ts_tablet_manager.cc:1434] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.180s	user 0.010s	sys 0.002s
I20260709 13:14:34.836383 10306 tablet_service.cc:1511] Processing CreateTablet for tablet 002cc8ee6e9043929d5cd5532317aab7 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:14:34.837716 10440 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:34.836357 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 0de4147226834030b0fd22d4a0948990 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:34.838714 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de4147226834030b0fd22d4a0948990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.844036 10441 tablet_bootstrap.cc:654] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.850920 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 4262070044b6403dbc7cebd32cfebe0c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:34.857620 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002cc8ee6e9043929d5cd5532317aab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.860914 10145 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:34.865962 10315 tablet_service.cc:1511] Processing CreateTablet for tablet 0de4147226834030b0fd22d4a0948990 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:34.867491 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de4147226834030b0fd22d4a0948990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.867110 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 0de4147226834030b0fd22d4a0948990 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:14:34.872999 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 9187284d595443aab84a71601d6fe9ea (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:34.874219 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262070044b6403dbc7cebd32cfebe0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.882697 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de4147226834030b0fd22d4a0948990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.875613 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 9187284d595443aab84a71601d6fe9ea (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:34.887666 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187284d595443aab84a71601d6fe9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.888983 10147 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.889860 10382 tablet_service.cc:1511] Processing CreateTablet for tablet 9187284d595443aab84a71601d6fe9ea (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:14:34.891207 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187284d595443aab84a71601d6fe9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.890918 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 1667c24c31044f708dc4fcc524ea924d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:34.892269 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1667c24c31044f708dc4fcc524ea924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.894405 10232 tablet_service.cc:1511] Processing CreateTablet for tablet ecab1d1cb33f4578870d0cf2888cf76e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:34.898002 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecab1d1cb33f4578870d0cf2888cf76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.894860 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 4262070044b6403dbc7cebd32cfebe0c (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:14:34.902192 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187284d595443aab84a71601d6fe9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.903661 10441 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:34.904312 10441 ts_tablet_manager.cc:1403] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.136s	user 0.006s	sys 0.030s
I20260709 13:14:34.907482 10441 raft_consensus.cc:359] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.908254 10441 raft_consensus.cc:385] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:34.908578 10441 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:34.909359 10441 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.910171 10439 tablet_bootstrap.cc:654] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.910560 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4262070044b6403dbc7cebd32cfebe0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.911806 10441 ts_tablet_manager.cc:1434] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:34.912914 10441 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:34.918967 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 1667c24c31044f708dc4fcc524ea924d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:34.920519 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1667c24c31044f708dc4fcc524ea924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.926211 10234 tablet_service.cc:1511] Processing CreateTablet for tablet fc4f8110c14b45cdadf9a53a149c8fdf (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:34.927613 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4f8110c14b45cdadf9a53a149c8fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.930912 10235 tablet_service.cc:1511] Processing CreateTablet for tablet 54badd91404d4f7894752c8769345dca (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:34.931417 10441 tablet_bootstrap.cc:654] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.932300 10440 tablet_bootstrap.cc:654] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:34.932332 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54badd91404d4f7894752c8769345dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.942200 10238 tablet_service.cc:1511] Processing CreateTablet for tablet 8898babdb91e46acafbe4314671b54fa (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:34.946151 10238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8898babdb91e46acafbe4314671b54fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.947695 10381 tablet_service.cc:1511] Processing CreateTablet for tablet 1667c24c31044f708dc4fcc524ea924d (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:14:34.949030 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1667c24c31044f708dc4fcc524ea924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.967607 10308 tablet_service.cc:1511] Processing CreateTablet for tablet ecab1d1cb33f4578870d0cf2888cf76e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:34.968979 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecab1d1cb33f4578870d0cf2888cf76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:34.970396 10466 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.970875 10466 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:34.973153 10466 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:34.975101 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:34.976630 10290 leader_election.cc:343] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.978426 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:34.986110 10288 leader_election.cc:343] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:34.986651 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:34.987457 10466 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:34.991660 10382 tablet_service.cc:1511] Processing CreateTablet for tablet ecab1d1cb33f4578870d0cf2888cf76e (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:14:34.993712 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecab1d1cb33f4578870d0cf2888cf76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.003577 10306 tablet_service.cc:1511] Processing CreateTablet for tablet fc4f8110c14b45cdadf9a53a149c8fdf (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:35.005856 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4f8110c14b45cdadf9a53a149c8fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.012395 10388 tablet_service.cc:1511] Processing CreateTablet for tablet fc4f8110c14b45cdadf9a53a149c8fdf (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:14:35.013839 10387 tablet_service.cc:1511] Processing CreateTablet for tablet 54badd91404d4f7894752c8769345dca (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:35.013826 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4f8110c14b45cdadf9a53a149c8fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.014879 10314 tablet_service.cc:1511] Processing CreateTablet for tablet 54badd91404d4f7894752c8769345dca (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:14:35.016978 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54badd91404d4f7894752c8769345dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.021191 10440 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.021762 10440 ts_tablet_manager.cc:1403] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.184s	user 0.032s	sys 0.015s
I20260709 13:14:35.022491 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54badd91404d4f7894752c8769345dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.033620 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 8898babdb91e46acafbe4314671b54fa (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:35.034950 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8898babdb91e46acafbe4314671b54fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.037011 10239 tablet_service.cc:1511] Processing CreateTablet for tablet 976ea23dd44047a6adc91ad78f34fa79 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:35.024876 10240 tablet_service.cc:1511] Processing CreateTablet for tablet 23ce7c1f0ea74a808f62e7870ca8579f (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:35.047205 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 23ce7c1f0ea74a808f62e7870ca8579f (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:35.048434 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ce7c1f0ea74a808f62e7870ca8579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.049976 10381 tablet_service.cc:1511] Processing CreateTablet for tablet 23ce7c1f0ea74a808f62e7870ca8579f (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:14:35.051445 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ce7c1f0ea74a808f62e7870ca8579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.051620 10233 tablet_service.cc:1511] Processing CreateTablet for tablet 5db7cef2154f4a63901d966c49530263 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:14:35.052033 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:35.058792 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976ea23dd44047a6adc91ad78f34fa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.059600 10233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db7cef2154f4a63901d966c49530263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.063669 10237 tablet_service.cc:1511] Processing CreateTablet for tablet 4810a67dfa984af6aa1dfcfc1ad2cc29 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:35.065019 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4810a67dfa984af6aa1dfcfc1ad2cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.067584 10473 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.068060 10473 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.072259 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.072944 10325 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:35.073977 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:35.075899 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:14:35.076848 10213 leader_election.cc:343] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.077463 10450 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.077847 10450 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.078178 10450 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.069998 10473 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.082047 10307 tablet_service.cc:1511] Processing CreateTablet for tablet 5db7cef2154f4a63901d966c49530263 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:35.082465 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 6a75ec4911bc4e9188e70ee560a67a72 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:35.083415 10307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db7cef2154f4a63901d966c49530263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.083592 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a75ec4911bc4e9188e70ee560a67a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.084306 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 5315e843bcf14730b0299b712eab40d0 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:35.086700 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 976ea23dd44047a6adc91ad78f34fa79 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:35.088516 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976ea23dd44047a6adc91ad78f34fa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.091224 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5315e843bcf14730b0299b712eab40d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.092257 10469 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.092756 10469 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.094916 10469 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:35.095206 10231 tablet_service.cc:1511] Processing CreateTablet for tablet 02c8de49bce9468ca25de2106e6f0a37 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:35.096511 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:35.098016 10364 leader_election.cc:343] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.100474 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:14:35.102030 10362 leader_election.cc:343] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.079492 10440 raft_consensus.cc:359] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.102653 10440 raft_consensus.cc:385] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.096524 10231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c8de49bce9468ca25de2106e6f0a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.103060 10440 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.102559 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:35.121726 10440 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.122179 10447 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.123152 10439 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.123659 10439 ts_tablet_manager.cc:1403] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.352s	user 0.015s	sys 0.035s
I20260709 13:14:35.124068 10440 ts_tablet_manager.cc:1434] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260709 13:14:35.124876 10441 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.125061 10440 tablet_bootstrap.cc:492] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.125311 10441 ts_tablet_manager.cc:1403] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.006s
I20260709 13:14:35.125799 10381 tablet_service.cc:1511] Processing CreateTablet for tablet 976ea23dd44047a6adc91ad78f34fa79 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:14:35.127139 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976ea23dd44047a6adc91ad78f34fa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.128424 10441 raft_consensus.cc:359] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.129165 10441 raft_consensus.cc:385] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.129464 10441 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.135090 10239 tablet_service.cc:1511] Processing CreateTablet for tablet fc16ee0241da48fa9ae8e1e3705b673b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:35.140403 10240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ce7c1f0ea74a808f62e7870ca8579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.140451 10469 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:35.142040 10362 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:35.144383 10388 tablet_service.cc:1511] Processing CreateTablet for tablet 4810a67dfa984af6aa1dfcfc1ad2cc29 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:35.145727 10388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4810a67dfa984af6aa1dfcfc1ad2cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.147013 10234 tablet_service.cc:1511] Processing CreateTablet for tablet 8b11f92960bc4c35a7a06623da846cc3 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:35.146030 10312 tablet_service.cc:1511] Processing CreateTablet for tablet 8b11f92960bc4c35a7a06623da846cc3 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:35.148489 10234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b11f92960bc4c35a7a06623da846cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.148944 10312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b11f92960bc4c35a7a06623da846cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.148749 10232 tablet_service.cc:1511] Processing CreateTablet for tablet 5235584cc4374dbcbe419cad1b3b9226 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:35.155009 10232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235584cc4374dbcbe419cad1b3b9226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.144479 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 4810a67dfa984af6aa1dfcfc1ad2cc29 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:14:35.162508 10380 tablet_service.cc:1511] Processing CreateTablet for tablet fc16ee0241da48fa9ae8e1e3705b673b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:35.163532 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4810a67dfa984af6aa1dfcfc1ad2cc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.163769 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc16ee0241da48fa9ae8e1e3705b673b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.166271 10383 tablet_service.cc:1511] Processing CreateTablet for tablet 8898babdb91e46acafbe4314671b54fa (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:14:35.167626 10383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8898babdb91e46acafbe4314671b54fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.167409 10308 tablet_service.cc:1511] Processing CreateTablet for tablet 5235584cc4374dbcbe419cad1b3b9226 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:35.168702 10308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235584cc4374dbcbe419cad1b3b9226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.150476 10439 raft_consensus.cc:359] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.155920 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 8b11f92960bc4c35a7a06623da846cc3 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:14:35.173077 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b11f92960bc4c35a7a06623da846cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.174677 10239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc16ee0241da48fa9ae8e1e3705b673b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.176208 10441 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.178380 10439 raft_consensus.cc:385] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.178714 10439 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.179736 10439 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.175725 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 02c8de49bce9468ca25de2106e6f0a37 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:14:35.181890 10439 ts_tablet_manager.cc:1434] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:14:35.156472 10309 tablet_service.cc:1511] Processing CreateTablet for tablet 5315e843bcf14730b0299b712eab40d0 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:35.157948 10389 tablet_service.cc:1511] Processing CreateTablet for tablet 6a75ec4911bc4e9188e70ee560a67a72 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:35.182906 10441 ts_tablet_manager.cc:1434] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 13:14:35.183240 10389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a75ec4911bc4e9188e70ee560a67a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.183983 10441 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.159946 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 5315e843bcf14730b0299b712eab40d0 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:14:35.187095 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5315e843bcf14730b0299b712eab40d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.162047 10386 tablet_service.cc:1511] Processing CreateTablet for tablet 02c8de49bce9468ca25de2106e6f0a37 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:14:35.190513 10134 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54917.3us
I20260709 13:14:35.191190 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c8de49bce9468ca25de2106e6f0a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.193400 10450 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.196439 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:35.197055 10325 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.188768 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02c8de49bce9468ca25de2106e6f0a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.198990 10309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5315e843bcf14730b0299b712eab40d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.198205 10439 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.204299 10325 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:35.205732 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:35.206630 10473 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.207158 10473 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:35.208010 10473 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.211105 10237 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0864627e04e0284664cff47040bf9 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:35.212385 10237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0864627e04e0284664cff47040bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.220515 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 58bcaf2ee2cb4badb447e0a27855aaf6 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:35.222437 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bcaf2ee2cb4badb447e0a27855aaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.159663 10387 tablet_service.cc:1511] Processing CreateTablet for tablet 5db7cef2154f4a63901d966c49530263 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:14:35.226325 10387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db7cef2154f4a63901d966c49530263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.229081 10450 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.229614 10315 tablet_service.cc:1511] Processing CreateTablet for tablet 6a75ec4911bc4e9188e70ee560a67a72 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:14:35.231109 10315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a75ec4911bc4e9188e70ee560a67a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.238097 10466 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.241210 10450 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.220378 10314 tablet_service.cc:1511] Processing CreateTablet for tablet fc16ee0241da48fa9ae8e1e3705b673b (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:14:35.250972 10447 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.251000 10382 tablet_service.cc:1511] Processing CreateTablet for tablet 5235584cc4374dbcbe419cad1b3b9226 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:14:35.257122 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235584cc4374dbcbe419cad1b3b9226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.262763 10314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc16ee0241da48fa9ae8e1e3705b673b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.286645 10306 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0864627e04e0284664cff47040bf9 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:35.238770 10466 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.303365 10439 tablet_bootstrap.cc:654] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.316387 10447 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.341706 10447 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.344954 10447 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:35.345496 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:35.347143 10364 leader_election.cc:343] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.347393 10313 tablet_service.cc:1511] Processing CreateTablet for tablet 58bcaf2ee2cb4badb447e0a27855aaf6 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:35.351732 10145 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.354619 10439 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.366008 10439 ts_tablet_manager.cc:1403] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.168s	user 0.021s	sys 0.016s
I20260709 13:14:35.372876 10384 tablet_service.cc:1511] Processing CreateTablet for tablet dfa0864627e04e0284664cff47040bf9 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:14:35.375183 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0864627e04e0284664cff47040bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.312700 10441 tablet_bootstrap.cc:654] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.380784 10439 raft_consensus.cc:359] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.381575 10439 raft_consensus.cc:385] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.381884 10439 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.382570 10439 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.385195 10306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa0864627e04e0284664cff47040bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.399096 10313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bcaf2ee2cb4badb447e0a27855aaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.353978 10145 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:14:35.420568 10290 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:35.421001 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:35.423036 10290 leader_election.cc:343] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.427450 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:35.428313 10399 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.438753 10440 tablet_bootstrap.cc:700] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent opening tablet: real 0.101s	user 0.002s	sys 0.001s
I20260709 13:14:35.461539 10487 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.462533 10466 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:35.466329 10213 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:35.466044 10380 tablet_service.cc:1511] Processing CreateTablet for tablet 58bcaf2ee2cb4badb447e0a27855aaf6 (DEFAULT_TABLE table=test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:14:35.467415 10380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bcaf2ee2cb4badb447e0a27855aaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:35.468030 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:35.469189 10440 tablet_bootstrap.cc:654] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:35.437386 10134 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 50438.6us
I20260709 13:14:35.467207 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.483557 10439 ts_tablet_manager.cc:1434] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.116s	user 0.011s	sys 0.022s
I20260709 13:14:35.484645 10439 tablet_bootstrap.cc:492] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.482342 10450 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.490775 10450 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:35.483507 10288 leader_election.cc:343] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.485131 10469 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:14:35.492852 10288 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:35.494204 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.492854 10450 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.498437 10323 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:35.496749 10487 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.483877 10324 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:35.501787 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:35.502735 10473 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.503111 10473 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.503337 10473 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.492851 10399 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:35.514053 10473 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.523674 10439 tablet_bootstrap.cc:654] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.530889 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:35.531667 10324 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:35.533275 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 67614us
I20260709 13:14:35.535336 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:35.535557 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:35.537246 10469 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.537875 10469 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.538375 10469 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:35.543340 10213 leader_election.cc:343] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.553742 10440 tablet_bootstrap.cc:492] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.554355 10440 ts_tablet_manager.cc:1403] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.430s	user 0.008s	sys 0.019s
I20260709 13:14:35.557924 10440 raft_consensus.cc:359] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.559787 10440 raft_consensus.cc:385] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.560168 10440 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.560922 10440 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.563184 10440 ts_tablet_manager.cc:1434] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:14:35.564361 10440 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.571307 10440 tablet_bootstrap.cc:654] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.571798 10441 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.572394 10441 ts_tablet_manager.cc:1403] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.389s	user 0.014s	sys 0.004s
I20260709 13:14:35.548511 10473 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.580874 10441 raft_consensus.cc:359] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.583194 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:35.592583 10324 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:35.594388 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:35.584100 10441 raft_consensus.cc:385] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.596294 10441 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.597486 10441 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.600607 10441 ts_tablet_manager.cc:1434] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:14:35.602586 10473 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:35.602849 10213 leader_election.cc:343] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.603188 10473 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:35.604132 10473 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.613372 10469 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.615468 10441 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.622447 10440 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.632705 10440 ts_tablet_manager.cc:1403] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.005s
I20260709 13:14:35.633689 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:14:35.635272 10364 leader_election.cc:343] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:35.635845 10440 raft_consensus.cc:359] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.636725 10440 raft_consensus.cc:385] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.637050 10440 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.638319 10441 tablet_bootstrap.cc:654] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.639206 10469 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:35.640455 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:35.641160 10325 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.637898 10440 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.644052 10440 ts_tablet_manager.cc:1434] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:14:35.645084 10440 tablet_bootstrap.cc:492] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.645798 10145 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.648849 10325 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:35.650022 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:35.651201 10469 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.651768 10439 tablet_bootstrap.cc:492] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.651683 10469 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:35.652403 10439 ts_tablet_manager.cc:1403] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.022s
I20260709 13:14:35.652798 10469 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.656018 10439 raft_consensus.cc:359] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.657063 10439 raft_consensus.cc:385] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.657436 10439 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.651691 10440 tablet_bootstrap.cc:654] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.662547 10439 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.666033 10439 ts_tablet_manager.cc:1434] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:35.667445 10439 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.673050 10441 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.673224 10440 tablet_bootstrap.cc:492] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.673588 10441 ts_tablet_manager.cc:1403] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.019s
I20260709 13:14:35.674307 10473 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.674799 10473 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.676827 10473 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.673588 10440 ts_tablet_manager.cc:1403] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:14:35.678671 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.679466 10323 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:35.679970 10473 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:35.680945 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:35.681226 10440 raft_consensus.cc:359] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.681946 10440 raft_consensus.cc:385] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.682868 10213 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:35.683674 10441 raft_consensus.cc:359] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.684372 10441 raft_consensus.cc:385] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.684660 10441 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.684850 10439 tablet_bootstrap.cc:654] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.685426 10441 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.684000 10473 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.687626 10441 ts_tablet_manager.cc:1434] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:14:35.687971 10148 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.688833 10441 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.682266 10440 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.698961 10440 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.701628 10440 ts_tablet_manager.cc:1434] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:14:35.702641 10440 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.708333 10440 tablet_bootstrap.cc:654] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.709906 10450 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:35.716216 10441 tablet_bootstrap.cc:654] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.693691 10439 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.693830 10473 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.723985 10439 ts_tablet_manager.cc:1403] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.003s
I20260709 13:14:35.732255 10441 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.732811 10441 ts_tablet_manager.cc:1403] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 13:14:35.732429 10439 raft_consensus.cc:359] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.733177 10439 raft_consensus.cc:385] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.733461 10439 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.734208 10439 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.735656 10323 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.736239 10441 raft_consensus.cc:359] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.737038 10441 raft_consensus.cc:385] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.737360 10441 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.736266 10439 ts_tablet_manager.cc:1434] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:14:35.738451 10439 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.738323 10441 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.740437 10441 ts_tablet_manager.cc:1434] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:35.742183 10441 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.742870 10440 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.743336 10440 ts_tablet_manager.cc:1403] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.008s
I20260709 13:14:35.747179 10440 raft_consensus.cc:359] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.748147 10440 raft_consensus.cc:385] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.748673 10440 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.748893 10441 tablet_bootstrap.cc:654] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.749440 10440 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.751605 10440 ts_tablet_manager.cc:1434] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:35.752604 10440 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.756703 10398 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.765645 10439 tablet_bootstrap.cc:654] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.771061 10440 tablet_bootstrap.cc:654] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.778282 10441 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.778870 10441 ts_tablet_manager.cc:1403] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.017s
I20260709 13:14:35.781623 10441 raft_consensus.cc:359] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.782533 10441 raft_consensus.cc:385] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.782876 10441 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.783682 10441 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.785995 10441 ts_tablet_manager.cc:1434] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:14:35.786957 10441 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.792665 10441 tablet_bootstrap.cc:654] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.795643 10440 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.796284 10440 ts_tablet_manager.cc:1403] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.007s
I20260709 13:14:35.799773 10440 raft_consensus.cc:359] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.800897 10440 raft_consensus.cc:385] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.801352 10440 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.802541 10440 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.817287 10440 ts_tablet_manager.cc:1434] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:14:35.821768 10440 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.823024 10439 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.823503 10439 ts_tablet_manager.cc:1403] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.045s
I20260709 13:14:35.826277 10439 raft_consensus.cc:359] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.827016 10439 raft_consensus.cc:385] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.827294 10439 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.828315 10440 tablet_bootstrap.cc:654] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.828763 10439 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.830359 10441 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.830828 10441 ts_tablet_manager.cc:1403] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.020s
I20260709 13:14:35.830950 10439 ts_tablet_manager.cc:1434] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:35.833156 10439 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.833853 10440 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:35.833562 10441 raft_consensus.cc:359] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.834278 10441 raft_consensus.cc:385] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.834337 10440 ts_tablet_manager.cc:1403] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:14:35.834649 10441 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.835505 10441 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.837096 10440 raft_consensus.cc:359] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.837802 10440 raft_consensus.cc:385] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.838081 10440 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.838901 10440 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.841024 10440 ts_tablet_manager.cc:1434] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:35.840981 10439 tablet_bootstrap.cc:654] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.841501 10441 ts_tablet_manager.cc:1434] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:35.842507 10441 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.850926 10441 tablet_bootstrap.cc:654] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.851897 10469 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.852592 10469 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.856798 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.859769 10323 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:35.860055 10439 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.860543 10439 ts_tablet_manager.cc:1403] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.007s
I20260709 13:14:35.858906 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:35.862427 10364 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:35.863446 10497 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.863528 10439 raft_consensus.cc:359] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.864420 10439 raft_consensus.cc:385] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.864756 10439 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.865552 10439 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.867231 10439 ts_tablet_manager.cc:1434] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:35.868239 10439 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.869439 10473 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.869926 10473 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.872664 10473 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.874199 10473 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.874459 10439 tablet_bootstrap.cc:654] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.858268 10469 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:35.874711 10473 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.874673 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.876209 10323 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:35.877897 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:35.878022 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:35.878827 10450 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.878909 10323 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:35.879271 10450 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.879673 10450 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.855912 10440 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:35.880924 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:35.886597 10471 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:35.887151 10471 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.887616 10471 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.892549 10450 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.896744 10497 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:35.899549 10473 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.898586 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:35.901854 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:35.902516 10450 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.902876 10440 tablet_bootstrap.cc:654] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.899318 10471 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.902873 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:35.903095 10439 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:35.903792 10439 ts_tablet_manager.cc:1403] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.015s
I20260709 13:14:35.900529 10398 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:35.902518 10399 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:35.900723 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:35.906461 10323 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.907120 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:35.908005 10325 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.908558 10439 raft_consensus.cc:359] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.909250 10439 raft_consensus.cc:385] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.909516 10439 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.910372 10439 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.912705 10439 ts_tablet_manager.cc:1434] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:35.913746 10439 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:35.918800 10441 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:35.919363 10441 ts_tablet_manager.cc:1403] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.077s	user 0.035s	sys 0.008s
I20260709 13:14:35.920387 10323 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:35.922060 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:35.922791 10439 tablet_bootstrap.cc:654] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:35.924115 10471 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:35.923240 10450 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.925148 10450 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:35.925980 10450 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.927986 10249 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.942031 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:35.942946 10399 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:35.953931 10441 raft_consensus.cc:359] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.961161 10441 raft_consensus.cc:385] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:35.961591 10441 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:35.962821 10441 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.972800 10399 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:35.974382 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:35.954599 10325 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:35.975399 10471 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:35.975924 10471 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:35.979470 10441 ts_tablet_manager.cc:1434] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:14:35.976948 10471 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.982842 10441 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:35.984100 10440 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.039448 10440 ts_tablet_manager.cc:1403] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.184s	user 0.027s	sys 0.053s
I20260709 13:14:36.027390 10497 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.986609 10488 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.041864 10488 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.041066 10497 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:35.998342 10473 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.046749 10473 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.047919 10439 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.048497 10439 ts_tablet_manager.cc:1403] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.135s	user 0.024s	sys 0.009s
I20260709 13:14:35.998034 10146 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.050971 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.056231 10473 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.056993 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.057354 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:36.057725 10325 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:36.058018 10398 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:36.053582 10248 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:36.058987 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:14:36.063441 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:36.069873 10439 raft_consensus.cc:359] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.070623 10439 raft_consensus.cc:385] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.070978 10439 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.069535 10473 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.071822 10473 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.072165 10473 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.067895 10497 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.072975 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:36.073908 10469 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.074340 10469 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.070537 10440 raft_consensus.cc:359] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.074720 10469 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.074513 10439 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.075028 10440 raft_consensus.cc:385] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.075469 10440 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.076378 10440 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.078197 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:36.079097 10398 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:36.080446 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:36.080941 10488 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.081379 10487 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.081800 10487 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.082160 10487 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.083503 10439 ts_tablet_manager.cc:1434] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 13:14:36.084060 10440 ts_tablet_manager.cc:1434] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:14:36.084475 10439 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.085035 10440 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.085813 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.081629 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.086524 10325 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:36.087321 10530 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.088546 10530 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.091385 10530 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.092633 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.093721 10325 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:36.092908 10530 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.093055 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:36.098097 10497 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.094056 10473 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.080719 10441 tablet_bootstrap.cc:654] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.107053 10248 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:14:36.106201 10213 leader_election.cc:343] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.099047 10487 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.098655 10497 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.107086 10469 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.133494 10439 tablet_bootstrap.cc:654] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.130213 10469 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.138998 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:36.139923 10325 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.126361 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53474.3us
I20260709 13:14:36.124583 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:36.146466 10473 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.146804 10530 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.147622 10530 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.148001 10530 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.149022 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:36.150125 10399 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.153343 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:36.154292 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:36.155144 10248 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:36.154423 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:36.156592 10323 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:36.156723 10487 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.157403 10497 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.158439 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.158663 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.159300 10323 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:36.162883 10399 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:36.157420 10530 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.165359 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:36.166052 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:36.166674 10248 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.166968 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:36.164812 10487 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.170543 10497 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.171041 10497 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.184212 10441 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.171489 10497 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.178871 10471 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.189790 10471 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:36.189033 10147 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.197362 10325 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:36.205618 10441 ts_tablet_manager.cc:1403] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.223s	user 0.020s	sys 0.017s
I20260709 13:14:36.191001 10471 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.209666 10439 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.210168 10439 ts_tablet_manager.cc:1403] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.006s
I20260709 13:14:36.213176 10439 raft_consensus.cc:359] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.214030 10439 raft_consensus.cc:385] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.214416 10439 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.214395 10441 raft_consensus.cc:359] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.215132 10441 raft_consensus.cc:385] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.215466 10441 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.215492 10439 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.218473 10439 ts_tablet_manager.cc:1434] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:14:36.216195 10441 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.220613 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:36.221462 10531 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.223255 10439 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.231107 10530 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.234540 10441 ts_tablet_manager.cc:1434] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:14:36.232358 10497 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.235720 10441 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.236496 10497 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.238453 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:36.239105 10322 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.240625 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:36.247264 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.247979 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:36.248319 10248 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:36.248587 10324 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.251652 10213 leader_election.cc:343] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.259156 10441 tablet_bootstrap.cc:654] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.261137 10531 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:36.263942 10531 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.265177 10324 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:36.267854 10487 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.268932 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:36.268889 10487 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.270684 10533 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.271196 10533 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:36.271135 10322 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:36.272436 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:36.272171 10533 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.273353 10471 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.274034 10471 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:36.260097 10497 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:36.275332 10487 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.275468 10471 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.278158 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:36.278473 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.279101 10398 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:36.265305 10147 catalog_manager.cc:5697] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:36.280159 10290 leader_election.cc:343] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.284804 10440 tablet_bootstrap.cc:654] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.290186 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:36.291471 10471 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.291589 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.293444 10487 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.293946 10487 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.294837 10487 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.307003 10441 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.307578 10441 ts_tablet_manager.cc:1403] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.013s
I20260709 13:14:36.302618 10487 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:36.302538 10364 leader_election.cc:343] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.314842 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:36.317414 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:36.317943 10398 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:36.321348 10290 leader_election.cc:343] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:36.324945 10364 leader_election.cc:343] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.325527 10533 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.316885 10487 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.340907 10146 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.347571 10399 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.354629 10439 tablet_bootstrap.cc:654] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.363452 10398 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:36.367173 10471 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.367980 10440 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.368083 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.368467 10440 ts_tablet_manager.cc:1403] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.284s	user 0.021s	sys 0.021s
I20260709 13:14:36.369506 10487 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.369973 10487 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:36.370818 10487 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.375182 10441 raft_consensus.cc:359] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.382614 10441 raft_consensus.cc:385] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.383162 10441 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.385514 10441 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.393887 10441 ts_tablet_manager.cc:1434] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.086s	user 0.003s	sys 0.006s
I20260709 13:14:36.394914 10441 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.396844 10440 raft_consensus.cc:359] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.397840 10440 raft_consensus.cc:385] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.398276 10440 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.399421 10440 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.422178 10440 ts_tablet_manager.cc:1434] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 13:14:36.423290 10440 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.429912 10439 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.430440 10439 ts_tablet_manager.cc:1403] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.003s
I20260709 13:14:36.433602 10439 raft_consensus.cc:359] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.440923 10439 raft_consensus.cc:385] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.441264 10439 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.443228 10439 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.452719 10533 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.453271 10533 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.453526 10471 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.455796 10148 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.457063 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.459774 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.459247 10146 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.460562 10324 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:36.461987 10362 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:36.463117 10531 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.468238 10440 tablet_bootstrap.cc:654] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.469141 10439 ts_tablet_manager.cc:1434] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:14:36.471089 10439 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.470472 10533 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.482723 10531 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.491645 10440 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.492847 10441 tablet_bootstrap.cc:654] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.493213 10440 ts_tablet_manager.cc:1403] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.006s
I20260709 13:14:36.500943 10440 raft_consensus.cc:359] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.501565 10440 raft_consensus.cc:385] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.501745 10440 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.502367 10440 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.503655 10553 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.504135 10147 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.504155 10553 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.508354 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:36.509004 10439 tablet_bootstrap.cc:654] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.508919 10553 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:36.509732 10288 leader_election.cc:343] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.510195 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:36.511520 10290 leader_election.cc:343] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.512079 10290 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.512848 10440 ts_tablet_manager.cc:1434] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:14:36.513813 10440 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.514737 10553 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.517081 10471 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.517601 10471 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.519815 10440 tablet_bootstrap.cc:654] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.519785 10471 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.522286 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:36.523092 10399 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:36.525087 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.527099 10441 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.527604 10441 ts_tablet_manager.cc:1403] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.007s
I20260709 13:14:36.527864 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:36.529529 10471 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.530361 10441 raft_consensus.cc:359] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.531002 10441 raft_consensus.cc:385] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.531246 10441 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.532464 10441 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.534915 10441 ts_tablet_manager.cc:1434] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:36.534840 10473 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.535941 10441 tablet_bootstrap.cc:492] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.536172 10440 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.536631 10440 ts_tablet_manager.cc:1403] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:14:36.537931 10471 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.542845 10440 raft_consensus.cc:359] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.543723 10440 raft_consensus.cc:385] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.544104 10440 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.544896 10440 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.547235 10440 ts_tablet_manager.cc:1434] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:14:36.548290 10440 tablet_bootstrap.cc:492] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.549736 10439 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.550284 10439 ts_tablet_manager.cc:1403] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.003s
I20260709 13:14:36.550444 10531 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.550961 10531 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.553292 10441 tablet_bootstrap.cc:654] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.553330 10531 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.553216 10439 raft_consensus.cc:359] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.554071 10439 raft_consensus.cc:385] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.554405 10439 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.554988 10440 tablet_bootstrap.cc:654] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.555284 10439 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.555963 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:36.557405 10364 leader_election.cc:343] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.557790 10439 ts_tablet_manager.cc:1434] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:36.559541 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.560286 10322 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:36.566582 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.567520 10531 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.568012 10531 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.568583 10531 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.572184 10440 tablet_bootstrap.cc:492] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.572727 10440 ts_tablet_manager.cc:1403] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:14:36.575459 10440 raft_consensus.cc:359] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.576159 10440 raft_consensus.cc:385] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.576439 10440 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.577124 10440 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.580411 10531 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.581079 10441 tablet_bootstrap.cc:492] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.588640 10441 ts_tablet_manager.cc:1403] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.013s
I20260709 13:14:36.589831 10531 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.590533 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:36.591068 10441 raft_consensus.cc:359] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.591567 10441 raft_consensus.cc:385] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.591730 10441 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
W20260709 13:14:36.592190 10364 leader_election.cc:343] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.592645 10441 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.581084 10440 ts_tablet_manager.cc:1434] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:36.594734 10441 ts_tablet_manager.cc:1434] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:36.595079 10440 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.595634 10441 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.596309 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:36.596873 10322 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.601747 10441 tablet_bootstrap.cc:654] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.602118 10440 tablet_bootstrap.cc:654] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.582440 10439 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.585853 10471 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.617230 10440 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.617720 10440 ts_tablet_manager.cc:1403] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.005s
I20260709 13:14:36.620420 10440 raft_consensus.cc:359] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.620957 10440 raft_consensus.cc:385] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.621193 10440 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.621803 10440 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.623781 10439 tablet_bootstrap.cc:654] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.619745 10322 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:36.627240 10440 ts_tablet_manager.cc:1434] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:14:36.628448 10440 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.630669 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.631647 10531 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:36.632256 10531 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:36.633596 10531 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.635861 10441 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.636210 10441 ts_tablet_manager.cc:1403] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.008s
I20260709 13:14:36.640761 10440 tablet_bootstrap.cc:654] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.640244 10441 raft_consensus.cc:359] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.641350 10441 raft_consensus.cc:385] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.641685 10441 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.642510 10441 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.645339 10441 ts_tablet_manager.cc:1434] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:14:36.646708 10441 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.648506 10439 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.649019 10439 ts_tablet_manager.cc:1403] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.000s
I20260709 13:14:36.651908 10439 raft_consensus.cc:359] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.652814 10439 raft_consensus.cc:385] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.654307 10439 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.655589 10441 tablet_bootstrap.cc:654] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.655818 10439 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.660137 10439 ts_tablet_manager.cc:1434] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:14:36.661178 10439 tablet_bootstrap.cc:492] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.665745 10145 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.671833 10439 tablet_bootstrap.cc:654] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.674578 10440 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.675055 10440 ts_tablet_manager.cc:1403] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.012s
I20260709 13:14:36.675904 10441 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.676348 10441 ts_tablet_manager.cc:1403] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.009s
I20260709 13:14:36.677585 10440 raft_consensus.cc:359] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.678400 10440 raft_consensus.cc:385] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.678669 10440 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.679324 10441 raft_consensus.cc:359] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.679454 10440 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.680025 10441 raft_consensus.cc:385] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.680311 10441 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.681002 10441 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.683092 10441 ts_tablet_manager.cc:1434] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:36.684033 10441 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.689808 10441 tablet_bootstrap.cc:654] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.698681 10473 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.701547 10441 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.702081 10441 ts_tablet_manager.cc:1403] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:14:36.704931 10441 raft_consensus.cc:359] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.705626 10441 raft_consensus.cc:385] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.705906 10441 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.706064 10440 ts_tablet_manager.cc:1434] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:14:36.713351 10440 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:36.713122 10441 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.715751 10441 ts_tablet_manager.cc:1434] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:14:36.716784 10441 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.719206 10439 tablet_bootstrap.cc:492] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.719863 10439 ts_tablet_manager.cc:1403] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.024s
I20260709 13:14:36.722851 10440 tablet_bootstrap.cc:654] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.727555 10439 raft_consensus.cc:359] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.728300 10439 raft_consensus.cc:385] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.728565 10439 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.729178 10441 tablet_bootstrap.cc:654] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.729367 10439 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.731865 10439 ts_tablet_manager.cc:1434] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:14:36.732882 10439 tablet_bootstrap.cc:492] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.734700 10441 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.735184 10441 ts_tablet_manager.cc:1403] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:14:36.737983 10441 raft_consensus.cc:359] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.738718 10441 raft_consensus.cc:385] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.738961 10439 tablet_bootstrap.cc:654] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.739094 10441 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.739969 10441 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.746208 10441 ts_tablet_manager.cc:1434] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:36.747331 10441 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.751248 10473 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.753279 10441 tablet_bootstrap.cc:654] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:36.759704 10533 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.760335 10533 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.761293 10248 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.769487 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.770295 10249 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:36.773700 10533 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.777947 10439 tablet_bootstrap.cc:492] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:36.778486 10439 ts_tablet_manager.cc:1403] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.002s
I20260709 13:14:36.774139 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:36.781358 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:36.781514 10439 raft_consensus.cc:359] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.782330 10439 raft_consensus.cc:385] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.782644 10439 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.782423 10325 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:36.787385 10531 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.788043 10439 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.791023 10441 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:36.791608 10441 ts_tablet_manager.cc:1403] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.009s
I20260709 13:14:36.791893 10439 ts_tablet_manager.cc:1434] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:14:36.783144 10533 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:36.795023 10533 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.794648 10439 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:36.796654 10533 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:36.830165 10471 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.850867 10441 raft_consensus.cc:359] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.851872 10441 raft_consensus.cc:385] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:36.852262 10441 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:36.857962 10553 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:36.863852 10554 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.864559 10554 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.867326 10441 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.876178 10554 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:36.877391 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:36.880249 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:36.881685 10290 leader_election.cc:343] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.884634 10441 ts_tablet_manager.cc:1434] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.000s
I20260709 13:14:36.885928 10441 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:36.850643 10533 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:36.859334 10531 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
W20260709 13:14:36.889035 10288 leader_election.cc:343] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:36.898736 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:36.901075 10554 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:36.912281 10440 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:36.912889 10440 ts_tablet_manager.cc:1403] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.200s	user 0.054s	sys 0.095s
I20260709 13:14:36.961056 10439 tablet_bootstrap.cc:654] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.076781 10441 tablet_bootstrap.cc:654] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.059103 10554 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.025146 10539 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.084911 10539 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.086673 10539 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.087180 10539 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.087613 10539 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.089773 10539 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:36.953698 10471 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.982854 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:36.918977 10533 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.050079 10497 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.084120 10554 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.013090 10531 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.095s
W20260709 13:14:37.109019 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 117155us
I20260709 13:14:37.112640 10587 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:36.977157 10553 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.131s
I20260709 13:14:37.114667 10439 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:37.117699 10439 ts_tablet_manager.cc:1403] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.323s	user 0.010s	sys 0.028s
I20260709 13:14:37.110780 10250 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.094059 10471 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.125734 10440 raft_consensus.cc:359] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.128616 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.129014 10440 raft_consensus.cc:385] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.129346 10440 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.130476 10440 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.111340 10533 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.131517 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.132161 10399 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:37.132576 10247 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:37.134001 10439 raft_consensus.cc:359] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.134759 10439 raft_consensus.cc:385] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.135066 10439 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.136190 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:37.135779 10439 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.118374 10583 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.142875 10440 ts_tablet_manager.cc:1434] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.230s	user 0.006s	sys 0.003s
I20260709 13:14:37.143909 10440 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:37.112052 10497 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.130538 10554 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.144336 10553 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.155658 10471 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.160117 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:37.134420 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53399.2us
I20260709 13:14:37.140659 10533 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.173290 10471 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.174757 10471 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.176875 10471 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.170096 10250 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.165802 10553 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:37.183640 10364 leader_election.cc:343] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.186004 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.142863 10583 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.182201 10553 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.202874 10439 ts_tablet_manager.cc:1434] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.085s	user 0.024s	sys 0.031s
I20260709 13:14:37.204272 10439 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:37.198664 10248 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:37.208899 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.211202 10325 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.207243 10554 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.223958 10533 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.229488 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.230218 10323 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:37.230662 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.232465 10583 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.225801 10497 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.220197 10554 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.237468 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.238080 10553 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.238849 10324 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:37.240373 10553 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.241596 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:37.241906 10441 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:37.242219 10399 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.242434 10441 ts_tablet_manager.cc:1403] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.357s	user 0.011s	sys 0.007s
I20260709 13:14:37.244598 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.245502 10441 raft_consensus.cc:359] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.246151 10441 raft_consensus.cc:385] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.246522 10441 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.246687 10325 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.247344 10441 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.248719 10441 ts_tablet_manager.cc:1434] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:37.249630 10441 tablet_bootstrap.cc:492] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:37.250985 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:37.252931 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.254338 10325 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:37.255878 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:37.256219 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.256698 10533 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.256840 10364 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:37.257516 10399 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:37.257664 10497 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.258075 10497 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.258440 10497 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.260069 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:14:37.262084 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:37.263994 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:37.265031 10364 leader_election.cc:343] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.266062 10585 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.265679 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.266661 10585 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.257439 10533 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:37.267066 10585 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.268251 10554 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:37.268476 10288 leader_election.cc:343] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.268388 10533 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.269066 10440 tablet_bootstrap.cc:654] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.270365 10553 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.272516 10553 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:37.272262 10497 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.274974 10439 tablet_bootstrap.cc:654] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.275007 10553 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.276613 10497 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.334286 10441 tablet_bootstrap.cc:654] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.339985 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.343283 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.342163 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.357350 10441 tablet_bootstrap.cc:492] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:37.357995 10473 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.360121 10441 ts_tablet_manager.cc:1403] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.009s
W20260709 13:14:37.360061 10290 leader_election.cc:343] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.362622 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.345988 10248 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.367838 10554 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.367126 10585 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.370507 10250 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:37.372452 10587 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.371248 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.374027 10247 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.373834 10587 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.366490 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.372406 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.380295 10585 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.381208 10587 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.378278 10399 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:37.382656 10396 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:37.386768 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.387348 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.387475 10323 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:37.389214 10362 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.390555 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.390496 10439 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:37.391183 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.392876 10322 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.398878 10587 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.399320 10587 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.399672 10587 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.424587 10439 ts_tablet_manager.cc:1403] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.221s	user 0.036s	sys 0.026s
I20260709 13:14:37.427038 10440 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:37.426723 10441 raft_consensus.cc:359] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.427522 10440 ts_tablet_manager.cc:1403] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.284s	user 0.021s	sys 0.006s
I20260709 13:14:37.427469 10441 raft_consensus.cc:385] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.427948 10441 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.428807 10441 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.431305 10322 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:37.436174 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:37.428915 10362 leader_election.cc:343] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.436132 10497 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.442735 10148 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.445024 10439 raft_consensus.cc:359] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.445573 10439 raft_consensus.cc:385] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.445806 10439 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.446681 10533 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:37.449563 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:37.450619 10585 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.451115 10441 ts_tablet_manager.cc:1434] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.090s	user 0.011s	sys 0.004s
I20260709 13:14:37.451069 10585 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:37.452005 10585 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:37.453948 10364 leader_election.cc:343] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.441373 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.446370 10439 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.442299 10587 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.461459 10497 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.462231 10439 ts_tablet_manager.cc:1434] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:14:37.475069 10439 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:37.478685 10440 raft_consensus.cc:359] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.479346 10440 raft_consensus.cc:385] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.479580 10440 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
W20260709 13:14:37.462795 10362 leader_election.cc:343] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.480881 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:37.481979 10531 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:37.482368 10362 leader_election.cc:343] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.480077 10440 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.481105 10441 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:37.486887 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:37.489215 10473 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.491815 10440 ts_tablet_manager.cc:1434] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.003s
I20260709 13:14:37.492676 10440 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:37.478286 10497 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.468859 10247 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.511451 10533 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.512481 10533 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.496034 10497 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.517071 10533 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.530999 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.532054 10320 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:37.534416 10439 tablet_bootstrap.cc:654] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.538368 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.533360 10587 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.547062 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.539157 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:37.550959 10586 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.552899 10364 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:37.554476 10587 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.556370 10441 tablet_bootstrap.cc:654] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.558394 10440 tablet_bootstrap.cc:654] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.546432 10497 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:37.561869 10364 leader_election.cc:343] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.562107 10497 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.563223 10439 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:37.564015 10439 ts_tablet_manager.cc:1403] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.023s
I20260709 13:14:37.566581 10586 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:37.562723 10364 leader_election.cc:343] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.558348 10587 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:37.571172 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:37.572341 10399 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:37.572947 10553 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.573526 10553 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.573472 10587 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.576089 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.576987 10553 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.577127 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.577183 10320 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:37.578449 10250 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:37.578508 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.578969 10439 raft_consensus.cc:359] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.579679 10439 raft_consensus.cc:385] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.579952 10439 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.580031 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.580570 10439 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.582368 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.582955 10439 ts_tablet_manager.cc:1434] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:14:37.583642 10553 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.583969 10439 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:37.598261 10591 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.599588 10591 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.604736 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.605954 10324 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:37.598233 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.606820 10320 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.606942 10591 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.608084 10145 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.608675 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.606086 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.609812 10396 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:37.611112 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.611333 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:37.611857 10248 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:37.612262 10591 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.612720 10591 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.613312 10591 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.614717 10497 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.615384 10497 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.615978 10497 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.614137 10553 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.627460 10440 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:37.628091 10440 ts_tablet_manager.cc:1403] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.005s
I20260709 13:14:37.630748 10440 raft_consensus.cc:359] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.631410 10440 raft_consensus.cc:385] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.632416 10440 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.633567 10440 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.624136 10441 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:37.635733 10439 tablet_bootstrap.cc:654] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.636351 10441 ts_tablet_manager.cc:1403] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.016s
I20260709 13:14:37.638681 10440 ts_tablet_manager.cc:1434] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:37.639485 10440 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:37.634409 10146 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.646498 10320 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.647660 10497 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.650183 10497 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.652758 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.653422 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.653999 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:37.654093 10248 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.656214 10531 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.656370 10533 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:37.659281 10531 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.659842 10531 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.671578 10531 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.672108 10248 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.671882 10441 raft_consensus.cc:359] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.672750 10441 raft_consensus.cc:385] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.673427 10364 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:37.673740 10531 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.673097 10148 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.674429 10531 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.675803 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.676230 10362 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:14:37.677217 10364 leader_election.cc:343] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.677286 10591 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.677850 10441 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.679039 10441 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.680224 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:37.680809 10248 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.678073 10440 tablet_bootstrap.cc:654] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.676226 10439 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:37.686780 10439 ts_tablet_manager.cc:1403] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.007s
I20260709 13:14:37.686931 10591 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.687819 10531 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:37.688606 10440 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:37.689142 10440 ts_tablet_manager.cc:1403] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:14:37.688823 10531 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.690320 10441 ts_tablet_manager.cc:1434] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 13:14:37.690840 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:37.691182 10441 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:37.691371 10396 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.692104 10248 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:37.692132 10539 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.699184 10539 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:37.699493 10439 raft_consensus.cc:359] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.700754 10439 raft_consensus.cc:385] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.701043 10439 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.701669 10439 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.702850 10290 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:37.703264 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.703905 10591 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.705106 10324 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.708675 10591 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:37.709642 10591 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.710398 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.711026 10322 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.721051 10439 ts_tablet_manager.cc:1434] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:14:37.721992 10439 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:37.729357 10324 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.732296 10439 tablet_bootstrap.cc:654] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.735450 10322 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:37.736238 10441 tablet_bootstrap.cc:654] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.736650 10440 raft_consensus.cc:359] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.737331 10440 raft_consensus.cc:385] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.737504 10440 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.704231 10539 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.740690 10440 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.746466 10440 ts_tablet_manager.cc:1434] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.002s
I20260709 13:14:37.752043 10396 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:37.742084 10589 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.756780 10589 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.759037 10589 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.759829 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.764052 10554 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:37.765879 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:37.758103 10440 tablet_bootstrap.cc:492] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:37.766690 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.767365 10320 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
W20260709 13:14:37.768712 10364 leader_election.cc:343] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.769847 10589 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:37.770563 10589 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:37.772547 10589 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.786154 10440 tablet_bootstrap.cc:654] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.791476 10441 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:37.791939 10441 ts_tablet_manager.cc:1403] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.006s
I20260709 13:14:37.791708 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:37.795342 10539 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:37.795814 10539 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.795555 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.796190 10539 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.797037 10441 raft_consensus.cc:359] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.797748 10441 raft_consensus.cc:385] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.798033 10441 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.798743 10441 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.801096 10441 ts_tablet_manager.cc:1434] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:14:37.802306 10441 tablet_bootstrap.cc:492] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:37.806311 10539 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.810320 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:14:37.812677 10364 leader_election.cc:343] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:37.814357 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:37.815323 10322 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.818403 10439 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:37.818555 10440 tablet_bootstrap.cc:492] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:37.818910 10439 ts_tablet_manager.cc:1403] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.010s
I20260709 13:14:37.819298 10441 tablet_bootstrap.cc:654] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.818924 10440 ts_tablet_manager.cc:1403] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.002s
I20260709 13:14:37.825559 10440 raft_consensus.cc:359] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.826579 10440 raft_consensus.cc:385] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.826952 10440 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.828126 10591 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.828493 10439 raft_consensus.cc:359] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.830075 10439 raft_consensus.cc:385] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.830384 10439 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.830981 10441 tablet_bootstrap.cc:492] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:37.831458 10441 ts_tablet_manager.cc:1403] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.006s
I20260709 13:14:37.829409 10440 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.832523 10473 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.832967 10473 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.834551 10441 raft_consensus.cc:359] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.835043 10473 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.835280 10441 raft_consensus.cc:385] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:37.835594 10441 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:37.802650 10146 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.836932 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.831347 10439 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.837558 10441 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.837970 10440 ts_tablet_manager.cc:1434] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:14:37.840866 10440 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:37.841166 10441 ts_tablet_manager.cc:1434] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:37.839560 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.842054 10441 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:37.842581 10324 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:37.844607 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:37.839936 10439 ts_tablet_manager.cc:1434] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:37.846462 10473 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:37.846730 10439 tablet_bootstrap.cc:492] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:37.851218 10441 tablet_bootstrap.cc:654] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.853304 10440 tablet_bootstrap.cc:654] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.854166 10585 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.857625 10439 tablet_bootstrap.cc:654] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:37.865561 10531 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:14:37.885761 10531 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:37.882323 10585 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.887820 10585 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:37.889843 10148 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:37.908314 10585 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:37.911278 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:37.860153 10539 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:37.931197 10473 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:37.936098 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 125835us
I20260709 13:14:37.952056 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:37.979931 10324 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:37.983402 10440 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:37.984112 10440 ts_tablet_manager.cc:1403] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.018s
I20260709 13:14:37.987737 10322 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:38.006892 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:38.007015 10531 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.008277 10587 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.008829 10587 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:38.010288 10440 raft_consensus.cc:359] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.011075 10440 raft_consensus.cc:385] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.011360 10440 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.012045 10440 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.009794 10587 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.023789 10146 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.027285 10440 ts_tablet_manager.cc:1434] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:14:38.028390 10440 tablet_bootstrap.cc:492] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.039927 10441 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.041924 10441 ts_tablet_manager.cc:1403] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.200s	user 0.035s	sys 0.053s
I20260709 13:14:38.051607 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.053092 10632 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.053941 10473 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.076411 10553 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.077147 10553 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.081305 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.082675 10439 tablet_bootstrap.cc:492] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
W20260709 13:14:38.082885 10288 leader_election.cc:343] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.083189 10439 ts_tablet_manager.cc:1403] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.237s	user 0.020s	sys 0.033s
I20260709 13:14:38.086794 10553 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.093137 10441 raft_consensus.cc:359] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.093977 10441 raft_consensus.cc:385] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.094327 10441 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.093761 10148 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.094637 10632 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.095088 10441 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.096374 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.096779 10440 tablet_bootstrap.cc:654] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.100839 10439 raft_consensus.cc:359] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.101783 10439 raft_consensus.cc:385] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.102095 10439 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.102867 10439 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.104586 10439 ts_tablet_manager.cc:1434] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:14:38.105616 10439 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.110275 10441 ts_tablet_manager.cc:1434] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.003s
I20260709 13:14:38.111717 10441 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.114353 10439 tablet_bootstrap.cc:654] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.116796 10539 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.121964 10441 tablet_bootstrap.cc:654] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.125857 10440 tablet_bootstrap.cc:492] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.126401 10440 ts_tablet_manager.cc:1403] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.000s
I20260709 13:14:38.130057 10440 raft_consensus.cc:359] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.131014 10440 raft_consensus.cc:385] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.131349 10440 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
W20260709 13:14:38.132218 10290 leader_election.cc:343] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.132158 10440 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.132846 10290 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:38.133340 10441 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.133750 10553 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.133883 10441 ts_tablet_manager.cc:1403] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 13:14:38.134881 10440 ts_tablet_manager.cc:1434] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:38.136314 10440 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.137157 10441 raft_consensus.cc:359] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.137908 10441 raft_consensus.cc:385] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.138221 10441 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.139323 10441 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.141968 10441 ts_tablet_manager.cc:1434] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:38.143541 10440 tablet_bootstrap.cc:654] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.143013 10441 tablet_bootstrap.cc:492] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.155277 10439 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.158382 10439 ts_tablet_manager.cc:1403] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.002s
I20260709 13:14:38.168041 10539 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.169420 10439 raft_consensus.cc:359] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.170477 10439 raft_consensus.cc:385] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.170930 10439 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.171864 10439 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.172943 10539 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:38.174611 10531 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.176141 10587 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.176815 10587 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.181219 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:38.182971 10364 leader_election.cc:343] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.185117 10439 ts_tablet_manager.cc:1434] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:14:38.187372 10439 tablet_bootstrap.cc:492] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.189657 10587 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.191454 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.153476 10441 tablet_bootstrap.cc:654] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.192914 10440 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.193519 10440 ts_tablet_manager.cc:1403] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.057s	user 0.030s	sys 0.017s
W20260709 13:14:38.193493 10362 leader_election.cc:343] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.196554 10362 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.197808 10587 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.206250 10539 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.208032 10439 tablet_bootstrap.cc:654] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.210548 10553 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.211452 10539 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.211987 10539 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.213369 10440 raft_consensus.cc:359] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.214184 10440 raft_consensus.cc:385] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.214535 10440 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.215060 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.215288 10440 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:38.216763 10364 leader_election.cc:343] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.218657 10539 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.219166 10440 ts_tablet_manager.cc:1434] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:14:38.220796 10440 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.225543 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.226590 10324 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:38.234009 10440 tablet_bootstrap.cc:654] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.238516 10553 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.246778 10553 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.249132 10553 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.250969 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:38.253252 10288 leader_election.cc:343] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.253381 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.243626 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:14:38.258598 10290 leader_election.cc:343] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.258766 10623 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.259157 10290 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:38.264271 10554 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.264405 10587 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.269170 10587 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.273418 10587 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.282583 10633 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.283151 10633 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.283869 10533 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.284335 10533 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.285279 10633 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.286832 10533 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.297899 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.298771 10322 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:38.309190 10439 tablet_bootstrap.cc:492] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.309667 10439 ts_tablet_manager.cc:1403] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.013s
I20260709 13:14:38.307842 10497 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.301726 10587 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.315662 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.315738 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.316468 10321 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:38.314683 10497 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.325275 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.325990 10248 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:38.326202 10539 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.329250 10439 raft_consensus.cc:359] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.329970 10439 raft_consensus.cc:385] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.332093 10587 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.333261 10213 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.334751 10632 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.330222 10439 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.339413 10441 tablet_bootstrap.cc:492] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.340013 10441 ts_tablet_manager.cc:1403] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.197s	user 0.022s	sys 0.019s
I20260709 13:14:38.339730 10439 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.349100 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.351199 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:38.351512 10497 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.351881 10320 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.352027 10497 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.355221 10497 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.355618 10497 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.363857 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.364292 10440 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.357897 10439 ts_tablet_manager.cc:1434] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 13:14:38.364972 10440 ts_tablet_manager.cc:1403] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.040s
I20260709 13:14:38.365996 10439 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
W20260709 13:14:38.367879 10362 leader_election.cc:343] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.372653 10632 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.373129 10320 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:38.374790 10539 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.379770 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:38.380260 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.381168 10587 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.381036 10440 raft_consensus.cc:359] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.381747 10587 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:38.381950 10440 raft_consensus.cc:385] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.382403 10440 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.383699 10440 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.388410 10440 ts_tablet_manager.cc:1434] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:14:38.390969 10440 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.381214 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.382709 10587 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:38.395970 10364 leader_election.cc:343] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:38.396960 10364 leader_election.cc:343] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.397410 10364 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.398602 10539 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.400571 10439 tablet_bootstrap.cc:654] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.408202 10441 raft_consensus.cc:359] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.408984 10441 raft_consensus.cc:385] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.409278 10441 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.409919 10441 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:38.421389 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:38.427819 10441 ts_tablet_manager.cc:1434] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:14:38.443078 10440 tablet_bootstrap.cc:654] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.413990 10497 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.449199 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:38.449443 10497 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.449935 10248 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.457022 10441 tablet_bootstrap.cc:492] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.466502 10497 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:38.467829 10632 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.468374 10632 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.470551 10632 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.471333 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:38.472980 10324 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.476843 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.479038 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.479699 10396 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:38.480937 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:38.485710 10533 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.485751 10440 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.486937 10440 ts_tablet_manager.cc:1403] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.016s
I20260709 13:14:38.487115 10439 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.487613 10439 ts_tablet_manager.cc:1403] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.014s
I20260709 13:14:38.483352 10632 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.487982 10632 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.488380 10632 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.491995 10440 raft_consensus.cc:359] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.492803 10440 raft_consensus.cc:385] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.493093 10440 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
W20260709 13:14:38.491654 10213 leader_election.cc:343] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.497575 10439 raft_consensus.cc:359] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.498402 10439 raft_consensus.cc:385] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.493788 10440 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.484127 10248 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:38.498776 10439 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.506398 10441 tablet_bootstrap.cc:654] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.500932 10439 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.511022 10439 ts_tablet_manager.cc:1434] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260709 13:14:38.513119 10440 ts_tablet_manager.cc:1434] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:14:38.514261 10440 tablet_bootstrap.cc:492] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.514333 10324 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:38.513155 10439 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.519135 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.520157 10533 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.520661 10533 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:38.522341 10533 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.523489 10146 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.532104 10553 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.532738 10553 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.546499 10439 tablet_bootstrap.cc:654] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.566970 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.554051 10632 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.568171 10553 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:38.576105 10288 leader_election.cc:343] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.576578 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.578310 10440 tablet_bootstrap.cc:654] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:38.589347 10290 leader_election.cc:343] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.589869 10290 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:38.591398 10624 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.594338 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:38.594938 10396 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.585638 10145 catalog_manager.cc:5697] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.592427 10632 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.600140 10439 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.600644 10439 ts_tablet_manager.cc:1403] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.007s
I20260709 13:14:38.602950 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:38.603446 10439 raft_consensus.cc:359] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.604175 10439 raft_consensus.cc:385] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.604496 10439 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.605155 10439 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:38.607057 10213 leader_election.cc:343] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.607888 10396 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:38.609267 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.609974 10441 tablet_bootstrap.cc:492] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.610591 10533 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.611189 10441 ts_tablet_manager.cc:1403] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.165s	user 0.011s	sys 0.015s
I20260709 13:14:38.611464 10633 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.611313 10533 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.611965 10633 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.613583 10533 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.613862 10441 raft_consensus.cc:359] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.614538 10441 raft_consensus.cc:385] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.614740 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.615016 10439 ts_tablet_manager.cc:1434] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:14:38.614933 10441 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.616029 10439 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
W20260709 13:14:38.615993 10362 leader_election.cc:343] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.616309 10441 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.616981 10585 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.617934 10585 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:38.618458 10633 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.618774 10441 ts_tablet_manager.cc:1434] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:14:38.619801 10441 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.619938 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.619997 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.620412 10585 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:38.622525 10364 leader_election.cc:343] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.622583 10440 tablet_bootstrap.cc:492] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.623000 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.623747 10533 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.623196 10440 ts_tablet_manager.cc:1403] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.109s	user 0.009s	sys 0.006s
I20260709 13:14:38.624191 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.625247 10439 tablet_bootstrap.cc:654] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.621338 10321 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:38.627069 10213 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.628230 10633 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.627017 10440 raft_consensus.cc:359] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.628877 10440 raft_consensus.cc:385] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.635658 10440 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.636708 10440 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.640242 10440 ts_tablet_manager.cc:1434] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:38.641538 10440 tablet_bootstrap.cc:492] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.635269 10441 tablet_bootstrap.cc:654] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.643713 10633 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:38.654562 10440 tablet_bootstrap.cc:654] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.654826 10439 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.657171 10441 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.661067 10441 ts_tablet_manager.cc:1403] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 13:14:38.664048 10441 raft_consensus.cc:359] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.664732 10441 raft_consensus.cc:385] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.665012 10441 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.665730 10441 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.666627 10439 ts_tablet_manager.cc:1403] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.018s
I20260709 13:14:38.667833 10441 ts_tablet_manager.cc:1434] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:38.666172 10440 tablet_bootstrap.cc:492] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.668861 10440 ts_tablet_manager.cc:1403] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 13:14:38.669469 10439 raft_consensus.cc:359] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.670156 10439 raft_consensus.cc:385] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.670434 10439 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.670943 10441 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.671217 10439 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.673322 10439 ts_tablet_manager.cc:1434] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:14:38.673377 10440 raft_consensus.cc:359] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.674070 10440 raft_consensus.cc:385] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.674326 10439 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.679195 10441 tablet_bootstrap.cc:654] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.680238 10439 tablet_bootstrap.cc:654] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.674360 10440 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.701610 10145 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.684742 10440 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.713694 10440 ts_tablet_manager.cc:1434] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:14:38.716706 10440 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.714963 10441 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.715723 10439 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.719534 10439 ts_tablet_manager.cc:1403] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.016s
I20260709 13:14:38.722383 10440 tablet_bootstrap.cc:654] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.723212 10441 ts_tablet_manager.cc:1403] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.001s
I20260709 13:14:38.725839 10441 raft_consensus.cc:359] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.726509 10441 raft_consensus.cc:385] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.726759 10441 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.727401 10441 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.729574 10441 ts_tablet_manager.cc:1434] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:14:38.730448 10441 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.722337 10439 raft_consensus.cc:359] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.733827 10439 raft_consensus.cc:385] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.734109 10439 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.734815 10439 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.737016 10439 ts_tablet_manager.cc:1434] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.002s
I20260709 13:14:38.737974 10439 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.745954 10439 tablet_bootstrap.cc:654] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.748831 10440 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.749378 10440 ts_tablet_manager.cc:1403] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.008s
I20260709 13:14:38.751880 10441 tablet_bootstrap.cc:654] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.752058 10440 raft_consensus.cc:359] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.752772 10440 raft_consensus.cc:385] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.753086 10440 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.753786 10440 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.756815 10439 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.756768 10440 ts_tablet_manager.cc:1434] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:38.757519 10439 ts_tablet_manager.cc:1403] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:14:38.758778 10440 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.760090 10439 raft_consensus.cc:359] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.760787 10439 raft_consensus.cc:385] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.761040 10439 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.761638 10439 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.763885 10439 ts_tablet_manager.cc:1434] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:14:38.765733 10439 tablet_bootstrap.cc:492] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.766136 10440 tablet_bootstrap.cc:654] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.775415 10441 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.776149 10441 ts_tablet_manager.cc:1403] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.008s
I20260709 13:14:38.779505 10441 raft_consensus.cc:359] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.780937 10439 tablet_bootstrap.cc:654] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.781124 10441 raft_consensus.cc:385] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.783108 10440 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:38.788735 10440 ts_tablet_manager.cc:1403] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.006s
I20260709 13:14:38.785914 10587 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:14:38.790475 10651 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.791007 10651 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.783071 10441 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.795145 10441 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.798393 10440 raft_consensus.cc:359] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.799121 10440 raft_consensus.cc:385] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.799480 10440 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.800729 10441 ts_tablet_manager.cc:1434] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:14:38.802470 10651 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.800280 10440 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.803328 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.806712 10248 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:38.807603 10585 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.808125 10585 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.807752 10441 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.810184 10585 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.804343 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.812351 10396 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:38.812718 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.813653 10321 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:38.814988 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.815784 10399 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:38.817294 10441 tablet_bootstrap.cc:654] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.817381 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.818328 10651 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.818684 10651 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.819083 10439 tablet_bootstrap.cc:492] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.819015 10651 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.819373 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:38.821662 10533 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.822330 10533 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.825057 10533 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.825608 10651 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.827421 10633 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.827684 10439 ts_tablet_manager.cc:1403] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.024s
I20260709 13:14:38.828531 10531 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:38.827807 10633 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.831017 10633 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.831079 10439 raft_consensus.cc:359] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.831979 10439 raft_consensus.cc:385] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.832310 10439 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.833007 10439 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.833242 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:38.833912 10247 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.834808 10585 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.835320 10585 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.838429 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.830595 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.836113 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:38.841274 10399 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.846213 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.847296 10396 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
W20260709 13:14:38.850387 10362 leader_election.cc:343] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.859061 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.846742 10247 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:38.860318 10632 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.860836 10632 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.862821 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:38.864003 10586 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.864375 10586 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.864730 10586 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.862949 10632 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.828166 10651 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.865731 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.866405 10396 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:38.851820 10585 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.866497 10439 ts_tablet_manager.cc:1434] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:14:38.869419 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:38.870318 10585 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.870689 10585 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.871038 10585 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.871474 10439 tablet_bootstrap.cc:492] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:38.873332 10586 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.877277 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:38.877810 10399 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:38.877954 10396 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.889281 10585 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.878300 10586 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:38.878844 10213 leader_election.cc:343] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.866565 10633 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.881196 10248 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:38.882200 10439 tablet_bootstrap.cc:654] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.884662 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:38.884930 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.892401 10651 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.892920 10651 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:38.893795 10651 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.885016 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:38.897329 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.898041 10396 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:38.898193 10533 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.898686 10533 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.899060 10533 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:38.899106 10213 leader_election.cc:343] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.899633 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:14:38.900084 10213 leader_election.cc:343] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.900372 10325 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.906499 10585 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.907256 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:38.908205 10396 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.908528 10633 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.912546 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.913101 10440 ts_tablet_manager.cc:1434] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260709 13:14:38.914095 10440 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:38.914927 10586 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.915412 10586 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:38.917449 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:38.922079 10533 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.922647 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:38.923710 10325 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:38.922338 10396 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:38.918053 10399 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:38.926573 10213 leader_election.cc:343] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.927269 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.928856 10680 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.916278 10586 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.931252 10148 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.936558 10533 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:38.937425 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:38.938064 10248 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.938583 10441 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:38.939078 10441 ts_tablet_manager.cc:1403] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.132s	user 0.046s	sys 0.028s
I20260709 13:14:38.941612 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:38.942049 10441 raft_consensus.cc:359] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.942829 10441 raft_consensus.cc:385] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.943140 10441 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.943250 10399 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:38.942960 10680 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:38.943856 10441 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.944355 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.945152 10633 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:38.945731 10362 leader_election.cc:343] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.945813 10633 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:38.942539 10440 tablet_bootstrap.cc:654] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.946115 10441 ts_tablet_manager.cc:1434] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:38.938583 10439 tablet_bootstrap.cc:492] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:38.947345 10441 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:38.947294 10439 ts_tablet_manager.cc:1403] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.005s
I20260709 13:14:38.951246 10651 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.951771 10651 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.953984 10651 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.954661 10633 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.955633 10651 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.955803 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.956123 10651 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:38.957641 10290 leader_election.cc:343] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.961895 10651 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.962571 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.964424 10396 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:38.964618 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:38.965886 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.965968 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:38.966643 10399 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
W20260709 13:14:38.967381 10290 leader_election.cc:343] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:38.944512 10680 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.968163 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:38.968334 10651 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.970373 10553 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:38.971103 10553 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.969987 10248 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:38.971556 10553 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.975878 10441 tablet_bootstrap.cc:654] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:38.971992 10651 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.982414 10651 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:38.988106 10553 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.988405 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:14:38.990181 10533 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:38.990918 10533 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:38.991595 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:38.993530 10439 raft_consensus.cc:359] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.993201 10533 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.995501 10439 raft_consensus.cc:385] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:38.996274 10439 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:38.997316 10439 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:38.997779 10146 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.000887 10624 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.001560 10624 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.005259 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.006183 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:39.006979 10399 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.010592 10624 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:38.990093 10651 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:39.018800 10290 leader_election.cc:343] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.020927 10440 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.020812 10399 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:39.022496 10440 ts_tablet_manager.cc:1403] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.027s
I20260709 13:14:39.024099 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.013216 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:38.997112 10553 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.030346 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:39.030676 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:39.031565 10399 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:39.031733 10290 leader_election.cc:343] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.035732 10439 ts_tablet_manager.cc:1434] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.001s
I20260709 13:14:39.036695 10439 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.026285 10440 raft_consensus.cc:359] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.037889 10440 raft_consensus.cc:385] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.038177 10440 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.042883 10396 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:39.025933 10624 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:39.043895 10624 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:39.044111 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.044736 10624 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.046298 10146 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.055735 10440 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.038820 10553 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.046933 10651 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.070268 10440 ts_tablet_manager.cc:1434] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:14:39.073077 10440 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.073503 10651 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.079730 10585 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.061707 10553 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.106257 10685 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.107721 10497 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.107844 10685 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.111433 10685 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.113085 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.113983 10553 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:39.114600 10288 leader_election.cc:343] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.117935 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.118412 10439 tablet_bootstrap.cc:654] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.118937 10397 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:39.119664 10533 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.120971 10399 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:39.123171 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:39.126387 10290 leader_election.cc:343] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.126919 10290 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.123895 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.128086 10553 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.137549 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.138935 10553 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:39.139443 10553 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:39.141153 10553 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.142197 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.143064 10685 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.159907 10440 tablet_bootstrap.cc:654] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.178748 10685 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.192178 10441 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:39.188527 10146 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.192703 10441 ts_tablet_manager.cc:1403] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.246s	user 0.015s	sys 0.019s
I20260709 13:14:39.195627 10439 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.196105 10439 ts_tablet_manager.cc:1403] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.013s
I20260709 13:14:39.196378 10441 raft_consensus.cc:359] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.201709 10441 raft_consensus.cc:385] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.202055 10441 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.202806 10441 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.204946 10441 ts_tablet_manager.cc:1434] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:14:39.205879 10441 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:39.208305 10651 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.199452 10148 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.200006 10439 raft_consensus.cc:359] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.214159 10439 raft_consensus.cc:385] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.193459 10146 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.214532 10439 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.215204 10439 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.222352 10585 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.228118 10439 ts_tablet_manager.cc:1434] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:14:39.229121 10439 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.229461 10441 tablet_bootstrap.cc:654] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.247231 10439 tablet_bootstrap.cc:654] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.260934 10651 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.261667 10651 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.265806 10651 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.266034 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.268014 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.268814 10248 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:39.271551 10290 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.273169 10685 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.279898 10685 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.285494 10440 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.286185 10440 ts_tablet_manager.cc:1403] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.001s
I20260709 13:14:39.291123 10440 raft_consensus.cc:359] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.293798 10440 raft_consensus.cc:385] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.294214 10440 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.295126 10440 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.298116 10440 ts_tablet_manager.cc:1434] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:14:39.300414 10440 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.301052 10439 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.302296 10439 ts_tablet_manager.cc:1403] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.030s
I20260709 13:14:39.305071 10439 raft_consensus.cc:359] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.305789 10439 raft_consensus.cc:385] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.306062 10439 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.306751 10439 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.309104 10439 ts_tablet_manager.cc:1434] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:39.310010 10439 tablet_bootstrap.cc:492] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.311129 10440 tablet_bootstrap.cc:654] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.314621 10651 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.317080 10439 tablet_bootstrap.cc:654] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.324105 10440 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.324783 10440 ts_tablet_manager.cc:1403] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:14:39.328953 10440 raft_consensus.cc:359] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.329582 10439 tablet_bootstrap.cc:492] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.329653 10440 raft_consensus.cc:385] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.330029 10440 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.330145 10439 ts_tablet_manager.cc:1403] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:14:39.330883 10440 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.332809 10439 raft_consensus.cc:359] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.333232 10440 ts_tablet_manager.cc:1434] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:14:39.333520 10439 raft_consensus.cc:385] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.333807 10439 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.334168 10440 tablet_bootstrap.cc:492] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.334468 10439 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.335440 10651 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.335985 10651 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.338057 10651 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.340422 10439 ts_tablet_manager.cc:1434] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:14:39.341318 10440 tablet_bootstrap.cc:654] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.341495 10439 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.342669 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.348950 10439 tablet_bootstrap.cc:654] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:39.350183 10288 leader_election.cc:343] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.355836 10440 tablet_bootstrap.cc:492] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.356504 10440 ts_tablet_manager.cc:1403] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:14:39.358767 10585 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.359062 10439 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.359534 10439 ts_tablet_manager.cc:1403] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:14:39.359380 10585 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.359776 10440 raft_consensus.cc:359] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.360462 10440 raft_consensus.cc:385] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.360733 10440 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.361847 10440 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.362203 10439 raft_consensus.cc:359] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.362691 10585 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.362888 10439 raft_consensus.cc:385] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.363337 10439 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.363996 10439 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.364313 10440 ts_tablet_manager.cc:1434] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:14:39.364248 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.365398 10397 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:39.365482 10440 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.366309 10439 ts_tablet_manager.cc:1434] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:39.367246 10439 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.371994 10440 tablet_bootstrap.cc:654] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.373860 10685 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.374428 10685 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.376694 10685 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.373162 10439 tablet_bootstrap.cc:654] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.380764 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.381973 10397 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:39.385819 10440 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.386390 10440 ts_tablet_manager.cc:1403] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 13:14:39.391834 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.391758 10440 raft_consensus.cc:359] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.392622 10440 raft_consensus.cc:385] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.393015 10440 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.393878 10440 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.392652 10248 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:39.397001 10440 ts_tablet_manager.cc:1434] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:14:39.408285 10145 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.409811 10440 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.410163 10439 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.410620 10439 ts_tablet_manager.cc:1403] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.019s
I20260709 13:14:39.414080 10439 raft_consensus.cc:359] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.415031 10439 raft_consensus.cc:385] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.415306 10439 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.415997 10439 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.416838 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:39.418267 10439 ts_tablet_manager.cc:1434] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:39.419222 10439 tablet_bootstrap.cc:492] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.424983 10439 tablet_bootstrap.cc:654] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.428726 10440 tablet_bootstrap.cc:654] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.440824 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.443871 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:39.445135 10585 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.445431 10441 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:39.445914 10441 ts_tablet_manager.cc:1403] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.240s	user 0.054s	sys 0.104s
I20260709 13:14:39.449764 10441 raft_consensus.cc:359] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.450536 10441 raft_consensus.cc:385] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.450810 10441 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.451577 10441 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.453434 10441 ts_tablet_manager.cc:1434] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:39.460886 10440 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.462522 10441 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:39.462453 10585 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.467617 10440 ts_tablet_manager.cc:1403] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.004s
I20260709 13:14:39.469194 10441 tablet_bootstrap.cc:654] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.471113 10440 raft_consensus.cc:359] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.471872 10440 raft_consensus.cc:385] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.472066 10685 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.472180 10440 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.472631 10685 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.472971 10439 tablet_bootstrap.cc:492] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.472923 10440 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.473542 10439 ts_tablet_manager.cc:1403] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.024s
I20260709 13:14:39.474112 10680 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.474726 10685 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.474587 10680 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.476173 10439 raft_consensus.cc:359] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.476372 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.476858 10439 raft_consensus.cc:385] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.477130 10439 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.477758 10439 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:39.478008 10288 leader_election.cc:343] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.476568 10680 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.479898 10439 ts_tablet_manager.cc:1434] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:14:39.480825 10439 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.481748 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.481980 10440 ts_tablet_manager.cc:1434] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:14:39.482501 10397 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:39.483240 10440 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.483958 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:39.484786 10680 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.485206 10680 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.485538 10680 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.487138 10439 tablet_bootstrap.cc:654] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.490514 10440 tablet_bootstrap.cc:654] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.492998 10680 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.498507 10685 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.499185 10685 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.501360 10685 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.501912 10440 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.502427 10440 ts_tablet_manager.cc:1403] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 13:14:39.505040 10440 raft_consensus.cc:359] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.505724 10440 raft_consensus.cc:385] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.506002 10440 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.506603 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.506772 10440 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:39.508152 10288 leader_election.cc:343] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.508857 10440 ts_tablet_manager.cc:1434] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:39.508344 10685 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.511816 10680 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.515136 10440 tablet_bootstrap.cc:492] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:39.515386 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:39.517457 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:39.518285 10397 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.523291 10440 tablet_bootstrap.cc:654] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.523850 10685 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.524441 10685 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.524901 10685 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.529295 10441 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:39.529827 10441 ts_tablet_manager.cc:1403] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.008s
I20260709 13:14:39.533454 10441 raft_consensus.cc:359] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.534166 10441 raft_consensus.cc:385] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.534518 10441 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.535282 10441 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.537010 10290 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.538131 10553 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.545058 10397 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:39.546351 10439 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:39.549336 10685 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.550108 10439 ts_tablet_manager.cc:1403] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.070s	user 0.043s	sys 0.021s
I20260709 13:14:39.550961 10589 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:39.552651 10439 raft_consensus.cc:359] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.553171 10439 raft_consensus.cc:385] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:39.553443 10439 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:39.554119 10439 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.555012 10688 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.555572 10688 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.556881 10439 ts_tablet_manager.cc:1434] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:39.556744 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:39.558373 10680 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:39.558859 10680 raft_consensus.cc:697] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:39.559640 10688 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.559688 10680 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.560734 10439 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:39.561034 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:39.561685 10397 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:39.562947 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:39.564085 10688 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.564565 10688 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.565056 10688 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.566550 10586 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:39.572824 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.574144 10247 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.575814 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.576493 10249 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:39.578107 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.579124 10439 tablet_bootstrap.cc:654] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:39.578154 10441 ts_tablet_manager.cc:1434] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:14:39.594558 10685 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.595781 10497 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:39.596254 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:14:39.603799 10288 leader_election.cc:343] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.605042 10441 tablet_bootstrap.cc:492] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:39.606199 10497 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.606971 10497 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.609344 10651 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:39.610450 10497 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:39.611114 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:39.611841 10249 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:39.615123 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:39.615947 10364 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:39.615836 10324 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:39.617316 10497 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:39.617754 10497 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.618141 10497 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.615756 10688 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.628485 10688 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.631699 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:39.632069 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:39.632649 10325 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:39.637589 10290 leader_election.cc:343] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.638438 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.632726 10249 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:39.547804 10553 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.651947 10685 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.670814 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:39.671766 10245 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:39.678869 10290 leader_election.cc:343] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:39.679522 10290 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:39.646250 10688 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.652295 10586 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:14:39.689211 10685 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:39.688207 10688 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.731527 10651 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.745509 10651 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:39.697114 10553 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 13:14:39.799947 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:39.823686 10323 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:39.703956 10680 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.090s
I20260709 13:14:39.754357 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:39.937732 10688 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:39.994647 10440 tablet_bootstrap.cc:492] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:39.995342 10440 ts_tablet_manager.cc:1403] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.480s	user 0.039s	sys 0.040s
I20260709 13:14:39.862353 10398 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:40.001426 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 294580us
W20260709 13:14:39.993669 10719 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:14:40.023846 10439 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:40.024529 10439 ts_tablet_manager.cc:1403] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.464s	user 0.047s	sys 0.044s
I20260709 13:14:40.027422 10440 raft_consensus.cc:359] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.028012 10440 raft_consensus.cc:385] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.028301 10440 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.028811 10440 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.030052 10440 ts_tablet_manager.cc:1434] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.001s
I20260709 13:14:40.030874 10440 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:40.029837 10439 raft_consensus.cc:359] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.031841 10439 raft_consensus.cc:385] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.032248 10439 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.033214 10439 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:40.021905 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:40.045802 10441 tablet_bootstrap.cc:654] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.060447 10440 tablet_bootstrap.cc:654] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.061362 10439 ts_tablet_manager.cc:1434] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:14:40.061249 10325 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:40.064520 10497 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.067494 10687 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:14:40.071210 10439 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:40.070964 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.084215 10723 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.085023 10723 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.071024 10651 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:40.136557 10715 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:14:40.141911 10716 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:14:40.152359 10717 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:14:40.152746 10723 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.155925 10497 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:14:40.210037 10213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.010s	sys 0.009s
W20260709 13:14:40.210915 10213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.010s	sys 0.013s
W20260709 13:14:40.211370 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 536817us
I20260709 13:14:40.211609 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:40.222975 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82383.7us
I20260709 13:14:40.230517 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.239987 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:40.240859 10246 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.248728 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:40.277029 10440 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:40.278031 10440 ts_tablet_manager.cc:1403] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.247s	user 0.021s	sys 0.017s
W20260709 13:14:40.310827 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 172863us
I20260709 13:14:40.310851 10441 tablet_bootstrap.cc:492] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:40.367388 10651 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.368288 10651 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.369252 10440 raft_consensus.cc:359] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.370062 10440 raft_consensus.cc:385] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.370441 10440 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.371308 10440 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.336567 10146 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.375262 10441 ts_tablet_manager.cc:1403] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.771s	user 0.038s	sys 0.039s
I20260709 13:14:40.375907 10651 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.380604 10440 ts_tablet_manager.cc:1434] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 13:14:40.382344 10440 tablet_bootstrap.cc:492] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
W20260709 13:14:40.391582 10288 leader_election.cc:343] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.398895 10439 tablet_bootstrap.cc:654] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.401021 10651 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:40.401999 10245 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.729s	user 0.015s	sys 0.011s
I20260709 13:14:40.402498 10245 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:40.404778 10441 raft_consensus.cc:359] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.405726 10441 raft_consensus.cc:385] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.406056 10441 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
W20260709 13:14:40.408475 10288 leader_election.cc:343] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.408469 10441 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.412638 10441 ts_tablet_manager.cc:1434] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:14:40.422325 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:40.423209 10325 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.435740 10440 tablet_bootstrap.cc:654] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.437161 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:40.442411 10290 leader_election.cc:343] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.442977 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:40.443893 10651 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:40.448359 10290 leader_election.cc:343] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.448818 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:40.452343 10246 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:40.456426 10680 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.457019 10398 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:40.457151 10680 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.459774 10680 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:40.460012 10249 consensus_meta.cc:287] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.006s
I20260709 13:14:40.460510 10249 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
W20260709 13:14:40.463740 10288 leader_election.cc:343] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.463603 10728 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:40.465111 10723 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:40.467514 10441 tablet_bootstrap.cc:492] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:40.471875 10733 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.473764 10553 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:40.475282 10736 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.475812 10364 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:40.475961 10736 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.465242 10325 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:40.481061 10722 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.473114 10733 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.481633 10722 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:40.483974 10733 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:40.483777 10722 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.489539 10439 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:40.486347 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:40.493290 10736 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:40.492468 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:40.497481 10553 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.498081 10553 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:14:40.498631 10364 leader_election.cc:343] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.499207 10553 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.488423 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:40.490206 10439 ts_tablet_manager.cc:1403] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.419s	user 0.025s	sys 0.015s
I20260709 13:14:40.514370 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.520467 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:40.521405 10651 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.521906 10651 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:40.540978 10585 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:40.533031 10651 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.556013 10439 raft_consensus.cc:359] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.556782 10439 raft_consensus.cc:385] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.557099 10439 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.557504 10440 tablet_bootstrap.cc:492] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:40.557991 10440 ts_tablet_manager.cc:1403] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.176s	user 0.007s	sys 0.010s
I20260709 13:14:40.557773 10439 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.567889 10440 raft_consensus.cc:359] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.570808 10440 raft_consensus.cc:385] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.571453 10440 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.572973 10440 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.580955 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.581485 10148 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.585961 10441 tablet_bootstrap.cc:654] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.587309 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:40.588040 10244 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:40.616034 10440 ts_tablet_manager.cc:1434] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.003s
I20260709 13:14:40.615936 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:40.617470 10440 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:40.621960 10439 ts_tablet_manager.cc:1434] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.118s	user 0.004s	sys 0.005s
I20260709 13:14:40.624583 10439 tablet_bootstrap.cc:492] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:40.662824 10440 tablet_bootstrap.cc:654] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.650306 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:40.666893 10322 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:40.674439 10687 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:14:40.675349 10687 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.677976 10687 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:40.707316 10213 leader_election.cc:343] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.721341 10687 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.731993 10687 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.729292 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:40.756234 10318 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:40.730104 10586 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:14:40.760758 10687 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.762706 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.763729 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:40.764914 10288 leader_election.cc:343] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.772017 10439 tablet_bootstrap.cc:654] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.751682 10441 tablet_bootstrap.cc:492] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:40.773293 10441 ts_tablet_manager.cc:1403] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.306s	user 0.017s	sys 0.008s
I20260709 13:14:40.775470 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:40.775998 10441 raft_consensus.cc:359] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.776705 10441 raft_consensus.cc:385] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.776966 10441 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.777670 10441 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.784179 10441 ts_tablet_manager.cc:1434] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.004s
I20260709 13:14:40.785326 10441 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:40.790558 10440 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:40.791078 10440 ts_tablet_manager.cc:1403] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.174s	user 0.027s	sys 0.008s
W20260709 13:14:40.790988 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 70156.6us
I20260709 13:14:40.794185 10440 raft_consensus.cc:359] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.794932 10440 raft_consensus.cc:385] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.795205 10440 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.795760 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:40.795856 10440 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.798487 10440 ts_tablet_manager.cc:1434] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:40.799685 10440 tablet_bootstrap.cc:492] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:40.803220 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:40.803993 10243 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:40.804095 10765 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.804677 10765 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.805380 10633 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.805833 10633 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.806617 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:40.806882 10765 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.807775 10736 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.807902 10633 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.808213 10736 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.808629 10736 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.810873 10441 tablet_bootstrap.cc:654] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.813063 10213 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:40.820181 10765 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.822804 10765 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:40.823524 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:40.824462 10497 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:40.825657 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:40.827564 10765 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.828008 10765 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.828401 10765 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.836860 10765 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.839641 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:40.854318 10763 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.854756 10763 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.855118 10763 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.859350 10440 tablet_bootstrap.cc:654] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.871292 10290 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:40.873279 10763 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.873888 10440 tablet_bootstrap.cc:492] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:40.874544 10440 ts_tablet_manager.cc:1403] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.010s
I20260709 13:14:40.818116 10736 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.843048 10439 tablet_bootstrap.cc:492] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:40.849978 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.877548 10439 ts_tablet_manager.cc:1403] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.254s	user 0.012s	sys 0.007s
I20260709 13:14:40.878167 10440 raft_consensus.cc:359] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.879233 10440 raft_consensus.cc:385] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.879554 10440 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.880286 10440 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.882349 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:40.882907 10687 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:40.883888 10288 leader_election.cc:343] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.884794 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:40.884847 10439 raft_consensus.cc:359] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.885514 10243 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.885660 10439 raft_consensus.cc:385] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.886046 10439 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.886842 10439 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.882925 10440 ts_tablet_manager.cc:1434] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:14:40.888235 10290 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:40.889252 10440 tablet_bootstrap.cc:492] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:40.889605 10736 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:40.890100 10441 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:40.890859 10441 ts_tablet_manager.cc:1403] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.000s
I20260709 13:14:40.892709 10687 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:40.893134 10687 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.893409 10243 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:40.893543 10687 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.894734 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:40.895517 10736 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:40.896601 10736 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:40.897457 10736 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.899565 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.893194 10763 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.899977 10586 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.902573 10586 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.904193 10441 raft_consensus.cc:359] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.904618 10586 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.907173 10441 raft_consensus.cc:385] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:40.907286 10586 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.907548 10441 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:40.907802 10586 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.908339 10441 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.909881 10586 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.901726 10765 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:40.910908 10441 ts_tablet_manager.cc:1434] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:14:40.912123 10441 tablet_bootstrap.cc:492] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
W20260709 13:14:40.906637 10213 leader_election.cc:343] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:40.918743 10213 leader_election.cc:343] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.924587 10441 tablet_bootstrap.cc:654] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:40.927107 10651 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:40.933971 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:40.936050 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.943410 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:40.945899 10439 ts_tablet_manager.cc:1434] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:14:40.947105 10439 tablet_bootstrap.cc:492] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:40.948778 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:40.949719 10249 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:40.948927 10148 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:40.956094 10213 leader_election.cc:343] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:40.957661 10213 leader_election.cc:343] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:40.960541 10213 leader_election.cc:343] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:40.970614 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:40.971334 10320 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.905929 10687 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:40.978087 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:40.978823 10393 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:40.979067 10320 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:40.983781 10146 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:14:40.998205 10687 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.010613 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.011333 10324 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:41.012844 10440 tablet_bootstrap.cc:654] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.016058 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.016996 10324 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:41.021371 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:41.022650 10323 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:41.023639 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.024355 10320 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:41.027634 10393 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:41.029003 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:41.029892 10687 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.029975 10736 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.064826 10441 tablet_bootstrap.cc:492] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:41.065452 10441 ts_tablet_manager.cc:1403] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.154s	user 0.041s	sys 0.042s
I20260709 13:14:41.037961 10687 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:41.076838 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:41.078505 10213 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.078879 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:41.080291 10633 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.082007 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.083946 10728 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:14:41.130939 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 46254.8us
I20260709 13:14:41.148844 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:41.150060 10687 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.157846 10393 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.158399 10441 raft_consensus.cc:359] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.159128 10441 raft_consensus.cc:385] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.159422 10441 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
W20260709 13:14:41.159675 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 83043us
I20260709 13:14:41.077569 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.083408 10553 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.169824 10440 tablet_bootstrap.cc:492] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:41.172096 10440 ts_tablet_manager.cc:1403] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.283s	user 0.020s	sys 0.015s
I20260709 13:14:41.162722 10765 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:41.177017 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45110.6us
I20260709 13:14:41.177464 10439 tablet_bootstrap.cc:654] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.175504 10148 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.182312 10720 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:41.182771 10720 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.183121 10720 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.198441 10441 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.200309 10441 ts_tablet_manager.cc:1434] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.135s	user 0.010s	sys 0.001s
I20260709 13:14:41.201427 10441 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:41.175202 10765 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.206503 10765 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.175073 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:14:41.221639 10213 leader_election.cc:343] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.222146 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.226974 10736 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.227685 10736 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.229724 10736 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:41.230603 10585 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.242579 10763 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.241425 10746 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:14:41.258780 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 89343.4us
I20260709 13:14:41.260762 10736 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:41.268038 10440 raft_consensus.cc:359] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.268784 10440 raft_consensus.cc:385] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.269068 10440 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.269675 10440 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.274556 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:41.275257 10245 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:41.262898 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.291868 10720 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.294072 10720 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.305814 10651 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.305853 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:41.326999 10786 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:41.327416 10786 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.327746 10786 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:41.254650 10765 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.352372 10440 ts_tablet_manager.cc:1434] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.180s	user 0.007s	sys 0.010s
I20260709 13:14:41.353579 10440 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:41.342087 10633 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:41.363085 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 83274.6us
I20260709 13:14:41.368755 10439 tablet_bootstrap.cc:492] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:41.371806 10441 tablet_bootstrap.cc:654] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.374527 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:41.376375 10439 ts_tablet_manager.cc:1403] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.429s	user 0.011s	sys 0.014s
I20260709 13:14:41.385162 10318 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:41.428889 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:41.422689 10765 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.424497 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:41.444919 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:41.449607 10323 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.449813 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:41.448700 10722 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:14:41.455577 10244 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
W20260709 13:14:41.464264 10213 leader_election.cc:343] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:41.464967 10213 leader_election.cc:343] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.470676 10440 tablet_bootstrap.cc:654] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.464056 10439 raft_consensus.cc:359] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.473526 10439 raft_consensus.cc:385] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.473805 10439 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.476437 10786 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.488034 10318 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:41.488389 10397 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:14:41.489871 10786 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:41.491092 10439 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.491331 10323 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:41.493569 10439 ts_tablet_manager.cc:1434] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.117s	user 0.004s	sys 0.003s
I20260709 13:14:41.502672 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:41.504668 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:41.506421 10441 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:41.506917 10441 ts_tablet_manager.cc:1403] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.306s	user 0.018s	sys 0.022s
I20260709 13:14:41.508819 10765 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.510290 10722 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.510819 10441 raft_consensus.cc:359] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.511598 10441 raft_consensus.cc:385] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.511431 10722 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.511881 10441 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.510653 10145 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.515030 10441 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.518427 10765 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:41.519577 10765 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.519845 10746 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:41.521646 10746 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:41.522004 10746 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:41.524680 10439 tablet_bootstrap.cc:492] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:41.534449 10441 ts_tablet_manager.cc:1434] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:14:41.513180 10728 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.533126 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:41.558037 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:41.522817 10746 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.563040 10746 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:41.563555 10651 consensus_queue.cc:1175] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:14:41.551126 10728 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:41.569008 10722 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:41.577543 10751 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:41.584440 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:41.582613 10728 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.594564 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.586138 10241 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:41.600234 10440 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:41.600881 10440 ts_tablet_manager.cc:1403] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.027s
I20260709 13:14:41.595712 10321 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:41.637593 10145 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.649704 10441 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:41.653741 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:41.673023 10318 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:14:41.673705 10792 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:41.674146 10792 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.674512 10792 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.669310 10786 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 13:14:41.683214 10800 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:14:41.693318 10440 raft_consensus.cc:359] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.694084 10440 raft_consensus.cc:385] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.696184 10439 tablet_bootstrap.cc:654] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.694408 10440 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.707893 10440 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.710526 10441 tablet_bootstrap.cc:654] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.711869 10440 ts_tablet_manager.cc:1434] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.000s
W20260709 13:14:41.712587 10802 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:14:41.713070 10440 tablet_bootstrap.cc:492] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:41.715518 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.701365 10792 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.718004 10792 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:41.718573 10792 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:41.719378 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:41.720158 10440 tablet_bootstrap.cc:654] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.720103 10244 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.719611 10148 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:41.750624 10765 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.760645 10439 tablet_bootstrap.cc:492] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:41.761144 10439 ts_tablet_manager.cc:1403] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.237s	user 0.016s	sys 0.022s
I20260709 13:14:41.765334 10440 tablet_bootstrap.cc:492] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:41.765812 10440 ts_tablet_manager.cc:1403] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.027s
I20260709 13:14:41.759588 10728 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.762905 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:41.769922 10319 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.770042 10728 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.771490 10441 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:41.771979 10441 ts_tablet_manager.cc:1403] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.010s
I20260709 13:14:41.775578 10728 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.777709 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:41.759812 10765 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.778499 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.780200 10765 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:41.780568 10213 leader_election.cc:343] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.780853 10783 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:41.781381 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.786089 10244 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
W20260709 13:14:41.786417 10213 leader_election.cc:343] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.787388 10213 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.787388 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:14:41.789908 10213 leader_election.cc:343] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.789983 10780 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:41.791067 10780 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:41.790455 10723 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.791998 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:41.792507 10780 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:41.794688 10213 leader_election.cc:343] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.786128 10319 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:41.797766 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.798635 10728 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.800976 10440 raft_consensus.cc:359] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.801733 10440 raft_consensus.cc:385] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.802021 10440 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.805004 10439 raft_consensus.cc:359] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.805766 10439 raft_consensus.cc:385] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.806064 10439 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.808729 10439 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.808921 10441 raft_consensus.cc:359] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.809733 10440 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.812013 10440 ts_tablet_manager.cc:1434] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260709 13:14:41.813072 10440 tablet_bootstrap.cc:492] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:41.809785 10441 raft_consensus.cc:385] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.818638 10441 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.819787 10441 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.821820 10441 ts_tablet_manager.cc:1434] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 13:14:41.822881 10441 tablet_bootstrap.cc:492] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:41.827474 10439 ts_tablet_manager.cc:1434] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.001s
I20260709 13:14:41.829038 10439 tablet_bootstrap.cc:492] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:41.834832 10439 tablet_bootstrap.cc:654] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.836838 10441 tablet_bootstrap.cc:654] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.833977 10148 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.838531 10440 tablet_bootstrap.cc:654] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.843000 10441 tablet_bootstrap.cc:492] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:41.843456 10439 tablet_bootstrap.cc:492] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:41.843988 10439 ts_tablet_manager.cc:1403] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:14:41.843494 10441 ts_tablet_manager.cc:1403] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 13:14:41.847245 10439 raft_consensus.cc:359] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.847955 10439 raft_consensus.cc:385] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.848215 10439 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.848824 10439 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.852083 10439 ts_tablet_manager.cc:1434] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:41.853361 10439 tablet_bootstrap.cc:492] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:41.854506 10440 tablet_bootstrap.cc:492] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:41.855016 10440 ts_tablet_manager.cc:1403] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:14:41.856072 10783 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.856580 10783 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.858916 10783 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.861322 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:41.862859 10288 leader_election.cc:343] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.863410 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:41.866714 10242 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:41.867853 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:41.869691 10783 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:41.870059 10783 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.870440 10783 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.873224 10441 raft_consensus.cc:359] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.873974 10441 raft_consensus.cc:385] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.874287 10441 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.865410 10440 raft_consensus.cc:359] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.876461 10440 raft_consensus.cc:385] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.876749 10440 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.877406 10440 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.874933 10441 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.879719 10440 ts_tablet_manager.cc:1434] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:14:41.881465 10441 ts_tablet_manager.cc:1434] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:14:41.882637 10440 tablet_bootstrap.cc:492] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:41.882982 10439 tablet_bootstrap.cc:654] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.888528 10440 tablet_bootstrap.cc:654] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.891311 10497 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.892050 10441 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:41.891851 10497 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.894506 10497 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:41.896859 10439 tablet_bootstrap.cc:492] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:41.897325 10439 ts_tablet_manager.cc:1403] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.044s	user 0.002s	sys 0.009s
I20260709 13:14:41.898758 10441 tablet_bootstrap.cc:654] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.901712 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:41.902872 10242 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:41.900452 10439 raft_consensus.cc:359] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.905710 10439 raft_consensus.cc:385] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.906066 10439 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.909108 10439 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.912140 10439 ts_tablet_manager.cc:1434] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:14:41.912631 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.913498 10319 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:41.914194 10439 tablet_bootstrap.cc:492] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:41.914346 10441 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:41.914886 10441 ts_tablet_manager.cc:1403] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 13:14:41.918988 10362 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.920442 10497 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.922354 10439 tablet_bootstrap.cc:654] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.925928 10780 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.926468 10780 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.927251 10497 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.928748 10780 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:41.930712 10441 raft_consensus.cc:359] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.931403 10441 raft_consensus.cc:385] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.931665 10441 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.933220 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:41.936329 10441 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.939100 10440 tablet_bootstrap.cc:492] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:41.939608 10440 ts_tablet_manager.cc:1403] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.004s
I20260709 13:14:41.942545 10440 raft_consensus.cc:359] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.943307 10440 raft_consensus.cc:385] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.943588 10440 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.945173 10441 ts_tablet_manager.cc:1434] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:14:41.946491 10441 tablet_bootstrap.cc:492] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:41.952406 10441 tablet_bootstrap.cc:654] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.954516 10440 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.954985 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.956703 10440 ts_tablet_manager.cc:1434] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:14:41.957389 10321 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:41.957835 10440 tablet_bootstrap.cc:492] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:41.958626 10362 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:41.959722 10780 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.961024 10783 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.964785 10586 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.968451 10439 tablet_bootstrap.cc:492] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:41.969060 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:41.972914 10439 ts_tablet_manager.cc:1403] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.024s
I20260709 13:14:41.973067 10393 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.972761 10586 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.976459 10586 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.970597 10783 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:41.971913 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:41.987167 10241 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:41.977542 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:41.990268 10441 tablet_bootstrap.cc:492] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:41.990732 10441 ts_tablet_manager.cc:1403] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.000s
W20260709 13:14:41.993237 10213 leader_election.cc:343] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:41.993870 10441 raft_consensus.cc:359] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.994568 10441 raft_consensus.cc:385] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.980878 10393 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:41.995071 10441 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.983445 10440 tablet_bootstrap.cc:654] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.995779 10441 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.997076 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:41.997949 10441 ts_tablet_manager.cc:1434] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:41.984107 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:41.977716 10439 raft_consensus.cc:359] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:41.999013 10439 raft_consensus.cc:385] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:41.999081 10321 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:41.999325 10439 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:41.970796 10780 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:41.998492 10687 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.000010 10439 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.000367 10687 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:42.000968 10786 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.001230 10687 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.001461 10786 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.002094 10439 ts_tablet_manager.cc:1434] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 13:14:42.003101 10439 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:42.003562 10786 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.005807 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.007124 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:42.008569 10364 leader_election.cc:343] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.008819 10439 tablet_bootstrap.cc:654] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:41.994534 10241 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:42.010397 10782 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.010819 10782 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.011198 10782 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.015669 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.016326 10441 tablet_bootstrap.cc:492] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.016395 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:42.017194 10440 tablet_bootstrap.cc:492] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:42.017691 10440 ts_tablet_manager.cc:1403] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:14:42.020506 10440 raft_consensus.cc:359] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.021174 10440 raft_consensus.cc:385] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.021479 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:42.021451 10440 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.023293 10786 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.023660 10786 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.024058 10786 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.024814 10441 tablet_bootstrap.cc:654] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.029932 10782 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.030891 10586 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.032219 10782 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.033680 10439 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.034171 10439 ts_tablet_manager.cc:1403] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.031s	user 0.003s	sys 0.009s
I20260709 13:14:42.035701 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:42.036347 10393 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.023664 10440 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.039263 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.039672 10439 raft_consensus.cc:359] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.040592 10439 raft_consensus.cc:385] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.041031 10439 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.041687 10439 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.048200 10441 tablet_bootstrap.cc:492] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.039887 10321 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.048769 10441 ts_tablet_manager.cc:1403] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:14:42.053347 10786 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.055344 10553 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.055637 10786 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.055907 10553 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.057449 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:14:42.058988 10364 leader_election.cc:343] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.061353 10553 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.061755 10439 ts_tablet_manager.cc:1434] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:14:42.061560 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.062848 10439 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
W20260709 13:14:42.063300 10288 leader_election.cc:343] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.064708 10393 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:42.065739 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:42.067675 10586 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.068178 10586 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:42.066447 10145 catalog_manager.cc:5697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.068143 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.069016 10586 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.070524 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.071074 10319 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.073654 10441 raft_consensus.cc:359] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.074510 10441 raft_consensus.cc:385] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.074808 10441 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.075522 10441 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.077762 10441 ts_tablet_manager.cc:1434] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.000s
I20260709 13:14:42.081828 10440 ts_tablet_manager.cc:1434] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:14:42.083010 10440 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:42.085024 10439 tablet_bootstrap.cc:654] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:42.085158 10290 leader_election.cc:343] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.085611 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:42.086344 10553 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.087872 10441 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.086342 10321 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:42.096422 10146 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.100477 10687 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.101044 10687 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.102149 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:42.106313 10782 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.111766 10687 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.112100 10441 tablet_bootstrap.cc:654] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.116720 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:42.118335 10288 leader_election.cc:343] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.119338 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:42.120458 10497 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.120942 10497 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:42.121692 10497 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.123541 10440 tablet_bootstrap.cc:654] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.133939 10440 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:42.134439 10440 ts_tablet_manager.cc:1403] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.007s
I20260709 13:14:42.135833 10439 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.137437 10439 ts_tablet_manager.cc:1403] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.000s
I20260709 13:14:42.139098 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.139732 10241 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:42.141093 10441 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.140641 10439 raft_consensus.cc:359] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.141580 10441 ts_tablet_manager.cc:1403] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.000s
I20260709 13:14:42.137107 10440 raft_consensus.cc:359] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.141649 10439 raft_consensus.cc:385] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.142035 10440 raft_consensus.cc:385] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.142378 10440 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.142151 10439 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.143326 10439 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.144111 10441 raft_consensus.cc:359] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.143924 10145 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.144780 10441 raft_consensus.cc:385] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.145112 10441 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.145785 10439 ts_tablet_manager.cc:1434] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:42.146929 10439 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:42.146500 10441 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.146819 10440 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.148815 10441 ts_tablet_manager.cc:1434] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:42.149808 10441 tablet_bootstrap.cc:492] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.153891 10439 tablet_bootstrap.cc:654] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.160714 10440 ts_tablet_manager.cc:1434] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:14:42.161887 10440 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:42.166162 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.169224 10553 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.172693 10553 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.167220 10782 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:42.173063 10553 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.177470 10441 tablet_bootstrap.cc:654] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.180754 10782 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.182513 10782 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.185313 10782 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.187436 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:42.189347 10213 leader_election.cc:343] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.195099 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.198520 10318 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:42.199751 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.200590 10782 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.201011 10782 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.201336 10782 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.211154 10440 tablet_bootstrap.cc:654] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.220669 10553 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.223011 10782 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.225162 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:42.225667 10393 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.226711 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:14:42.227247 10288 leader_election.cc:343] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.228086 10553 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:42.228209 10213 leader_election.cc:343] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.225183 10782 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.231101 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.231904 10318 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.231122 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:42.233057 10241 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.233958 10439 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.234442 10439 ts_tablet_manager.cc:1403] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.088s	user 0.030s	sys 0.012s
I20260709 13:14:42.242733 10241 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:42.245069 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.245445 10586 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.251760 10586 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.253907 10687 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.254842 10687 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:42.255528 10586 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.255661 10687 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.259796 10720 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.262195 10439 raft_consensus.cc:359] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.263029 10439 raft_consensus.cc:385] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.263376 10439 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.264604 10439 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.271725 10439 ts_tablet_manager.cc:1434] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260709 13:14:42.272650 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.271065 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.281121 10736 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.279297 10439 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
W20260709 13:14:42.281147 10213 leader_election.cc:343] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:42.285506 10213 leader_election.cc:343] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.286054 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:42.288195 10782 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.322510 10441 tablet_bootstrap.cc:492] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.322947 10441 ts_tablet_manager.cc:1403] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.026s
I20260709 13:14:42.330983 10441 raft_consensus.cc:359] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.335255 10441 raft_consensus.cc:385] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.334901 10440 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:42.335633 10439 tablet_bootstrap.cc:654] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.335892 10440 ts_tablet_manager.cc:1403] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.174s	user 0.025s	sys 0.038s
I20260709 13:14:42.336421 10441 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.340181 10440 raft_consensus.cc:359] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.340906 10440 raft_consensus.cc:385] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.341166 10440 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.343231 10148 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.344550 10441 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.366127 10440 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.368528 10441 ts_tablet_manager.cc:1434] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 13:14:42.369922 10441 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.372149 10318 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
W20260709 13:14:42.373471 10834 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:14:42.374585 10792 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.379309 10441 tablet_bootstrap.cc:654] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.381899 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.382670 10765 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.383148 10765 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:42.383955 10765 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.390343 10440 ts_tablet_manager.cc:1434] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:14:42.391482 10440 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:42.396988 10441 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.406725 10441 ts_tablet_manager.cc:1403] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.015s
I20260709 13:14:42.407090 10439 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.407538 10439 ts_tablet_manager.cc:1403] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.004s
I20260709 13:14:42.411214 10441 raft_consensus.cc:359] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.414568 10441 raft_consensus.cc:385] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.414865 10441 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.415614 10441 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.419066 10441 ts_tablet_manager.cc:1434] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:42.420248 10441 tablet_bootstrap.cc:492] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.426571 10146 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.438251 10439 raft_consensus.cc:359] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.444458 10440 tablet_bootstrap.cc:654] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.444696 10439 raft_consensus.cc:385] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.445159 10439 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.446007 10439 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.453200 10439 ts_tablet_manager.cc:1434] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:14:42.454348 10439 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:42.458663 10687 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.459187 10687 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.462602 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.463320 10736 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.463837 10736 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:42.464214 10288 leader_election.cc:343] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.466723 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.467020 10441 tablet_bootstrap.cc:654] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.467427 10244 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:42.468974 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.473493 10242 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:42.472790 10687 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.472762 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.470404 10439 tablet_bootstrap.cc:654] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.472790 10440 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:42.473905 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:14:42.475993 10362 leader_election.cc:343] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.476632 10792 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.476994 10792 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.477463 10792 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.477998 10440 ts_tablet_manager.cc:1403] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.005s
I20260709 13:14:42.480947 10440 raft_consensus.cc:359] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.481721 10440 raft_consensus.cc:385] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.482033 10440 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.482370 10736 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.482846 10440 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.483964 10290 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.487190 10687 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.487814 10687 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.488512 10687 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.498324 10440 ts_tablet_manager.cc:1434] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
W20260709 13:14:42.503765 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:42.504823 10720 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.505427 10440 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:42.505537 10720 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.509850 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.510512 10319 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:42.511907 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.512584 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:42.513823 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:42.509804 10720 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.517927 10720 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.518342 10720 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.518061 10782 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.518678 10720 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.525527 10440 tablet_bootstrap.cc:654] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.526476 10792 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.529675 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:42.530521 10242 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.544587 10782 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.545390 10782 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.549197 10782 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.552218 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.553017 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.553686 10318 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:42.555121 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:42.556401 10586 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.556896 10586 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.557340 10586 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.558617 10765 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.559923 10765 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.561411 10765 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.565644 10553 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.568797 10720 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.578914 10651 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:42.567770 10765 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.581758 10441 tablet_bootstrap.cc:492] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.596145 10441 ts_tablet_manager.cc:1403] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.176s	user 0.021s	sys 0.011s
W20260709 13:14:42.603216 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46915.8us
I20260709 13:14:42.605777 10720 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:42.605921 10213 leader_election.cc:343] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.610031 10553 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.610611 10553 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.612658 10553 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.614205 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.614925 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:42.615455 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.615593 10398 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:42.617417 10288 leader_election.cc:343] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.629542 10441 raft_consensus.cc:359] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.634537 10441 raft_consensus.cc:385] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.635072 10441 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.635946 10441 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:42.638712 10213 leader_election.cc:343] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.639063 10441 ts_tablet_manager.cc:1434] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:14:42.640385 10441 tablet_bootstrap.cc:492] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.646732 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.646857 10687 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.649533 10792 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.651713 10441 tablet_bootstrap.cc:654] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:42.653714 10364 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.655793 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.666767 10242 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:42.668633 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:42.669860 10780 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.670631 10780 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:42.671943 10780 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.681206 10398 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:42.682757 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:42.683977 10720 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.684618 10720 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:42.685161 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.685715 10720 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:42.691393 10290 leader_election.cc:343] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.691884 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:42.586063 10586 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:42.693408 10213 leader_election.cc:343] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.694031 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:42.694713 10586 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.695294 10651 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.697340 10844 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.698452 10687 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.700352 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:42.685787 10319 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:42.701769 10288 leader_election.cc:343] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.704501 10439 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.705013 10439 ts_tablet_manager.cc:1403] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.251s	user 0.048s	sys 0.085s
I20260709 13:14:42.707774 10439 raft_consensus.cc:359] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.708477 10439 raft_consensus.cc:385] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.708745 10439 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.709358 10439 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.710516 10440 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:42.713430 10440 ts_tablet_manager.cc:1403] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.000s
I20260709 13:14:42.713838 10439 ts_tablet_manager.cc:1434] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:14:42.714545 10288 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.714967 10439 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:42.717039 10319 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:42.711319 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:14:42.721772 10213 leader_election.cc:343] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.721897 10439 tablet_bootstrap.cc:654] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.721982 10441 tablet_bootstrap.cc:492] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.722676 10441 ts_tablet_manager.cc:1403] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.083s	user 0.025s	sys 0.022s
I20260709 13:14:42.725189 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.725325 10441 raft_consensus.cc:359] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.726084 10441 raft_consensus.cc:385] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.726442 10441 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.727695 10440 raft_consensus.cc:359] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.728365 10440 raft_consensus.cc:385] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.728614 10440 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.729269 10440 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.731675 10440 ts_tablet_manager.cc:1434] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:14:42.732782 10440 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:42.734444 10439 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.737303 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.737596 10439 ts_tablet_manager.cc:1403] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:14:42.737926 10319 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:42.739511 10362 leader_election.cc:343] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.742579 10780 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.746116 10319 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:42.736418 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:42.749225 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.750087 10244 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.751930 10439 raft_consensus.cc:359] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.752708 10439 raft_consensus.cc:385] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.753001 10439 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.753674 10439 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.734563 10441 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.754217 10146 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:42.756635 10439 ts_tablet_manager.cc:1434] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:14:42.757804 10439 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:42.757929 10441 ts_tablet_manager.cc:1434] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:14:42.758996 10441 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.761272 10145 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:42.765538 10425 tablet.cc:2406] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:42.776015 10244 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:42.777277 10290 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:42.778012 10687 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.778545 10687 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:42.779017 10586 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.779649 10586 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:42.779389 10687 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.786582 10441 tablet_bootstrap.cc:654] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.787542 10440 tablet_bootstrap.cc:654] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.782487 10439 tablet_bootstrap.cc:654] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.797580 10651 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.802570 10586 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.804416 10439 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.806315 10439 ts_tablet_manager.cc:1403] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.004s
I20260709 13:14:42.807674 10441 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.808142 10441 ts_tablet_manager.cc:1403] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.001s
I20260709 13:14:42.808192 10736 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.808718 10736 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.808943 10439 raft_consensus.cc:359] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.809605 10439 raft_consensus.cc:385] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.809876 10439 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.812727 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.810649 10441 raft_consensus.cc:359] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.813437 10319 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:42.813678 10441 raft_consensus.cc:385] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.814038 10441 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.814612 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.814764 10441 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.815068 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:42.815989 10853 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:42.816090 10364 leader_election.cc:343] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.816399 10853 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.816499 10441 ts_tablet_manager.cc:1434] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:42.816828 10853 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.819177 10439 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.819825 10736 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.821506 10440 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:42.821978 10440 ts_tablet_manager.cc:1403] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.004s
I20260709 13:14:42.823622 10439 ts_tablet_manager.cc:1434] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:42.825553 10439 tablet_bootstrap.cc:492] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
I20260709 13:14:42.828033 10441 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.832063 10439 tablet_bootstrap.cc:654] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.838852 10736 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.839491 10736 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.842391 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.842836 10736 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:14:42.844022 10364 leader_election.cc:343] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.845885 10441 tablet_bootstrap.cc:654] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.848263 10720 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:42.851902 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.858469 10439 tablet_bootstrap.cc:492] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.858981 10439 ts_tablet_manager.cc:1403] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.006s
I20260709 13:14:42.858942 10145 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.862110 10439 raft_consensus.cc:359] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.863269 10439 raft_consensus.cc:385] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.863530 10439 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.864187 10439 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.865628 10439 ts_tablet_manager.cc:1434] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:14:42.866592 10439 tablet_bootstrap.cc:492] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Bootstrap starting.
W20260709 13:14:42.872341 10362 leader_election.cc:343] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.872890 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:42.873919 10780 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:42.878500 10439 tablet_bootstrap.cc:654] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.854532 10440 raft_consensus.cc:359] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.880497 10440 raft_consensus.cc:385] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.880784 10440 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.890043 10736 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.890409 10439 tablet_bootstrap.cc:492] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: No bootstrap required, opened a new log
I20260709 13:14:42.890923 10439 ts_tablet_manager.cc:1403] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 13:14:42.890628 10736 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.891650 10853 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.892638 10441 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.892964 10736 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.893154 10441 ts_tablet_manager.cc:1403] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.000s
I20260709 13:14:42.898756 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.899515 10324 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:42.901588 10441 raft_consensus.cc:359] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.902441 10441 raft_consensus.cc:385] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.902791 10441 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.903982 10441 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.908982 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.909663 10319 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:42.910377 10213 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:42.911763 10441 ts_tablet_manager.cc:1434] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:14:42.911621 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:42.912901 10780 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.913285 10780 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.913674 10780 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.917201 10441 tablet_bootstrap.cc:492] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:42.893682 10439 raft_consensus.cc:359] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.921064 10439 raft_consensus.cc:385] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.921433 10439 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.893743 10853 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.895723 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:42.923000 10241 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:42.922782 10439 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.895889 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:42.919440 10148 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:42.924527 10439 ts_tablet_manager.cc:1434] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
W20260709 13:14:42.927482 10364 leader_election.cc:343] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:42.894459 10440 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.933738 10440 ts_tablet_manager.cc:1434] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.000s
I20260709 13:14:42.937947 10782 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.938525 10782 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.940613 10440 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:42.948734 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:42.949486 10398 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:42.952795 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:42.953892 10765 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:42.954298 10765 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.954625 10765 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.955349 10780 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.956271 10440 tablet_bootstrap.cc:654] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.947243 10319 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:42.956935 10441 tablet_bootstrap.cc:654] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:42.957916 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:42.958698 10318 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:42.962113 10780 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:42.961694 10765 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.963718 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:42.949453 10782 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.965492 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:42.966528 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.986063 10318 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.987396 10765 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:42.988726 10780 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:42.989327 10780 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:42.986063 10244 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.990686 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:42.991039 10441 tablet_bootstrap.cc:492] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:42.991310 10398 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.991496 10441 ts_tablet_manager.cc:1403] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.007s
I20260709 13:14:42.993714 10318 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:42.995579 10441 raft_consensus.cc:359] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.996269 10441 raft_consensus.cc:385] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:42.996577 10441 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:42.996922 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:42.997501 10319 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:42.997190 10441 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:42.999289 10780 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.003019 10441 ts_tablet_manager.cc:1434] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:14:43.004081 10441 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:43.003895 10244 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:14:43.005141 10319 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:43.006328 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:43.008615 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:43.003892 10398 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:43.009681 10440 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:43.009840 10736 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:43.010303 10843 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:43.010381 10736 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:14:43.010857 10843 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:43.011811 10441 tablet_bootstrap.cc:654] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.011435 10736 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.011720 10843 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.010476 10440 ts_tablet_manager.cc:1403] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.014s
I20260709 13:14:43.014607 10844 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:14:43.015318 10844 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.020613 10651 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.021136 10651 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.023303 10651 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.023819 10441 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:43.023711 10844 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.024444 10441 ts_tablet_manager.cc:1403] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:14:43.019979 10440 raft_consensus.cc:359] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.025699 10440 raft_consensus.cc:385] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.025988 10440 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:43.026451 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.026903 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.027133 10241 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 0.
I20260709 13:14:43.027252 10441 raft_consensus.cc:359] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.027932 10441 raft_consensus.cc:385] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.028203 10441 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
W20260709 13:14:43.028230 10288 leader_election.cc:343] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:43.028952 10441 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.030037 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.030720 10319 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:14:43.031687 10440 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.033604 10441 ts_tablet_manager.cc:1434] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:43.034749 10441 tablet_bootstrap.cc:492] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:43.033604 10440 ts_tablet_manager.cc:1434] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:14:43.035282 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.036113 10392 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:43.036369 10440 tablet_bootstrap.cc:492] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:43.037812 10148 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.040428 10441 tablet_bootstrap.cc:654] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.045120 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:43.046312 10651 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:43.046448 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:43.046717 10651 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.047159 10441 tablet_bootstrap.cc:492] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:43.047640 10441 ts_tablet_manager.cc:1403] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 13:14:43.047632 10843 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:43.049018 10843 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:14:43.049501 10843 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:43.047112 10651 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.051604 10441 raft_consensus.cc:359] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.052323 10441 raft_consensus.cc:385] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.052610 10441 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:43.053432 10441 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.055887 10441 ts_tablet_manager.cc:1434] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:43.057157 10441 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:43.060704 10440 tablet_bootstrap.cc:654] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.058204 10651 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.063030 10441 tablet_bootstrap.cc:654] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.058349 10843 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.064114 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:14:43.065853 10288 leader_election.cc:343] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:43.066195 10843 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.067512 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:43.068318 10398 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:43.068917 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:14:43.069518 10244 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.073413 10440 tablet_bootstrap.cc:492] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:43.073333 10651 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.074090 10440 ts_tablet_manager.cc:1403] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.001s
I20260709 13:14:43.075393 10853 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.075876 10853 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.077309 10241 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.077980 10853 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:43.080031 10440 raft_consensus.cc:359] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.080442 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.080829 10440 raft_consensus.cc:385] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.081111 10440 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:43.081259 10249 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:43.081874 10440 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.084024 10440 ts_tablet_manager.cc:1434] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:43.085049 10440 tablet_bootstrap.cc:492] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:43.086200 10441 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:43.086746 10441 ts_tablet_manager.cc:1403] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:14:43.087337 10148 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:43.089326 10441 raft_consensus.cc:359] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.089989 10441 raft_consensus.cc:385] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.090446 10441 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:43.090835 10440 tablet_bootstrap.cc:654] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.091090 10441 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.092864 10441 ts_tablet_manager.cc:1434] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:14:43.093829 10441 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: Bootstrap starting.
I20260709 13:14:43.099395 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:43.100216 10441 tablet_bootstrap.cc:654] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.108505 10318 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:14:43.110841 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:43.111886 10843 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:43.112396 10843 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:43.113232 10843 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.119205 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.122788 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:43.124229 10853 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.129094 10780 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.129668 10780 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.130896 10651 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.131083 10792 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.131532 10792 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.133006 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.133435 10780 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:43.133978 10792 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:43.131510 10651 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.136257 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.137095 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.134968 10244 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:43.143353 10651 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.144640 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.145033 10853 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:43.147001 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.147786 10249 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:14:43.151072 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:43.151831 10853 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:43.154691 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:43.155531 10853 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:43.157408 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:14:43.158140 10651 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:43.158740 10651 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:14:43.159713 10651 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.163774 10853 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.168131 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.190963 10844 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.191556 10844 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.197052 10844 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.197912 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.198753 10393 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:43.200910 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:43.205072 10782 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:43.205642 10780 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.205873 10782 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.206632 10782 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.206511 10780 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.209637 10780 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:43.210753 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:43.211052 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53734.4us
W20260709 13:14:43.212284 10364 leader_election.cc:343] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:43.211928 10875 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:14:43.219477 10398 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.240767 10290 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:43.249691 10651 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.254406 10651 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.232760 10146 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.262871 10843 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.267272 10148 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:43.268539 10651 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:43.271391 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59720.3us
I20260709 13:14:43.283797 10651 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.284932 10765 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.285534 10765 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.285072 10651 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.287678 10497 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.288183 10497 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.293061 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.293817 10324 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 0.
I20260709 13:14:43.296579 10497 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:43.298898 10651 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.299013 10687 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.302985 10440 tablet_bootstrap.cc:492] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:43.303990 10440 ts_tablet_manager.cc:1403] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.219s	user 0.019s	sys 0.050s
I20260709 13:14:43.302985 10687 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.321094 10687 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.328764 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.329629 10397 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:14:43.330396 10765 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.332301 10440 raft_consensus.cc:359] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.333161 10440 raft_consensus.cc:385] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:43.333504 10440 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:43.334286 10440 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.343719 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.344422 10399 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:43.361306 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:43.396545 10782 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:14:43.766319 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 405076us
I20260709 13:14:43.777330 10146 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:43.785173 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:43.805953 10889 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.808313 10889 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.813426 10889 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.927860 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.928534 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.928833 10889 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.929221 10390 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:43.934834 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:43.936095 10887 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:43.936499 10887 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.936901 10887 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.943150 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:43.943341 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.943863 10316 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.943982 10320 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:43.944999 10887 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.948386 10887 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.952458 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.954555 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:43.955624 10245 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:43.961956 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.951522 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:43.968700 10321 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:43.971844 10894 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:43.972759 10890 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.973367 10440 ts_tablet_manager.cc:1434] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.669s	user 0.006s	sys 0.004s
W20260709 13:14:43.973675 10440 ts_tablet_manager.cc:1467] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet startup took 669ms
I20260709 13:14:43.962720 10320 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 0.
I20260709 13:14:43.969762 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:43.974385 10399 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:43.485783 10586 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:43.977788 10586 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.978149 10586 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:43.974001 10440 ts_tablet_manager.cc:1469] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Trace:
0709 13:14:35.094037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:35.094171 (+   134us) service_pool.cc:224] Handling call
0709 13:14:35.096046 (+  1875us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:14:35.096134 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:14:35.337456 (+241322us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:35.451182 (+113726us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:35.471069 (+ 19887us) inbound_call.cc:177] Queueing success response
0709 13:14:43.084652 (+7613583us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:14:43.304311 (+219659us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:14:43.330418 (+ 26107us) tablet_replica.cc:261] Starting instrumentation
0709 13:14:43.330993 (+   575us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":1597,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":61459,"tablet-open.queue_time_us":7629376}
I20260709 13:14:43.979432 10440 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Bootstrap starting.
I20260709 13:14:43.982259 10399 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:43.985394 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:43.984408 10316 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:43.986399 10319 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:14:43.986946 10586 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:43.988215 10244 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:43.965512 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:43.990259 10780 raft_consensus.cc:2764] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:14:43.990559 10782 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.992352 10586 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:43.993726 10780 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:43.997239 10440 tablet_bootstrap.cc:654] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:43.998375 10394 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:44.000737 10213 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:44.001348 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:44.002633 10586 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:44.002686 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:44.003325 10393 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.003342 10885 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:44.007062 10765 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:44.009410 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:44.010474 10890 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:44.011000 10890 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:44.011904 10890 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.014106 10586 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:44.015291 10586 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.016007 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:14:44.016685 10317 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.010996 10393 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:14:44.020918 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:14:44.021661 10393 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.032550 10440 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: No bootstrap required, opened a new log
I20260709 13:14:44.033064 10440 ts_tablet_manager.cc:1403] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent bootstrapping tablet: real 0.054s	user 0.002s	sys 0.006s
I20260709 13:14:44.033187 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:43.340950 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:14:44.034065 10398 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 1: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:14:44.036178 10440 raft_consensus.cc:359] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.058053 10440 raft_consensus.cc:385] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.042050 10780 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:14:44.058707 10440 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.035216 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:44.059540 10318 raft_consensus.cc:2376] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1. Re-sending same reply.
I20260709 13:14:44.059593 10440 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.061618 10440 ts_tablet_manager.cc:1434] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent starting tablet: real 0.028s	user 0.019s	sys 0.004s
W20260709 13:14:44.062637 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 721734us
I20260709 13:14:44.063047 10393 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:14:44.064544 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:14:44.065598 10885 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:44.066308 10885 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:14:44.067495 10885 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.068854 10396 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:44.071187 10720 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:44.055620 10892 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.078255 10892 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.080730 10892 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:14:44.096808 10880 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.372s	user 0.002s	sys 0.002s
I20260709 13:14:44.103535 10441 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: No bootstrap required, opened a new log
I20260709 13:14:44.104236 10441 ts_tablet_manager.cc:1403] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: Time spent bootstrapping tablet: real 1.011s	user 0.060s	sys 0.102s
I20260709 13:14:44.031486 10317 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:14:44.114090 10651 raft_consensus.cc:2764] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:14:44.136632 10441 raft_consensus.cc:359] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.140179 10441 raft_consensus.cc:385] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:44.140622 10441 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Initialized, Role: FOLLOWER
I20260709 13:14:44.141408 10441 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.143152 10441 ts_tablet_manager.cc:1434] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:14:44.152683 10243 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.148967 10888 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:14:44.164757 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:14:44.165829 10893 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:44.184623 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:44.194958 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:44.196424 10246 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 1: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:14:44.254647 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.258365 10720 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:14:44.272331 10892 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.319378 10780 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:44.328004 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 48160.9us
I20260709 13:14:44.335511 10364 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.344162 10780 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.384459 10883 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:14:44.385229 10883 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.387720 10883 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:44.396018 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:14:44.399405 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47578.3us
I20260709 13:14:44.364996 10918 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 13:14:44.410168 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45963.6us
I20260709 13:14:44.431738 10919 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.431583 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:14:44.432258 10919 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.434469 10736 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:14:44.441223 10736 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.451294 10393 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:44.483019 10910 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:14:44.428970 10920 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.089s
W20260709 13:14:44.493563 10924 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:44.469666 10780 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:44.499632 10736 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:14:44.511659 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 67376.8us
W20260709 13:14:44.513562 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 82407.3us
I20260709 13:14:44.515803 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:44.519430 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:44.527463 10885 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.528064 10885 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.530077 10213 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.535235 10885 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:44.536357 10883 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:44.549185 10925 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:14:44.560554 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:14:44.591480 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 74585.6us
I20260709 13:14:44.594561 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.595647 10497 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.600262 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:44.603957 10317 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:44.612695 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.614367 10889 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.620630 10919 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:14:44.621399 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 100190us
I20260709 13:14:44.632995 10885 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:14:44.684103 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50378.5us
W20260709 13:14:44.717924 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 85464.4us
W20260709 13:14:44.750804 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800035c20 after lost signal to thread 9150
W20260709 13:14:44.751916 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800064e20 after lost signal to thread 10182
W20260709 13:14:44.753027 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002a23e0 after lost signal to thread 10274
I20260709 13:14:44.754592 10928 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:14:44.757803 10928 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:14:44.760171 10928 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:44.761059 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:14:44.770896 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:14:44.774871 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080026bd00 after lost signal to thread 10349
W20260709 13:14:44.775986 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002df960 after lost signal to thread 10423
W20260709 13:14:44.776405 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfae0 after lost signal to thread 10553
W20260709 13:14:44.776960 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002df7c0 after lost signal to thread 10783
W20260709 13:14:44.777298 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfd20 after lost signal to thread 10818
W20260709 13:14:44.777648 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002dfdc0 after lost signal to thread 10834
W20260709 13:14:44.779438 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0340 after lost signal to thread 10856
W20260709 13:14:44.779799 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4000 after lost signal to thread 10860
W20260709 13:14:44.780054 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800252580 after lost signal to thread 10862
W20260709 13:14:44.780375 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800232d60 after lost signal to thread 10868
W20260709 13:14:44.780695 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800232c40 after lost signal to thread 10872
W20260709 13:14:44.780977 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800232ca0 after lost signal to thread 10873
I20260709 13:14:44.789702 10146 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.796972 10146 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:44.799312 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64616.6us
I20260709 13:14:44.799953 10146 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 0 to 2, leader changed from <none> to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:44.816623 10651 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:44.821705 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:14:44.824193 10317 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:14:44.847582 10196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:44.875777 10884 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:44.881299 10396 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:44.911654 10889 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:14:44.927966 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:14:44.941370 10935 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:14:44.975713 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.989293 10362 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:14:44.987543 10586 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:44.987558 10780 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:44.992823 10853 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:14:45.073858 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 74310.6us
I20260709 13:14:45.076248 10952 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:45.109311 10950 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:46.002440  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:46.011032 10956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:46.012557 10957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:46.015487 10959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:46.019122  9147 server_base.cc:1061] running on GCE node
I20260709 13:14:46.020624  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:46.020910  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:46.021147  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783602886021127 us; error 0 us; skew 500 ppm
I20260709 13:14:46.021919  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:46.025876  9147 webserver.cc:533] Webserver started at http://127.8.238.196:45387/ using document root <none> and password file <none>
I20260709 13:14:46.026666  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:46.026957  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:46.027367  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:46.029153  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-3-root/instance:
uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
format_stamp: "Formatted at 2026-07-09 13:14:46 on dist-test-slave-ml7r"
I20260709 13:14:46.036711  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:14:46.042847 10964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:46.044847  9147 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:14:46.045377  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-3-root
uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
format_stamp: "Formatted at 2026-07-09 13:14:46 on dist-test-slave-ml7r"
I20260709 13:14:46.045887  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:46.094974  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:46.097010  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:46.099246  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:46.103577  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:46.103905  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:46.104188  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:46.104387  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:46.243728  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.196:35437
I20260709 13:14:46.243781 11027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.196:35437 every 8 connection(s)
I20260709 13:14:46.256446  9147 auto_leader_rebalancer-test.cc:384] add a tserver: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:46.280745 11028 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38317
I20260709 13:14:46.281257 11028 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:46.282222 11028 heartbeater.cc:507] Master 127.8.238.254:38317 requested a full tablet report, sending...
I20260709 13:14:46.286170 10147 ts_manager.cc:194] Registered new tserver with Master: 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:14:46.288120 10147 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36216
I20260709 13:14:47.003481 10246 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.018682 10392 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.020391 10950 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.020794 10323 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.023355 10950 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:47.075325 10950 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.085078 10392 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.094926 10321 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.109632 10147 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:14:47.137436 10213 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6d7bac4863c4b958392d525cba4f98b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.194759 10323 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.209445 10394 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.214386 10246 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.215818 10931 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.217700 10931 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:47.228786 10288 consensus_peers.cc:597] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f4dd97a92804cc6927c6fff64d16f39. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.236585 10932 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.240097 10242 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.266100 10145 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.270124 10242 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.277565 10394 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.291906 11028 heartbeater.cc:499] Master 127.8.238.254:38317 was elected leader, sending a full tablet report...
I20260709 13:14:47.309508 10394 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:47.310129 10213 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1667c24c31044f708dc4fcc524ea924d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.310936 10323 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.311138 11039 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.313735 11039 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.327039 11039 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.329792 10394 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.333757 10318 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.350569 10242 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.351199 10148 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:47.372906 10213 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a07acf0009094d989235d04de13c6c2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:47.373271 10394 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.375025 10318 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:47.375516 11039 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.379273 11007 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:47.387530 11040 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.396135 10395 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.413833 10145 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.449587 10321 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:47.533488 11057 ts_tablet_manager.cc:933] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:47.551868 11057 tablet_copy_client.cc:323] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:14:47.580622 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet a6d7bac4863c4b958392d525cba4f98b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:14:47.581187 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet a6d7bac4863c4b958392d525cba4f98b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-a6d7bac4863c4b958392d525cba4f98b
I20260709 13:14:47.588258 10260 tablet_copy_source_session.cc:215] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:47.593138 11057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d7bac4863c4b958392d525cba4f98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:47.613548 11057 tablet_copy_client.cc:806] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:47.614252 11057 tablet_copy_client.cc:670] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:47.625110 11057 tablet_copy_client.cc:538] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:47.641990 11057 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:47.694056 11062 ts_tablet_manager.cc:933] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:47.705258 11062 tablet_copy_client.cc:323] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:14:47.755844 11057 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.757117 11057 tablet_bootstrap.cc:492] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:47.759182 11066 ts_tablet_manager.cc:933] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:47.766846 11057 ts_tablet_manager.cc:1403] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.004s
I20260709 13:14:47.767727 10335 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 1f4dd97a92804cc6927c6fff64d16f39 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:14:47.768332 10335 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 1f4dd97a92804cc6927c6fff64d16f39 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-1f4dd97a92804cc6927c6fff64d16f39
I20260709 13:14:47.774000 11066 tablet_copy_client.cc:323] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:14:47.775571 10335 tablet_copy_source_session.cc:215] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:47.776921 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 1667c24c31044f708dc4fcc524ea924d from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:14:47.777498 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 1667c24c31044f708dc4fcc524ea924d from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-1667c24c31044f708dc4fcc524ea924d
I20260709 13:14:47.779623 11062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4dd97a92804cc6927c6fff64d16f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:47.787113 10260 tablet_copy_source_session.cc:215] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:47.790452 11066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1667c24c31044f708dc4fcc524ea924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:47.808012 11066 tablet_copy_client.cc:806] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:47.808599 11066 tablet_copy_client.cc:670] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:47.812532 11066 tablet_copy_client.cc:538] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:47.770478 11057 raft_consensus.cc:359] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.820705 11057 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:47.823679 11066 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:47.821453 11057 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.827188 11062 tablet_copy_client.cc:806] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:47.827884 11062 tablet_copy_client.cc:670] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:47.831976 11062 tablet_copy_client.cc:538] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:47.857951 11057 ts_tablet_manager.cc:1434] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.091s	user 0.020s	sys 0.000s
I20260709 13:14:47.851856 11062 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:47.869915 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-a6d7bac4863c4b958392d525cba4f98b received from {username='slave'} at 127.0.0.1:54378
I20260709 13:14:47.870515 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-a6d7bac4863c4b958392d525cba4f98b on tablet a6d7bac4863c4b958392d525cba4f98b with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:47.884704 11066 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.885720 11066 tablet_bootstrap.cc:492] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:47.886451 11066 ts_tablet_manager.cc:1403] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.063s	user 0.032s	sys 0.012s
I20260709 13:14:47.891047 11066 raft_consensus.cc:359] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.892267 11066 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:47.893525 11066 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.896551 11066 ts_tablet_manager.cc:1434] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:14:47.899286 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-1667c24c31044f708dc4fcc524ea924d received from {username='slave'} at 127.0.0.1:54378
I20260709 13:14:47.899765 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-1667c24c31044f708dc4fcc524ea924d on tablet 1667c24c31044f708dc4fcc524ea924d with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:47.916935 11062 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:47.917928 11062 tablet_bootstrap.cc:492] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:47.918728 11062 ts_tablet_manager.cc:1403] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.009s
I20260709 13:14:47.921715 11062 raft_consensus.cc:359] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.922611 11062 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:47.926746 11002 raft_consensus.cc:1217] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:47.923552 11062 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:47.934532 11062 ts_tablet_manager.cc:1434] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:14:47.936283 10335 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-1f4dd97a92804cc6927c6fff64d16f39 received from {username='slave'} at 127.0.0.1:52922
I20260709 13:14:47.936723 10335 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-1f4dd97a92804cc6927c6fff64d16f39 on tablet 1f4dd97a92804cc6927c6fff64d16f39 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:47.955802 11062 ts_tablet_manager.cc:933] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:47.963315 11062 tablet_copy_client.cc:323] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:14:47.964936 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet a07acf0009094d989235d04de13c6c2e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:14:47.965525 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet a07acf0009094d989235d04de13c6c2e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-a07acf0009094d989235d04de13c6c2e
I20260709 13:14:47.975241 10260 tablet_copy_source_session.cc:215] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:47.978518 11062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07acf0009094d989235d04de13c6c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:47.995532 11062 tablet_copy_client.cc:806] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:47.996181 11062 tablet_copy_client.cc:670] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:47.999433 11062 tablet_copy_client.cc:538] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:48.010092 11062 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:48.043627 11062 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:48.044608 11062 tablet_bootstrap.cc:492] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:48.045327 11062 ts_tablet_manager.cc:1403] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.004s
I20260709 13:14:48.048569 11062 raft_consensus.cc:359] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:48.049489 11062 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:48.050194 11062 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:48.053095 11062 ts_tablet_manager.cc:1434] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:14:48.057042 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-a07acf0009094d989235d04de13c6c2e received from {username='slave'} at 127.0.0.1:54378
I20260709 13:14:48.057500 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-a07acf0009094d989235d04de13c6c2e on tablet a07acf0009094d989235d04de13c6c2e with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:48.146477 11002 raft_consensus.cc:1217] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:48.242164 11002 raft_consensus.cc:1217] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:48.415931 11002 raft_consensus.cc:1217] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:48.423784 10586 raft_consensus.cc:1064] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:48.426489 10586 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:48.433704 11002 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.435343 10392 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.438532 10318 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.439057 10586 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.442287 10950 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.448891 10950 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.475600 11040 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.486637 10318 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.496572 11002 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.495862 10392 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.513466 10148 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.554936 10250 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:48.562646 11002 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:48.565330 10586 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:48.570989 10392 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:48.574690 11077 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:48.581557 11040 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.590415 11002 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.593030 10392 raft_consensus.cc:2955] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.607050 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6d7bac4863c4b958392d525cba4f98b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:48.622473 10145 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.643370 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet a6d7bac4863c4b958392d525cba4f98b with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:14:48.660178 11082 tablet_replica.cc:333] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:14:48.661221 11082 raft_consensus.cc:2243] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.661866 11082 raft_consensus.cc:2272] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.665421 11082 ts_tablet_manager.cc:1916] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:48.676862 11040 raft_consensus.cc:1064] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:48.679565 11040 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:48.696993 11002 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.697942 10392 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.699293 11077 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.703183 10586 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.712110 10323 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.715999 10586 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.732551 11082 ts_tablet_manager.cc:1929] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:48.733362 11082 log.cc:1199] T a6d7bac4863c4b958392d525cba4f98b P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/a6d7bac4863c4b958392d525cba4f98b
I20260709 13:14:48.735471 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet a6d7bac4863c4b958392d525cba4f98b (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:48.745211 11040 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.754727 10323 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.757534 10392 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.763285 11002 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.770924 10147 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.817039 10250 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:48.822742 11002 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:48.822861 10321 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:48.824476 11077 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:48.828740 11040 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:48.838567 10950 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.846823 10321 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.865618 10147 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.871349 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1667c24c31044f708dc4fcc524ea924d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:48.880973 11050 raft_consensus.cc:1064] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:48.884697 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 1667c24c31044f708dc4fcc524ea924d with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:14:48.883682 11050 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:48.912199 11088 tablet_replica.cc:333] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:14:48.914167 11088 raft_consensus.cc:2243] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:48.914992 11088 raft_consensus.cc:2272] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:48.936676 11001 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.939209 11089 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.942945 10394 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.945701 10931 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:48.956910 10246 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:48.968950 11089 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:48.973599 11088 ts_tablet_manager.cc:1916] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:48.987923 11001 raft_consensus.cc:2955] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.998971 11094 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:48.999923 10394 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.024232 11039 raft_consensus.cc:1064] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:49.042385 11088 ts_tablet_manager.cc:1929] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:49.042913 11088 log.cc:1199] T 1667c24c31044f708dc4fcc524ea924d P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/1667c24c31044f708dc4fcc524ea924d
I20260709 13:14:49.044605 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 1667c24c31044f708dc4fcc524ea924d (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:49.027083 11039 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:49.063189 10147 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.066944 10242 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.074301 11001 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.077963 11002 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:49.082537 11039 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:49.087033 10323 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:49.090945 11040 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:49.097667 10392 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:49.108314 11077 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:49.131708 10321 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:49.153338 11039 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.161803 11002 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:49.162039 10394 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:49.164848 11050 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:49.169081 11050 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:14:49.173840 10931 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.177099 11002 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.182943 10392 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.186209 11001 raft_consensus.cc:2955] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.194995 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f4dd97a92804cc6927c6fff64d16f39 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:49.195782 10318 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.193913 10148 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.218551 10148 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.231413 10392 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.247418 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f4dd97a92804cc6927c6fff64d16f39 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:14:49.269622 10242 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:49.279258 11001 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:49.280619 10586 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:49.282147 10392 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:49.284174 11101 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:49.296855 10586 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.299015 11102 tablet_replica.cc:333] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:14:49.300114 11102 raft_consensus.cc:2243] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:49.302409 11001 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.316000 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a07acf0009094d989235d04de13c6c2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:49.304666 10394 raft_consensus.cc:2955] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:49.329980 11102 raft_consensus.cc:2272] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.333736 11102 ts_tablet_manager.cc:1916] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:49.337666 10147 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:49.370344 11102 ts_tablet_manager.cc:1929] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:49.370950 11102 log.cc:1199] T 1f4dd97a92804cc6927c6fff64d16f39 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/1f4dd97a92804cc6927c6fff64d16f39
I20260709 13:14:49.372946 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 1f4dd97a92804cc6927c6fff64d16f39 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:49.373754 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet a07acf0009094d989235d04de13c6c2e with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:14:49.382154 11103 tablet_replica.cc:333] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:14:49.383392 11103 raft_consensus.cc:2243] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:49.384286 11103 raft_consensus.cc:2272] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:49.389127 11103 ts_tablet_manager.cc:1916] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:49.406177 11103 ts_tablet_manager.cc:1929] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:49.406739 11103 log.cc:1199] T a07acf0009094d989235d04de13c6c2e P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/a07acf0009094d989235d04de13c6c2e
I20260709 13:14:49.408264 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet a07acf0009094d989235d04de13c6c2e (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
W20260709 13:14:50.525929 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53693.4us
I20260709 13:14:50.609634 10321 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:14:50.630509 10288 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16f38b8c79f844dc83f9505884422f2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.631107 10394 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.633695 10246 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.636855 10931 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:50.642225 11108 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:50.667694 10931 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.669040 10394 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.675557 10246 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.693159 10145 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.749372 10394 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:50.763613 10321 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.766574 11111 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:50.770046 10246 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.773648 11110 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:50.795783 10362 consensus_peers.cc:597] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07947046eb9e42ae8ccb9083210f95f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.808820 11109 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.814545 10321 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.816303 10242 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.852757 10148 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.845598 10325 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:14:50.873826 10288 consensus_peers.cc:597] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 976ea23dd44047a6adc91ad78f34fa79. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.877419 10392 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.879185 10242 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.880810 11108 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.886709 11108 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:50.892887 11050 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.897359 10392 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.898039 10242 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.916277 10145 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:50.918231 10325 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:14:50.992429 10288 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 002cc8ee6e9043929d5cd5532317aab7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:50.993535 10394 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:50.995493 10931 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:51.003319 10246 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:51.005225 10931 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:51.019208 10931 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:51.021759 10392 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:51.028481 10246 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:51.051261 10148 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:51.119155 11133 ts_tablet_manager.cc:933] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:51.293594 11133 tablet_copy_client.cc:323] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:14:51.300071 11139 ts_tablet_manager.cc:933] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:14:51.333353 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87944.9us
I20260709 13:14:51.339435 10335 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 16f38b8c79f844dc83f9505884422f2a from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:14:51.344341 10335 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 16f38b8c79f844dc83f9505884422f2a from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-16f38b8c79f844dc83f9505884422f2a
I20260709 13:14:51.373132 10335 tablet_copy_source_session.cc:215] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:51.381654 11139 tablet_copy_client.cc:323] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:14:51.394198 11148 ts_tablet_manager.cc:933] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:51.408818 11133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f38b8c79f844dc83f9505884422f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:51.426432 11148 tablet_copy_client.cc:323] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:14:51.428085 11133 tablet_copy_client.cc:806] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:51.428781 11133 tablet_copy_client.cc:670] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:51.436636 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 976ea23dd44047a6adc91ad78f34fa79 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:14:51.437306 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 976ea23dd44047a6adc91ad78f34fa79 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-976ea23dd44047a6adc91ad78f34fa79
I20260709 13:14:51.437626 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 07947046eb9e42ae8ccb9083210f95f0 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:14:51.438287 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 07947046eb9e42ae8ccb9083210f95f0 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-07947046eb9e42ae8ccb9083210f95f0
I20260709 13:14:51.449790 11133 tablet_copy_client.cc:538] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:51.451216 10409 tablet_copy_source_session.cc:215] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:51.454726 11139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07947046eb9e42ae8ccb9083210f95f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:51.460549 11133 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:51.469604 10334 tablet_copy_source_session.cc:215] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:51.472836 11148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976ea23dd44047a6adc91ad78f34fa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:51.541689 11139 tablet_copy_client.cc:806] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:51.545475 11152 ts_tablet_manager.cc:933] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:14:51.545297 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58689us
I20260709 13:14:51.559335 11148 tablet_copy_client.cc:806] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:51.560120 11148 tablet_copy_client.cc:670] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:51.556000 11139 tablet_copy_client.cc:670] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:51.594883 11152 tablet_copy_client.cc:323] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:14:51.595111 11148 tablet_copy_client.cc:538] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:51.610332 11139 tablet_copy_client.cc:538] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:51.620214 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 002cc8ee6e9043929d5cd5532317aab7 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:14:51.620837 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 002cc8ee6e9043929d5cd5532317aab7 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-002cc8ee6e9043929d5cd5532317aab7
I20260709 13:14:51.621111 11148 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:51.625012 11133 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.626818 11133 tablet_bootstrap.cc:492] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:51.627614 11133 ts_tablet_manager.cc:1403] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.015s
I20260709 13:14:51.630975 11133 raft_consensus.cc:359] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.631924 11133 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:51.632710 11133 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.652992 10334 tablet_copy_source_session.cc:215] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:51.653255 11133 ts_tablet_manager.cc:1434] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.009s
I20260709 13:14:51.655547 10335 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-16f38b8c79f844dc83f9505884422f2a received from {username='slave'} at 127.0.0.1:52922
I20260709 13:14:51.656065 10335 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-16f38b8c79f844dc83f9505884422f2a on tablet 16f38b8c79f844dc83f9505884422f2a with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:51.664520 11139 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:51.679504 11152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002cc8ee6e9043929d5cd5532317aab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:51.705777 11152 tablet_copy_client.cc:806] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:51.714929 11152 tablet_copy_client.cc:670] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:51.714087 11148 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.716558 11148 tablet_bootstrap.cc:492] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:51.717604 11148 ts_tablet_manager.cc:1403] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.097s	user 0.048s	sys 0.024s
I20260709 13:14:51.723137 11148 raft_consensus.cc:359] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.723179 11152 tablet_copy_client.cc:538] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:51.724092 11148 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:51.726289 11148 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.728755 11148 ts_tablet_manager.cc:1434] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:14:51.731886 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-976ea23dd44047a6adc91ad78f34fa79 received from {username='slave'} at 127.0.0.1:52922
I20260709 13:14:51.732324 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-976ea23dd44047a6adc91ad78f34fa79 on tablet 976ea23dd44047a6adc91ad78f34fa79 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:51.743821 11152 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:51.745376 11139 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.748317 11139 tablet_bootstrap.cc:492] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:51.749154 11139 ts_tablet_manager.cc:1403] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.009s
I20260709 13:14:51.752223 11139 raft_consensus.cc:359] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.753225 11139 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:51.754081 11139 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.760579 11139 ts_tablet_manager.cc:1434] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:14:51.762470 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-07947046eb9e42ae8ccb9083210f95f0 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:14:51.762935 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-07947046eb9e42ae8ccb9083210f95f0 on tablet 07947046eb9e42ae8ccb9083210f95f0 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:51.789881 11152 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.790911 11152 tablet_bootstrap.cc:492] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:51.791671 11152 ts_tablet_manager.cc:1403] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.013s
I20260709 13:14:51.794658 11152 raft_consensus.cc:359] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.795573 11152 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:51.796258 11152 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:51.798928 11152 ts_tablet_manager.cc:1434] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:51.801877 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-002cc8ee6e9043929d5cd5532317aab7 received from {username='slave'} at 127.0.0.1:52922
I20260709 13:14:51.802348 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-002cc8ee6e9043929d5cd5532317aab7 on tablet 002cc8ee6e9043929d5cd5532317aab7 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:51.916476 11001 raft_consensus.cc:1217] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:51.952908 11001 raft_consensus.cc:1217] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:51.964455 11001 raft_consensus.cc:1217] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:52.010469 11001 raft_consensus.cc:1217] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:52.339000 11050 raft_consensus.cc:1064] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:52.341673 11050 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:52.364363 11144 raft_consensus.cc:1064] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:52.384495 11001 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.384685 10392 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.387274 10246 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.387662 10931 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.389562 10931 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.395097 11050 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.372378 11144 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:52.431663 10931 raft_consensus.cc:1064] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:52.433934 10931 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:52.470383 11138 raft_consensus.cc:1064] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:52.499475 11138 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:52.534325 11001 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.536790 11162 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:52.557363 10392 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.559350 10242 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.562458 10931 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.564670 11163 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.586987 11050 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.615083 11002 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.630625 11174 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.640964 10392 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.683693 10242 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.689437 10931 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.639580 11001 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:14:52.664992 11165 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:14:52.670322 11000 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.673951 10394 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.678431 10396 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.696693 10246 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.710901 10931 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:52.715230 11162 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.754447 11174 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.769960 10396 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.788472 10145 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:14:52.795629 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 141418us
I20260709 13:14:52.882179 10250 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.870749 10243 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.926123 11000 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.931907 10147 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:52.965893 10250 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:52.967748 11169 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:14:52.984439 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 88521.5us
I20260709 13:14:52.995791 10325 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:53.035501 11002 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:53.050871 10147 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:14:53.058897 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 72221.2us
I20260709 13:14:53.075234 10318 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:53.076829 10325 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:53.088685 10243 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.089083 11001 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.090732 11163 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.091159 11000 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.091159 10243 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.093312 11163 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.094357 11162 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.099238 11162 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.105269 11162 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.112653 10246 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.124267 11144 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.126708 11000 raft_consensus.cc:2955] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.128871 11002 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.141734 10145 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.143769 10146 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.144965 10246 raft_consensus.cc:2955] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.148216 11183 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:53.156749 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16f38b8c79f844dc83f9505884422f2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:53.156869 11183 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:53.187009 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 002cc8ee6e9043929d5cd5532317aab7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:53.223686 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 16f38b8c79f844dc83f9505884422f2a with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:14:53.224095 10387 tablet_service.cc:1558] Processing DeleteTablet for tablet 002cc8ee6e9043929d5cd5532317aab7 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:14:53.234328 10319 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:53.243952 11200 tablet_replica.cc:333] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:14:53.245188 11002 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.245425 11200 raft_consensus.cc:2243] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:53.246263 11200 raft_consensus.cc:2272] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:53.247314 10931 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.247855 10395 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.249917 10931 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:53.251644 11200 ts_tablet_manager.cc:1916] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:53.258067 11175 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.268951 11002 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.274652 10395 raft_consensus.cc:2955] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.293910 10145 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.295344 11200 ts_tablet_manager.cc:1929] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:53.295864 11200 log.cc:1199] T 16f38b8c79f844dc83f9505884422f2a P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/16f38b8c79f844dc83f9505884422f2a
I20260709 13:14:53.297545 11200 tablet_replica.cc:333] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:14:53.298714 11200 raft_consensus.cc:2243] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:53.305205 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 976ea23dd44047a6adc91ad78f34fa79 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:14:53.311038 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 976ea23dd44047a6adc91ad78f34fa79 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:53.316910 11200 raft_consensus.cc:2272] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:53.314177 11184 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.324548 11201 tablet_replica.cc:333] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:14:53.348073 11201 raft_consensus.cc:2243] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:53.337877 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 16f38b8c79f844dc83f9505884422f2a (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:53.354528 11200 ts_tablet_manager.cc:1916] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:53.353786 11002 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.355718 11201 raft_consensus.cc:2272] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:53.360774 10318 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.375236 11201 ts_tablet_manager.cc:1916] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:53.405977 10146 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.422361 11200 ts_tablet_manager.cc:1929] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:53.422857 11200 log.cc:1199] T 002cc8ee6e9043929d5cd5532317aab7 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/002cc8ee6e9043929d5cd5532317aab7
I20260709 13:14:53.424472 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 002cc8ee6e9043929d5cd5532317aab7 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:53.425515 10246 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.471935 11201 ts_tablet_manager.cc:1929] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:53.473204 11201 log.cc:1199] T 976ea23dd44047a6adc91ad78f34fa79 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/976ea23dd44047a6adc91ad78f34fa79
I20260709 13:14:53.475324 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 976ea23dd44047a6adc91ad78f34fa79 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:53.486004 10395 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:53.494410 11002 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.496168 11183 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.504443 11185 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.516361 11002 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.535430 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07947046eb9e42ae8ccb9083210f95f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:53.536330 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54114.4us
I20260709 13:14:53.546381 10319 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:53.548836 11184 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:53.559144 10317 raft_consensus.cc:2955] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.558494 10146 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:53.582973 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 07947046eb9e42ae8ccb9083210f95f0 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:14:53.584501 11201 tablet_replica.cc:333] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:14:53.585721 11201 raft_consensus.cc:2243] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:53.586513 11201 raft_consensus.cc:2272] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:53.590476 11201 ts_tablet_manager.cc:1916] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:53.614583 11201 ts_tablet_manager.cc:1929] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:53.615068 11201 log.cc:1199] T 07947046eb9e42ae8ccb9083210f95f0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/07947046eb9e42ae8ccb9083210f95f0
I20260709 13:14:53.616822 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 07947046eb9e42ae8ccb9083210f95f0 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:54.663053 10250 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:54.670682 10317 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:54.673336 10213 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebb1d9c88bdd4df9942232a578267aa6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:54.673772 11195 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.674535 10395 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:54.683738 11195 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.698643 11195 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.706060 10317 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.705796 10395 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.730599 10148 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.748934 10395 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:14:54.764247 10362 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d97c1a2214d54cff9377d68a3d00054b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:54.765291 10250 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:54.766845 10317 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:54.767654 11184 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.769444 11184 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.806789 11203 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.829025 10250 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.842715 10319 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.887096 10250 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:54.908492 10148 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.952633 10394 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:54.954454 11220 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:54.955353 10319 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:54.969218 10213 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6fa99a4824140528f1f002c969d567c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:54.970057 11147 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:54.990360 11147 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:54.992435 10319 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:55.001119 10392 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:55.015259 10146 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:55.024315 10319 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.048213 10392 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:55.052057 10288 consensus_peers.cc:597] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9187284d595443aab84a71601d6fe9ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:55.052719 10250 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:55.053238 11222 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:55.054382 11175 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:55.070216 11144 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:55.079631 10392 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:55.102365 10246 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:55.103961 10148 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:55.119395 11228 ts_tablet_manager.cc:933] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:55.132726 11228 tablet_copy_client.cc:323] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:14:55.134943 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet ebb1d9c88bdd4df9942232a578267aa6 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:14:55.135521 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet ebb1d9c88bdd4df9942232a578267aa6 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-ebb1d9c88bdd4df9942232a578267aa6
I20260709 13:14:55.154304 10260 tablet_copy_source_session.cc:215] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:55.165556 11228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1d9c88bdd4df9942232a578267aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:55.184309 11228 tablet_copy_client.cc:806] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:55.185097 11228 tablet_copy_client.cc:670] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:55.189860 11230 ts_tablet_manager.cc:933] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:55.191231 11228 tablet_copy_client.cc:538] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:55.201840 11228 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:55.213882 11230 tablet_copy_client.cc:323] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:14:55.215782 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet d97c1a2214d54cff9377d68a3d00054b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:14:55.216375 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet d97c1a2214d54cff9377d68a3d00054b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-d97c1a2214d54cff9377d68a3d00054b
I20260709 13:14:55.239060 11228 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:55.240332 11228 tablet_bootstrap.cc:492] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:55.241178 11228 ts_tablet_manager.cc:1403] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.014s
I20260709 13:14:55.244635 11228 raft_consensus.cc:359] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.245668 11228 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:55.248107 10409 tablet_copy_source_session.cc:215] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:55.260404 11230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c1a2214d54cff9377d68a3d00054b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:55.257462 11228 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.274840 11228 ts_tablet_manager.cc:1434] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:14:55.278338 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-ebb1d9c88bdd4df9942232a578267aa6 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:14:55.278839 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-ebb1d9c88bdd4df9942232a578267aa6 on tablet ebb1d9c88bdd4df9942232a578267aa6 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:55.292598 11230 tablet_copy_client.cc:806] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:55.293853 11230 tablet_copy_client.cc:670] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:55.297976 11230 tablet_copy_client.cc:538] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:55.311297 11230 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:55.346127 11230 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:55.347187 11230 tablet_bootstrap.cc:492] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:55.349155 11230 ts_tablet_manager.cc:1403] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.005s
I20260709 13:14:55.356722 11230 raft_consensus.cc:359] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.359135 11230 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:55.359896 11230 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.362967 11230 ts_tablet_manager.cc:1434] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:14:55.370503 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-d97c1a2214d54cff9377d68a3d00054b received from {username='slave'} at 127.0.0.1:38154
I20260709 13:14:55.371017 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-d97c1a2214d54cff9377d68a3d00054b on tablet d97c1a2214d54cff9377d68a3d00054b with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:55.481194 11230 ts_tablet_manager.cc:933] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:55.499684 11230 tablet_copy_client.cc:323] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:14:55.501435 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet e6fa99a4824140528f1f002c969d567c from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:14:55.502080 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet e6fa99a4824140528f1f002c969d567c from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-e6fa99a4824140528f1f002c969d567c
I20260709 13:14:55.509732 10260 tablet_copy_source_session.cc:215] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:55.513711 11230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fa99a4824140528f1f002c969d567c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:55.547643 11230 tablet_copy_client.cc:806] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:55.549144 11230 tablet_copy_client.cc:670] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:55.549643 11002 raft_consensus.cc:1217] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:55.561118 11230 tablet_copy_client.cc:538] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:55.571293 11002 raft_consensus.cc:1217] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:55.591094 11230 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:55.626056 11230 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:55.627045 11230 tablet_bootstrap.cc:492] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:55.627705 11230 ts_tablet_manager.cc:1403] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.009s
I20260709 13:14:55.630719 11230 raft_consensus.cc:359] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.631757 11230 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:55.632517 11230 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.641269 11230 ts_tablet_manager.cc:1434] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:55.642998 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-e6fa99a4824140528f1f002c969d567c received from {username='slave'} at 127.0.0.1:54378
I20260709 13:14:55.643603 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-e6fa99a4824140528f1f002c969d567c on tablet e6fa99a4824140528f1f002c969d567c with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:55.643730 11228 ts_tablet_manager.cc:933] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:55.663329 11228 tablet_copy_client.cc:323] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:14:55.665236 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 9187284d595443aab84a71601d6fe9ea from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:14:55.665823 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 9187284d595443aab84a71601d6fe9ea from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-9187284d595443aab84a71601d6fe9ea
I20260709 13:14:55.673625 10334 tablet_copy_source_session.cc:215] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:55.677198 11228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187284d595443aab84a71601d6fe9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:55.698129 11228 tablet_copy_client.cc:806] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:55.698848 11228 tablet_copy_client.cc:670] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:55.706719 11228 tablet_copy_client.cc:538] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:55.717410 11228 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:55.749503 11228 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:55.750672 11228 tablet_bootstrap.cc:492] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:55.751539 11228 ts_tablet_manager.cc:1403] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.034s	user 0.028s	sys 0.004s
I20260709 13:14:55.755290 11228 raft_consensus.cc:359] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.756659 11228 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:55.757484 11228 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:55.768301 11228 ts_tablet_manager.cc:1434] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:14:55.772904 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-9187284d595443aab84a71601d6fe9ea received from {username='slave'} at 127.0.0.1:52922
I20260709 13:14:55.773393 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-9187284d595443aab84a71601d6fe9ea on tablet 9187284d595443aab84a71601d6fe9ea with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:55.978096 11002 raft_consensus.cc:1217] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:55.988497 11220 raft_consensus.cc:1064] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:55.991775 11220 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.009137 11002 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.012673 11221 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.014743 10325 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.021061 11220 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.024819 10395 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.029487 11221 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.043212 11213 raft_consensus.cc:1064] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:56.047955 11213 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.068776 11220 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.077589 11002 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.077677 10318 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.081126 10394 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.081804 11184 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:56.086568 11184 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:56.088593 10318 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.164901 10148 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.175169 11249 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.191565 10318 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:14:56.197971 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 116912us
I20260709 13:14:56.200258 10241 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.227625 11002 raft_consensus.cc:1217] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:56.236917 11246 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.263550 11002 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.276340 10246 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.270141 11000 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.296981 10147 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.300261 11001 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.311120 11254 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:56.321318 10395 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.329785 11239 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:56.343233 11147 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.344739 11001 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.343591 10243 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.354979 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ebb1d9c88bdd4df9942232a578267aa6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:56.380479 10147 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.385296 11221 raft_consensus.cc:1064] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:56.387894 11221 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.397101 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet ebb1d9c88bdd4df9942232a578267aa6 with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:14:56.399902 11258 tablet_replica.cc:333] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:14:56.401723 11258 raft_consensus.cc:2243] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.402509 11258 raft_consensus.cc:2272] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.404696 10395 raft_consensus.cc:2955] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.405756 11001 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.417500 10325 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.426164 11147 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:56.432996 11239 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.436682 10392 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.439288 11254 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:56.460700 11258 ts_tablet_manager.cc:1916] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:56.487298 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49111.8us
I20260709 13:14:56.503935 11258 ts_tablet_manager.cc:1929] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:56.504518 11258 log.cc:1199] T ebb1d9c88bdd4df9942232a578267aa6 P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/ebb1d9c88bdd4df9942232a578267aa6
I20260709 13:14:56.506333 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet ebb1d9c88bdd4df9942232a578267aa6 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:56.532099 11259 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.542918 10318 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.562170 10147 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:56.563870 10392 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.563433 11001 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.597478 10241 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.619414 11001 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.621701 10325 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.623318 11220 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:56.636169 11220 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:56.643149 11147 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.654634 11001 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.670501 10318 raft_consensus.cc:2955] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.674080 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6fa99a4824140528f1f002c969d567c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:56.681757 11252 raft_consensus.cc:1064] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:56.684396 11252 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.688899 10147 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:56.709995 11001 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.712589 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet e6fa99a4824140528f1f002c969d567c with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:14:56.714213 10392 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.716425 11222 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:56.718621 11222 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.727440 10241 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:56.729606 11144 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:14:56.775801 10392 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.797847 11222 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.804013 10396 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.822202 10243 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.822319 11000 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.823904 11213 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:56.824784 11246 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:56.829101 10241 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.836764 11246 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.843393 11001 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.847853 10243 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.854547 10147 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.854945 11000 raft_consensus.cc:2955] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.874336 11264 tablet_replica.cc:333] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:14:56.883350 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d97c1a2214d54cff9377d68a3d00054b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:56.891011 11264 raft_consensus.cc:2243] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.897953 11264 raft_consensus.cc:2272] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.900249 10318 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:56.914975 10146 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:56.928057 10396 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.938891 11000 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:56.939353 11264 ts_tablet_manager.cc:1916] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:56.943396 11268 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:14:56.949357 11252 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:56.961438 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet d97c1a2214d54cff9377d68a3d00054b with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:14:56.962478 11258 tablet_replica.cc:333] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:14:56.963522 11258 raft_consensus.cc:2243] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.964200 11258 raft_consensus.cc:2272] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.963685 11252 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.968389 11258 ts_tablet_manager.cc:1916] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:56.965577 11000 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:56.988317 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9187284d595443aab84a71601d6fe9ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:57.005084 10396 raft_consensus.cc:2955] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:57.012238 10146 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:57.021003 11264 ts_tablet_manager.cc:1929] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:57.021629 11264 log.cc:1199] T e6fa99a4824140528f1f002c969d567c P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/e6fa99a4824140528f1f002c969d567c
I20260709 13:14:57.026192 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 9187284d595443aab84a71601d6fe9ea with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:14:57.030089 11258 ts_tablet_manager.cc:1929] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:57.030839 11258 log.cc:1199] T d97c1a2214d54cff9377d68a3d00054b P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/d97c1a2214d54cff9377d68a3d00054b
I20260709 13:14:57.032922 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet d97c1a2214d54cff9377d68a3d00054b (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:57.040805 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet e6fa99a4824140528f1f002c969d567c (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:57.066871 11271 tablet_replica.cc:333] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:14:57.081278 11271 raft_consensus.cc:2243] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.082094 11271 raft_consensus.cc:2272] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.085695 11271 ts_tablet_manager.cc:1916] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:57.102173 11271 ts_tablet_manager.cc:1929] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:57.102620 11271 log.cc:1199] T 9187284d595443aab84a71601d6fe9ea P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/9187284d595443aab84a71601d6fe9ea
I20260709 13:14:57.104377 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 9187284d595443aab84a71601d6fe9ea (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:14:58.093732 10396 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.100263 10325 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:58.100504 10362 consensus_peers.cc:597] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb19b1ef417a439c833c0b7627cf7c00. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.100263 10244 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.101843 11246 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.102777 11213 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.110437 11213 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.112859 10325 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.114916 10244 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.126545 10241 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:14:58.134534 10213 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58bcaf2ee2cb4badb447e0a27855aaf6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.133977 10147 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.137281 10396 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.138712 11254 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.144771 10325 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.147230 11254 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.171154 11147 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.184566 10318 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.185371 10396 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.217511 10392 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:14:58.242849 10362 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5235584cc4374dbcbe419cad1b3b9226. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.243392 10318 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.243135 10148 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.249879 11270 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:58.251080 10244 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.253099 11270 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.260663 11270 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.262439 10318 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.304155 10318 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.310688 10244 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.316888 10148 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:58.344017 10288 consensus_peers.cc:597] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69ce991d35f4413e82e03d5416c73bf2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:58.347018 10244 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.347395 10392 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:58.350118 11272 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.351066 11268 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:58.363026 11268 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.364676 10244 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.366649 10396 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.381476 10147 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:14:58.599690 11292 ts_tablet_manager.cc:933] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:58.601778 11292 tablet_copy_client.cc:323] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:14:58.603544 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet bb19b1ef417a439c833c0b7627cf7c00 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:14:58.604048 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet bb19b1ef417a439c833c0b7627cf7c00 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-bb19b1ef417a439c833c0b7627cf7c00
I20260709 13:14:58.610942 10409 tablet_copy_source_session.cc:215] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:58.614094 11292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb19b1ef417a439c833c0b7627cf7c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:58.631309 11292 tablet_copy_client.cc:806] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:58.632002 11292 tablet_copy_client.cc:670] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:58.635692 11292 tablet_copy_client.cc:538] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:58.645071 11292 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:58.666469 11292 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:58.667445 11292 tablet_bootstrap.cc:492] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:58.668155 11292 ts_tablet_manager.cc:1403] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.010s
I20260709 13:14:58.671098 11292 raft_consensus.cc:359] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.672003 11292 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:58.672703 11292 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.678411 11292 ts_tablet_manager.cc:1434] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:14:58.680398 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-bb19b1ef417a439c833c0b7627cf7c00 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:14:58.680843 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-bb19b1ef417a439c833c0b7627cf7c00 on tablet bb19b1ef417a439c833c0b7627cf7c00 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:58.708814 11292 ts_tablet_manager.cc:933] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:14:58.712592 11292 tablet_copy_client.cc:323] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:14:58.714515 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 58bcaf2ee2cb4badb447e0a27855aaf6 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:14:58.715667 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 58bcaf2ee2cb4badb447e0a27855aaf6 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-58bcaf2ee2cb4badb447e0a27855aaf6
I20260709 13:14:58.724391 10260 tablet_copy_source_session.cc:215] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:58.727888 11292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58bcaf2ee2cb4badb447e0a27855aaf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:58.744693 11292 tablet_copy_client.cc:806] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:58.745296 11292 tablet_copy_client.cc:670] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:58.745910 11297 ts_tablet_manager.cc:933] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:14:58.748755 11297 tablet_copy_client.cc:323] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:14:58.750420 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 5235584cc4374dbcbe419cad1b3b9226 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:14:58.750957 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 5235584cc4374dbcbe419cad1b3b9226 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-5235584cc4374dbcbe419cad1b3b9226
I20260709 13:14:58.756093 11292 tablet_copy_client.cc:538] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:58.759116 10409 tablet_copy_source_session.cc:215] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:58.767980 11297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235584cc4374dbcbe419cad1b3b9226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:58.777123 11292 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:58.782871 11297 tablet_copy_client.cc:806] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:58.783617 11297 tablet_copy_client.cc:670] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:58.791787 11297 tablet_copy_client.cc:538] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:58.806512 11297 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:58.809711 11292 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:58.810729 11292 tablet_bootstrap.cc:492] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:58.811415 11292 ts_tablet_manager.cc:1403] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.022s
I20260709 13:14:58.821633 11292 raft_consensus.cc:359] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.822942 11292 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:58.823953 11292 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.832226 11292 ts_tablet_manager.cc:1434] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:14:58.839152 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-58bcaf2ee2cb4badb447e0a27855aaf6 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:14:58.839833 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-58bcaf2ee2cb4badb447e0a27855aaf6 on tablet 58bcaf2ee2cb4badb447e0a27855aaf6 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:58.866652 11292 ts_tablet_manager.cc:933] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:14:58.876005 11297 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:58.876961 11297 tablet_bootstrap.cc:492] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:58.877624 11297 ts_tablet_manager.cc:1403] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.071s	user 0.032s	sys 0.031s
I20260709 13:14:58.881096 11297 raft_consensus.cc:359] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.881958 11297 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:58.882668 11297 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:58.886155 11297 ts_tablet_manager.cc:1434] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:14:58.887941 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-5235584cc4374dbcbe419cad1b3b9226 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:14:58.888396 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-5235584cc4374dbcbe419cad1b3b9226 on tablet 5235584cc4374dbcbe419cad1b3b9226 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:58.884341 11292 tablet_copy_client.cc:323] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:14:58.897712 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 69ce991d35f4413e82e03d5416c73bf2 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:14:58.898319 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 69ce991d35f4413e82e03d5416c73bf2 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-69ce991d35f4413e82e03d5416c73bf2
I20260709 13:14:58.906425 10334 tablet_copy_source_session.cc:215] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:58.909986 11292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ce991d35f4413e82e03d5416c73bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:58.924456 11292 tablet_copy_client.cc:806] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:58.925014 11292 tablet_copy_client.cc:670] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:58.930927 11292 tablet_copy_client.cc:538] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:58.939399 11292 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:14:59.039728 11292 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:59.040611 11292 tablet_bootstrap.cc:492] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:14:59.041726 11292 ts_tablet_manager.cc:1403] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.103s	user 0.029s	sys 0.054s
I20260709 13:14:59.044348 11292 raft_consensus.cc:359] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:59.045135 11292 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:14:59.045740 11292 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:14:59.048281 11292 ts_tablet_manager.cc:1434] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.003s
I20260709 13:14:59.049973 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-69ce991d35f4413e82e03d5416c73bf2 received from {username='slave'} at 127.0.0.1:52922
I20260709 13:14:59.050426 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-69ce991d35f4413e82e03d5416c73bf2 on tablet 69ce991d35f4413e82e03d5416c73bf2 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:14:59.152459 11001 raft_consensus.cc:1217] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:59.177542 11001 raft_consensus.cc:1217] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:59.241842 11001 raft_consensus.cc:1217] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:59.291165 11001 raft_consensus.cc:1217] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:59.677304 11272 raft_consensus.cc:1064] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:59.680018 11272 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:59.687109 10396 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.687300 10243 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.688622 11001 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.690210 11272 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.691519 11268 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.693152 11272 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.709856 11270 raft_consensus.cc:1064] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:59.712651 11270 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:59.717104 11268 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.724072 10244 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.737790 10396 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.740006 10243 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.741613 11213 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.749189 11002 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.754016 11213 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:59.755709 10318 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.754002 10148 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.777961 11213 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.779150 11304 raft_consensus.cc:1064] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:59.791747 11270 raft_consensus.cc:1064] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:14:59.794829 11270 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:59.793717 11304 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:14:59.813300 11213 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.825795 11002 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.834631 10244 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.834537 10319 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.836261 11000 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.836740 11318 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:59.839264 11001 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.841924 10244 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:14:59.844784 11309 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.845793 11288 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:59.875169 10999 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.875984 10325 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.882433 10396 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:59.886524 11283 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:14:59.912959 11220 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.913900 11282 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:59.929020 11213 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:14:59.980232 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 78882.5us
W20260709 13:14:59.984628 11314 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:14:59.990674 10318 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.001178 10244 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:00.019690 11317 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:00.025197 10325 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.033172 11000 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.085208 10146 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.085029 11330 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.086918 10146 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.097307 10321 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.102509 10395 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.123215 11000 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.140311 10325 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:00.147636 11001 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.149526 11325 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.149835 10396 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:00.149835 10394 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:00.156561 10999 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.156839 10325 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.157975 11002 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.159173 11320 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.160748 11288 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.161427 11213 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.162595 10145 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:00.162729 11272 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.164196 10244 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.169759 11318 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.170905 11213 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.175081 10392 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.179260 11002 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.184333 10243 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.253063 10146 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:00.190418 11309 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.191006 11000 raft_consensus.cc:2955] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.199096 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 69ce991d35f4413e82e03d5416c73bf2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:15:00.262588 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 63517.3us
I20260709 13:15:00.263329 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5235584cc4374dbcbe419cad1b3b9226 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:00.200394 11001 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.200822 10244 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:00.284904 10144 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.287104 11002 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.288697 11326 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:00.294042 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb19b1ef417a439c833c0b7627cf7c00 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:00.298810 11328 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.300088 10319 raft_consensus.cc:2955] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.312790 11325 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.315986 10321 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:00.317449 10392 raft_consensus.cc:2955] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.319403 11283 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.320286 11001 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.326145 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58bcaf2ee2cb4badb447e0a27855aaf6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:00.334789 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 69ce991d35f4413e82e03d5416c73bf2 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:00.349735 11336 tablet_replica.cc:333] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:00.350952 11336 raft_consensus.cc:2243] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.334380 10321 raft_consensus.cc:2955] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.353389 11336 raft_consensus.cc:2272] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.357537 11336 ts_tablet_manager.cc:1916] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:00.357929 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet 5235584cc4374dbcbe419cad1b3b9226 with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:00.363306 10147 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:00.360208 10144 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:00.394421 11337 tablet_replica.cc:333] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:15:00.395556 11337 raft_consensus.cc:2243] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.396337 11337 raft_consensus.cc:2272] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.399996 11337 ts_tablet_manager.cc:1916] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:00.407025 11336 ts_tablet_manager.cc:1929] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:00.407545 11336 log.cc:1199] T 69ce991d35f4413e82e03d5416c73bf2 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/69ce991d35f4413e82e03d5416c73bf2
I20260709 13:15:00.462656 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 69ce991d35f4413e82e03d5416c73bf2 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:00.417514 11337 ts_tablet_manager.cc:1929] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:00.465518 11337 log.cc:1199] T 5235584cc4374dbcbe419cad1b3b9226 P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/5235584cc4374dbcbe419cad1b3b9226
I20260709 13:15:00.469990 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet 5235584cc4374dbcbe419cad1b3b9226 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:00.481292 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 58bcaf2ee2cb4badb447e0a27855aaf6 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:00.491662 11340 tablet_replica.cc:333] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:00.494906 11340 raft_consensus.cc:2243] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.496629 11340 raft_consensus.cc:2272] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.514835 11340 ts_tablet_manager.cc:1916] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:00.542850 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet bb19b1ef417a439c833c0b7627cf7c00 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:00.544595 11336 tablet_replica.cc:333] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:00.590070 11340 ts_tablet_manager.cc:1929] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:00.590857 11340 log.cc:1199] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/58bcaf2ee2cb4badb447e0a27855aaf6
I20260709 13:15:00.593317 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 58bcaf2ee2cb4badb447e0a27855aaf6 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:00.600543 11336 raft_consensus.cc:2243] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:00.601619 11336 raft_consensus.cc:2272] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:00.607700 11336 ts_tablet_manager.cc:1916] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:00.622728 11336 ts_tablet_manager.cc:1929] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:00.623088 11336 log.cc:1199] T bb19b1ef417a439c833c0b7627cf7c00 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/bb19b1ef417a439c833c0b7627cf7c00
I20260709 13:15:00.624465 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet bb19b1ef417a439c833c0b7627cf7c00 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:01.546170 10244 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:15:01.554740 10213 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67d43312af804527af89708edfbd9177. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.555133 10394 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:01.555738 10321 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:01.556500 11304 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:01.557549 11330 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.566123 11330 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.569029 10321 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.569756 10394 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.583699 10244 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:01.588174 10147 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:15:01.602649 10213 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75f247057a16492c8757cbf337e8b240. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.603088 10394 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:01.603950 10319 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:01.608830 11344 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:01.613148 11330 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.635483 11344 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.638135 10392 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.646776 10321 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.669162 10394 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:01.678789 10144 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.691582 10321 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:01.692750 10362 consensus_peers.cc:597] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f892a371a6e2431ab5718daa82f2b02e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.693018 10244 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:01.695319 11270 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:01.698159 11349 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:01.708478 11349 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.711642 10319 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.713065 10246 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.731804 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.737320 10246 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:01.747763 10319 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:01.748173 10213 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfd747d82d6d447e9c04851a4163a863. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.749159 10394 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:01.749060 11344 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.750415 11330 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:01.769881 11304 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.778941 10319 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:01.797058 10147 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.833354 10394 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:02.116776 11360 ts_tablet_manager.cc:933] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:02.118886 11360 tablet_copy_client.cc:323] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:02.120797 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 67d43312af804527af89708edfbd9177 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:02.121284 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 67d43312af804527af89708edfbd9177 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-67d43312af804527af89708edfbd9177
I20260709 13:15:02.128886 10260 tablet_copy_source_session.cc:215] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:02.132295 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d43312af804527af89708edfbd9177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.148007 11360 tablet_copy_client.cc:806] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:02.148780 11360 tablet_copy_client.cc:670] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:02.153512 11360 tablet_copy_client.cc:538] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:02.162545 11360 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:02.185914 11360 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:02.187016 11360 tablet_bootstrap.cc:492] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:02.187832 11360 ts_tablet_manager.cc:1403] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.005s
I20260709 13:15:02.203269 11360 raft_consensus.cc:359] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.208992 11360 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:02.209916 11360 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.237744 11360 ts_tablet_manager.cc:1434] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.050s	user 0.013s	sys 0.011s
I20260709 13:15:02.239617 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-67d43312af804527af89708edfbd9177 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:02.240134 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-67d43312af804527af89708edfbd9177 on tablet 67d43312af804527af89708edfbd9177 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:02.245038 11360 ts_tablet_manager.cc:933] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:02.253453 11360 tablet_copy_client.cc:323] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:02.256024 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 75f247057a16492c8757cbf337e8b240 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:02.256615 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 75f247057a16492c8757cbf337e8b240 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-75f247057a16492c8757cbf337e8b240
I20260709 13:15:02.263072 10260 tablet_copy_source_session.cc:215] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:02.268586 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75f247057a16492c8757cbf337e8b240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.286803 11360 tablet_copy_client.cc:806] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:02.287465 11360 tablet_copy_client.cc:670] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:02.290264 11364 ts_tablet_manager.cc:933] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:02.291290 11360 tablet_copy_client.cc:538] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:02.302094 11360 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:02.312659 11364 tablet_copy_client.cc:323] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:02.319139 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet f892a371a6e2431ab5718daa82f2b02e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:02.319782 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet f892a371a6e2431ab5718daa82f2b02e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-f892a371a6e2431ab5718daa82f2b02e
I20260709 13:15:02.327208 11367 ts_tablet_manager.cc:933] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:02.330767 10409 tablet_copy_source_session.cc:215] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:02.334918 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892a371a6e2431ab5718daa82f2b02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.357128 11364 tablet_copy_client.cc:806] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:02.358984 11364 tablet_copy_client.cc:670] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:02.367122 11364 tablet_copy_client.cc:538] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:02.367483 11367 tablet_copy_client.cc:323] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:02.370092 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet cfd747d82d6d447e9c04851a4163a863 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:02.370728 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet cfd747d82d6d447e9c04851a4163a863 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-cfd747d82d6d447e9c04851a4163a863
I20260709 13:15:02.382113 11364 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:02.398537 10260 tablet_copy_source_session.cc:215] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:02.403597 11367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfd747d82d6d447e9c04851a4163a863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:02.420995 11364 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:02.422024 11364 tablet_bootstrap.cc:492] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:02.426430 11364 ts_tablet_manager.cc:1403] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.004s
I20260709 13:15:02.430089 11360 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:02.431138 11360 tablet_bootstrap.cc:492] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:02.431915 11360 ts_tablet_manager.cc:1403] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.023s
I20260709 13:15:02.432737 11364 raft_consensus.cc:359] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.433696 11364 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:02.434460 11364 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.435782 11360 raft_consensus.cc:359] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.436743 11360 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:02.437423 11360 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.439523 11367 tablet_copy_client.cc:806] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:02.439651 11360 ts_tablet_manager.cc:1434] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:02.441053 11364 ts_tablet_manager.cc:1434] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:15:02.442981 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-f892a371a6e2431ab5718daa82f2b02e received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:02.443073 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-75f247057a16492c8757cbf337e8b240 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:02.443521 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-f892a371a6e2431ab5718daa82f2b02e on tablet f892a371a6e2431ab5718daa82f2b02e with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:02.443627 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-75f247057a16492c8757cbf337e8b240 on tablet 75f247057a16492c8757cbf337e8b240 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:02.442155 11367 tablet_copy_client.cc:670] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:02.454367 11367 tablet_copy_client.cc:538] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:02.465939 11367 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:02.509855 11367 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:02.510933 11367 tablet_bootstrap.cc:492] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:02.512195 11367 ts_tablet_manager.cc:1403] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.018s
I20260709 13:15:02.515367 11367 raft_consensus.cc:359] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.516330 11367 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:02.517074 11367 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:02.520705 11367 ts_tablet_manager.cc:1434] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:02.522866 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-cfd747d82d6d447e9c04851a4163a863 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:02.523329 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-cfd747d82d6d447e9c04851a4163a863 on tablet cfd747d82d6d447e9c04851a4163a863 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:02.587105 11000 raft_consensus.cc:1217] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:02.637240 11000 raft_consensus.cc:1217] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:02.756531 11000 raft_consensus.cc:1217] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:02.822890 11000 raft_consensus.cc:1217] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:03.143178 11373 raft_consensus.cc:1064] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:03.145711 11373 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.153031 11000 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.153659 10394 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.154472 10319 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.154580 11350 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.156639 11350 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.158016 11330 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.173238 11330 raft_consensus.cc:1064] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:03.176986 11330 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.196798 11373 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.214035 11001 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.216411 10323 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.218566 10323 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.223302 10392 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.225968 11330 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.229312 11330 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.256402 10144 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.263533 11304 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.287417 11304 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.296098 10394 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.309821 11000 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.329717 11382 raft_consensus.cc:1064] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:03.332662 11382 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.431751 11000 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.462621 10323 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.478796 10145 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.485785 11000 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.490815 10319 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.519443 10392 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.522432 11304 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.523886 11385 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.526989 10395 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.530675 11309 raft_consensus.cc:1064] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:03.535691 11309 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.547824 10243 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.550004 11373 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.561211 11373 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.573254 10243 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.578289 10319 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.580999 11002 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.584182 11385 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:03.584103 11002 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.587419 11000 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.588474 10319 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.591054 11000 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.591292 11395 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.592784 10243 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:03.591291 10392 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.594844 11395 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.595732 11350 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:03.597707 11350 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:03.600152 10319 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.604158 10146 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.606065 11384 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.611406 10321 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.616057 11002 raft_consensus.cc:2955] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.628178 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67d43312af804527af89708edfbd9177 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:03.633020 11373 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:03.635496 11395 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.635782 10392 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.640074 11373 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.667819 10145 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.673617 11002 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.685945 10392 raft_consensus.cc:2955] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.690567 11395 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.695483 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75f247057a16492c8757cbf337e8b240 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:03.705231 10147 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.706956 11002 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.713361 10244 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.715828 10319 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.736017 10246 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.737022 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 67d43312af804527af89708edfbd9177 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:03.744974 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet 75f247057a16492c8757cbf337e8b240 with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:03.752580 11000 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.753177 10323 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.756194 11385 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:03.758280 11385 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:03.770459 11373 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.775022 11404 tablet_replica.cc:333] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:15:03.776847 11404 raft_consensus.cc:2243] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.777722 11404 raft_consensus.cc:2272] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.778872 10323 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.782290 11404 ts_tablet_manager.cc:1916] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:03.787088 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfd747d82d6d447e9c04851a4163a863 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:03.787460 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.776852 11403 tablet_replica.cc:333] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:03.793578 11403 raft_consensus.cc:2243] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.796871 11403 raft_consensus.cc:2272] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.795989 11000 raft_consensus.cc:2955] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.800500 11403 ts_tablet_manager.cc:1916] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:03.816551 10148 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.820586 10392 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:03.833382 11000 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.833531 10319 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:03.836385 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet cfd747d82d6d447e9c04851a4163a863 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:03.837999 11395 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:03.841089 11395 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:03.848278 11403 ts_tablet_manager.cc:1929] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:03.848994 11403 log.cc:1199] T 67d43312af804527af89708edfbd9177 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/67d43312af804527af89708edfbd9177
I20260709 13:15:03.849817 11395 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.851711 11403 tablet_replica.cc:333] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:03.852583 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 67d43312af804527af89708edfbd9177 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:03.852787 11002 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.854283 10319 raft_consensus.cc:2955] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.863629 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f892a371a6e2431ab5718daa82f2b02e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:03.861392 11404 ts_tablet_manager.cc:1929] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:03.865581 11404 log.cc:1199] T 75f247057a16492c8757cbf337e8b240 P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/75f247057a16492c8757cbf337e8b240
I20260709 13:15:03.867671 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet 75f247057a16492c8757cbf337e8b240 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:03.852842 11403 raft_consensus.cc:2243] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.871091 11403 raft_consensus.cc:2272] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.885834 11403 ts_tablet_manager.cc:1916] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:03.885401 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:03.901485 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet f892a371a6e2431ab5718daa82f2b02e with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:03.903982 11403 ts_tablet_manager.cc:1929] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:03.905521 11403 log.cc:1199] T cfd747d82d6d447e9c04851a4163a863 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/cfd747d82d6d447e9c04851a4163a863
I20260709 13:15:03.908536 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet cfd747d82d6d447e9c04851a4163a863 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:03.909451 11405 tablet_replica.cc:333] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:03.910575 11405 raft_consensus.cc:2243] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:03.911276 11405 raft_consensus.cc:2272] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:03.914961 11405 ts_tablet_manager.cc:1916] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:03.927399 11405 ts_tablet_manager.cc:1929] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:03.927772 11405 log.cc:1199] T f892a371a6e2431ab5718daa82f2b02e P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/f892a371a6e2431ab5718daa82f2b02e
I20260709 13:15:03.929512 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet f892a371a6e2431ab5718daa82f2b02e (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:04.970131 10244 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:04.977754 10394 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:04.978088 10213 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bdf450e3110e486088b3d5c7e2c7cef7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:04.978834 10319 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:04.980084 11373 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:04.980981 11384 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:04.989603 11373 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:04.991549 10394 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:04.997002 10319 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.018030 10244 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.018848 10147 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.032066 10394 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:05.034313 10213 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0de4147226834030b0fd22d4a0948990. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.034747 10319 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.035504 11412 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.036623 11373 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.047108 11373 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.047474 10395 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.056821 10319 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.068744 10394 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.072592 10148 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.089785 10246 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:05.089792 10362 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ed60181ed2d4e3782c0247f5c8a145f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.092384 11395 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.094907 10319 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:05.106287 11423 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.136296 11422 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.140156 10319 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.155856 10148 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.157665 10395 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.151540 10246 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.197047 10319 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:05.198042 10362 consensus_peers.cc:597] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bab3992733148c582649aac71356232. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.199213 10246 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:05.201643 11395 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.203184 11421 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.211526 11395 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.213811 10319 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.225822 10243 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.239944 10148 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:05.467072 11430 ts_tablet_manager.cc:933] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:05.471522 11430 tablet_copy_client.cc:323] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:05.473340 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 0de4147226834030b0fd22d4a0948990 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:05.473946 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 0de4147226834030b0fd22d4a0948990 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-0de4147226834030b0fd22d4a0948990
I20260709 13:15:05.482311 10260 tablet_copy_source_session.cc:215] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:05.485699 11430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0de4147226834030b0fd22d4a0948990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.503116 11430 tablet_copy_client.cc:806] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:05.503755 11430 tablet_copy_client.cc:670] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:05.507627 11430 tablet_copy_client.cc:538] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:05.517755 11430 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:05.544414 11432 ts_tablet_manager.cc:933] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:05.550611 11432 tablet_copy_client.cc:323] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:05.554615 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet bdf450e3110e486088b3d5c7e2c7cef7 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:05.555202 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet bdf450e3110e486088b3d5c7e2c7cef7 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-bdf450e3110e486088b3d5c7e2c7cef7
I20260709 13:15:05.556234 11430 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:05.557171 11430 tablet_bootstrap.cc:492] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:05.557870 11430 ts_tablet_manager.cc:1403] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.012s
I20260709 13:15:05.560994 11430 raft_consensus.cc:359] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.561847 11430 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:05.562638 11430 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.566080 10260 tablet_copy_source_session.cc:215] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:05.567895 11430 ts_tablet_manager.cc:1434] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:15:05.571286 11432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf450e3110e486088b3d5c7e2c7cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.572782 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-0de4147226834030b0fd22d4a0948990 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:05.573297 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-0de4147226834030b0fd22d4a0948990 on tablet 0de4147226834030b0fd22d4a0948990 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:05.590518 11432 tablet_copy_client.cc:806] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:05.591228 11432 tablet_copy_client.cc:670] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:05.599260 11432 tablet_copy_client.cc:538] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:05.609189 11432 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:05.632442 11432 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:05.633318 11432 tablet_bootstrap.cc:492] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:05.634995 11432 ts_tablet_manager.cc:1403] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.012s
I20260709 13:15:05.637840 11432 raft_consensus.cc:359] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.638841 11432 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:05.639403 11432 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.641325 11432 ts_tablet_manager.cc:1434] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:05.643438 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-bdf450e3110e486088b3d5c7e2c7cef7 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:05.643890 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-bdf450e3110e486088b3d5c7e2c7cef7 on tablet bdf450e3110e486088b3d5c7e2c7cef7 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:05.648793 11432 ts_tablet_manager.cc:933] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:05.659955 11432 tablet_copy_client.cc:323] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:05.661679 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 0ed60181ed2d4e3782c0247f5c8a145f from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:05.662271 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 0ed60181ed2d4e3782c0247f5c8a145f from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-0ed60181ed2d4e3782c0247f5c8a145f
I20260709 13:15:05.662756 11430 ts_tablet_manager.cc:933] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:05.675740 10409 tablet_copy_source_session.cc:215] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:05.681310 11430 tablet_copy_client.cc:323] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:05.685072 11432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed60181ed2d4e3782c0247f5c8a145f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.685819 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 6bab3992733148c582649aac71356232 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:05.686421 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 6bab3992733148c582649aac71356232 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-6bab3992733148c582649aac71356232
I20260709 13:15:05.694167 10409 tablet_copy_source_session.cc:215] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:05.697570 11430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bab3992733148c582649aac71356232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:05.701538 11432 tablet_copy_client.cc:806] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:05.702163 11432 tablet_copy_client.cc:670] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:05.708097 11432 tablet_copy_client.cc:538] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:05.716917 11430 tablet_copy_client.cc:806] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:05.717566 11430 tablet_copy_client.cc:670] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:05.720813 11430 tablet_copy_client.cc:538] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:05.721822 11432 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:05.729575 11430 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:05.753633 11432 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:05.754645 11432 tablet_bootstrap.cc:492] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:05.755378 11432 ts_tablet_manager.cc:1403] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.009s
I20260709 13:15:05.758961 11432 raft_consensus.cc:359] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.759845 11432 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:05.760527 11432 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.762710 11432 ts_tablet_manager.cc:1434] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:05.766458 11430 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:05.767467 11430 tablet_bootstrap.cc:492] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:05.768195 11430 ts_tablet_manager.cc:1403] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.008s
I20260709 13:15:05.769366 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-0ed60181ed2d4e3782c0247f5c8a145f received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:05.769847 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-0ed60181ed2d4e3782c0247f5c8a145f on tablet 0ed60181ed2d4e3782c0247f5c8a145f with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:05.772796 11430 raft_consensus.cc:359] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.773710 11430 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:05.774390 11430 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:05.776361 11430 ts_tablet_manager.cc:1434] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:05.777979 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-6bab3992733148c582649aac71356232 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:05.778426 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-6bab3992733148c582649aac71356232 on tablet 6bab3992733148c582649aac71356232 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:06.032009 11000 raft_consensus.cc:1217] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:15:06.033624 11002 raft_consensus.cc:1217] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:06.115417 11002 raft_consensus.cc:1217] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:06.136178 11000 raft_consensus.cc:1217] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:06.257864  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:06.319164 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:06.319801 10395 raft_consensus.cc:606] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:06.322216 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38076f481679473aac7854c07b22e381"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:06.322743 10395 raft_consensus.cc:606] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:06.325032 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:06.325541 10395 raft_consensus.cc:606] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:06.328230 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:06.329128 10395 raft_consensus.cc:606] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:06.342489 10244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:06.343008 10244 raft_consensus.cc:606] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:06.345635 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:06.346128 10395 raft_consensus.cc:606] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:06.347851  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:06.349470  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:06.429131 11423 raft_consensus.cc:993] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.429687 11395 raft_consensus.cc:1081] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.431403 10319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38076f481679473aac7854c07b22e381"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:06.432034 10319 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.432389 10319 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.439203 10319 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.443004 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:06.443699 10243 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.443548 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:06.451229 10395 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.452736 10395 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:06.455648 10243 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.457031 10395 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.458413 10319 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:06.458146 10395 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.473255 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:06.474220 11272 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.474725 11272 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:06.475533 11272 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.490604 10395 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.504566 10148 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.505373 11442 raft_consensus.cc:1064] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:06.508535 11442 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:06.510995 11427 raft_consensus.cc:993] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.511544 11427 raft_consensus.cc:1081] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.516803 10321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:06.517347 10321 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.517673 10321 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.527225 10321 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.529274 10321 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:06.531388 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:06.532070 10246 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.532724 10395 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:06.534616 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:06.535241 10394 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.535106 11442 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:06.535602 10394 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:06.536420 10394 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.537539 10394 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.540315 11000 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:06.542125 11395 raft_consensus.cc:1064] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:06.544291 10318 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:06.544926 11395 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:06.545957 11412 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:06.548497 11412 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.577843 10244 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:06.582484 11384 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.582762 10246 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.588193 11000 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.580868 11427 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:15:06.595088 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:06.596170 11441 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.596580 10394 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.596689 11441 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:06.597666 11441 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:06.608712 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47298.7us
I20260709 13:15:06.614562 10999 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:06.628574 11373 raft_consensus.cc:1064] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
W20260709 13:15:06.629006 11373 raft_consensus.cc:1068] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Unable to promote non-voter 72a1fe75b2bc4fb698d13f9d0b2dda04: Service unavailable: leader transfer in progress
I20260709 13:15:06.629086 10392 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.632570 11395 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.635512 11412 raft_consensus.cc:993] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:06.635968 11412 raft_consensus.cc:1081] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:06.639006 10395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:06.639555 10395 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.639927 10395 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.645023 10148 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.652300 10321 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:06.658841 10318 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.677610 10244 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:06.678584 10395 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:06.683944 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:06.684559 10246 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.684863 10246 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:06.684926 11002 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:06.685619 10246 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:06.686626 11423 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.686990 11373 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.687012 10246 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.689105 10395 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:06.692444 11427 raft_consensus.cc:993] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.695215 11427 raft_consensus.cc:1081] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.695845 11412 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.709654 11427 raft_consensus.cc:1064] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
W20260709 13:15:06.710125 11427 raft_consensus.cc:1068] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Unable to promote non-voter 72a1fe75b2bc4fb698d13f9d0b2dda04: Service unavailable: leader transfer in progress
I20260709 13:15:06.717742 11000 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.718904 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0de4147226834030b0fd22d4a0948990 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:06.717556 10146 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.726918 10321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:06.727530 10321 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.727926 10321 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.728760 10317 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:06.727757 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:06.730499 10319 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.730721 10246 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:06.733639 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:06.734452 11423 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.734942 11423 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:06.735832 11423 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:06.737694 10319 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:06.742098 11373 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:15:06.763856 10321 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:06.767624 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:06.768636 10392 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.768997 10392 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:06.766093 10321 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:06.769809 10392 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:06.790539 10392 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.798300 10147 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.806624 11455 raft_consensus.cc:993] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.807168 11455 raft_consensus.cc:1081] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.809685 10392 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.813223 10288 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:06.814090 11272 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.814294 10321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:06.814956 10321 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.815331 10321 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.814046 11395 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.823338 10321 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.823738 11457 raft_consensus.cc:993] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.833298 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:06.833860 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:06.833940 10244 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.815655 10146 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.833993 10321 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:06.833905 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:06.846647 10246 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:06.848289 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 108406us
I20260709 13:15:06.846745 10392 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.852815 10392 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:06.861764 10246 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.834713 11457 raft_consensus.cc:1081] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:06.874425 10392 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.861145 11001 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.884251 10244 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.877197 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:06.900028 11407 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.900594 11407 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:06.901580 11407 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:06.908532 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56564.7us
I20260709 13:15:06.910482 10392 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.910935 10323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:06.912248 10323 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.912650 10323 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.921844 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 0de4147226834030b0fd22d4a0948990 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
W20260709 13:15:06.925488 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 59347.3us
I20260709 13:15:06.930132 10321 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.934569 10393 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:06.934867 11472 tablet_replica.cc:333] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:06.936105 11472 raft_consensus.cc:2243] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:06.938311 11272 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:06.938709 10392 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.943727 10323 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.942368 11465 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:15:06.946833 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:06.947451 10393 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.947492 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:06.947786 10393 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:06.948191 10243 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.948066 10244 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.948670 10393 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.950920 10393 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.951889 10323 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:06.960250 11472 raft_consensus.cc:2272] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:06.957950 11272 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:06.969331 10393 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:06.970559 10146 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.972362 10321 raft_consensus.cc:2955] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:06.975308 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:06.979988 11465 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.980530 11465 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:06.981483 11465 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:06.991595 10243 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:07.006007 10395 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:07.019656 11472 ts_tablet_manager.cc:1916] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:07.070623 10395 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.077127 10323 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:07.079208 11466 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:07.085601 11468 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:07.091562 10147 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:07.101799 10246 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.106470 10243 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.110185 11000 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:07.112879 11464 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:07.113204 10321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:07.113721 10321 raft_consensus.cc:606] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:15:07.123585 11468 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.124823 11464 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:07.126530 11467 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.132879 10146 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:07.139037 11000 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.150640 10146 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:07.153776 11472 ts_tablet_manager.cc:1929] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:15:07.156105 11472 log.cc:1199] T 0de4147226834030b0fd22d4a0948990 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/0de4147226834030b0fd22d4a0948990
I20260709 13:15:07.160948 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 0de4147226834030b0fd22d4a0948990 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:07.161247 10321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:07.161813 10321 raft_consensus.cc:606] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:15:07.161990 10323 raft_consensus.cc:2955] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:07.162984 10132 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0ed60181ed2d4e3782c0247f5c8a145f already in progress [suppressed 2 similar messages]
I20260709 13:15:07.185801 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bab3992733148c582649aac71356232 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:07.189123 10323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:07.189844 10323 raft_consensus.cc:606] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:15:07.197188 10196 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:15:07.197657 10196 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0ed60181ed2d4e3782c0247f5c8a145f already in progress
W20260709 13:15:07.197960 10196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0ed60181ed2d4e3782c0247f5c8a145f already in progress
I20260709 13:15:07.204154 10147 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.216109 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bab3992733148c582649aac71356232 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:07.223639 11485 tablet_replica.cc:333] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:07.224776 11485 raft_consensus.cc:2243] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.229125 10243 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:07.229712 11485 raft_consensus.cc:2272] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.232043 11395 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.233780 11485 ts_tablet_manager.cc:1916] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:07.239087 10323 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:07.240351 11395 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.253636 11000 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Advancing to term 2
I20260709 13:15:07.265580 11000 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:07.267490 11395 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.289939 11485 ts_tablet_manager.cc:1929] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:07.290693 11485 log.cc:1199] T 6bab3992733148c582649aac71356232 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/6bab3992733148c582649aac71356232
I20260709 13:15:07.293038 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 6bab3992733148c582649aac71356232 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:07.297041 11395 raft_consensus.cc:1064] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:07.299729 11395 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:07.311865 11001 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:07.312198 10243 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:07.317865 11467 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.318869 11468 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.320159 10323 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:07.324802 11395 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.332271 11423 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.336280 11000 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.342881 10318 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.350544  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:07.365206 10147 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 2 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.365023 10243 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.384857 10394 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:07.395358 11000 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:07.398319 11423 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:07.408643 11395 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.410120 11001 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.418910 10243 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.419281 10392 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:07.420928 11272 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.424400 11272 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:07.425098 10244 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:07.426985 11272 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.429549 10246 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:07.432199 11423 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:07.442456 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bdf450e3110e486088b3d5c7e2c7cef7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:07.446408 10241 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.446010 10246 raft_consensus.cc:2955] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.450927 11272 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:07.460970 11407 raft_consensus.cc:993] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:07.461584 11407 raft_consensus.cc:1081] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:07.467314 10392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:15:07.467864 10392 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:07.468251 10392 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.474077 10146 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:07.478518 10392 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:07.502696 10394 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.502923 10396 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.521111 10393 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:07.503544 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet bdf450e3110e486088b3d5c7e2c7cef7 with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:07.508169 11001 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Advancing to term 2
I20260709 13:15:07.524571  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:07.523463 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:07.527164 10241 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.529130 11001 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:07.526825 11466 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:15:07.527060 11407 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:15:07.536561 11407 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:07.539887 11407 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.540803 11272 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:07.541172 11272 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:07.541925 11272 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:07.550956 10392 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:07.555539 11272 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.555871 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:07.581642 11494 tablet_replica.cc:333] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:15:07.596526 11494 raft_consensus.cc:2243] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.597486 11494 raft_consensus.cc:2272] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.601784 10241 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:07.631986 10318 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:07.633603 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:07.634517 11395 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:07.635001 11395 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:07.636027 11395 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:07.642993 11494 ts_tablet_manager.cc:1916] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:07.645771 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:07.646456 10393 raft_consensus.cc:606] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:07.651700 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:07.652263 10393 raft_consensus.cc:606] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:07.657143 10147 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:07.659610 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bab3992733148c582649aac71356232"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:07.660223 10392 raft_consensus.cc:606] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:07.662784 11494 ts_tablet_manager.cc:1929] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:15:07.665139 11494 log.cc:1199] T bdf450e3110e486088b3d5c7e2c7cef7 P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/bdf450e3110e486088b3d5c7e2c7cef7
I20260709 13:15:07.666996 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet bdf450e3110e486088b3d5c7e2c7cef7 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:07.668553 10241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75f247057a16492c8757cbf337e8b240"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:07.669061 10241 raft_consensus.cc:606] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:07.681823 10318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:07.682507 10318 raft_consensus.cc:606] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:07.685770 10241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:07.686307 10241 raft_consensus.cc:606] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:07.687456  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:07.688828  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:07.764952 11463 raft_consensus.cc:993] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:07.765511 11463 raft_consensus.cc:1081] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:07.767581 10392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:07.768151 10392 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:07.768508 10392 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.770977 11272 raft_consensus.cc:993] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:07.771510 11466 raft_consensus.cc:1081] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:07.773432 10395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:15:07.773993 10395 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:07.774387 10395 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.774642 10392 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.776559 10392 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:07.777436 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:07.777992 10318 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.778121 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:07.778745 10244 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:07.779035 10244 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:07.779736 10244 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.780920 10244 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.781075 10395 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.783056 10395 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:07.783721 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:07.784302 10241 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.784710 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:07.784907 10318 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:07.785305 10321 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:07.785635 10321 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:07.786376 10321 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.787371 10321 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.790488 10241 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:07.791770 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:07.792097 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:07.792708 11496 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.793210 11395 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.793229 11496 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:07.794196 11395 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:07.794481 11496 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.795035 11395 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.797402 11467 raft_consensus.cc:993] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:07.793254 10244 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:07.797942 11423 raft_consensus.cc:1081] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:07.799844 10323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:07.800380 10323 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:07.800722 10323 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.808501 10323 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.810207 10323 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:07.811432 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:07.812047 10395 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:07.812356 10395 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:07.813120 10395 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.814182 10395 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.816481 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:07.817036 10244 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:07.819497 10321 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:07.821627 10395 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:07.823660 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:07.824766 11466 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:07.825279 11466 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:07.826149 11466 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:07.832984 10244 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:07.850950 10147 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.852568 10147 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:07.854775 10146 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.036648 11423 raft_consensus.cc:993] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.037081 11395 raft_consensus.cc:1081] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.038576 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bab3992733148c582649aac71356232"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:08.039074 11001 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:08.039319 11001 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.044227 11001 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.046532 11001 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:08.047818 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:08.047892 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:08.048512 10318 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.048650 10395 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:08.049036 10395 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:08.049716 10395 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.050801 10395 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.054178 10318 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.055361 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:08.055770 10395 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.056182 11435 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:08.062656 11435 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:08.063714 11435 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.070767 10146 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.086696 11001 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Advancing to term 3
I20260709 13:15:08.091703 11001 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:08.092905 11395 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:08.100239 11423 raft_consensus.cc:1064] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
W20260709 13:15:08.100739 11423 raft_consensus.cc:1068] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Unable to promote non-voter 72a1fe75b2bc4fb698d13f9d0b2dda04: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:08.153537 10241 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:08.155026 11395 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:08.170488 10318 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:08.174649 11427 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:08.176184 11496 raft_consensus.cc:1064] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:08.178462 11496 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.196600 11478 raft_consensus.cc:993] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.198021 10241 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:08.198734 11001 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:08.199864 11423 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.201490 11423 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.206550 10241 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.214284 11423 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.216332 11496 raft_consensus.cc:993] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.217435 11423 raft_consensus.cc:1081] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.218343 11471 raft_consensus.cc:1081] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.219256 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:08.220221 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75f247057a16492c8757cbf337e8b240"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37908
I20260709 13:15:08.220825 11001 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:08.220392 10999 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:08.221263 11001 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.221690 10999 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.231503 10999 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.233824 10999 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:08.235708 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:08.235917 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:08.236590 10392 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:08.236624 10319 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.237182 10392 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:08.238767 11001 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.242352 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:08.241387 11467 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.242937 10241 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:08.243284 10241 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:08.244060 10241 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.243845 10392 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.245146 10241 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.245468 10392 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.253522 10241 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.264150 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:08.265106 11435 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:08.265636 11435 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:08.266500 11435 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.260128 10999 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.258430 11001 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:08.259696 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:08.276063 10395 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.283717 10323 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.287312 10319 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.290004 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:08.291074 11504 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:08.296015 11504 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:08.297050 11504 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.301460 11423 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:08.308409 10395 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.312003 10321 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:08.311807 10241 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.317799 10392 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.324400 10145 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 5, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.325628 10147 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.334735 11467 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.346763 10395 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.349907 10321 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.354154 10241 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:08.355942 11496 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:08.361119 10999 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:08.360512 10147 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:08.366559 11496 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:08.374297 11423 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.377863 10999 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.377849 10241 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.386878 10241 raft_consensus.cc:2955] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.394716 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ed60181ed2d4e3782c0247f5c8a145f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:08.397440 10243 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.398646 11464 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:08.408476 11496 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.411307 10392 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.412781 11466 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.416251 10145 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 5 to 6, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:08.420184 10318 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:08.429610 11467 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.435274 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ed60181ed2d4e3782c0247f5c8a145f with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:08.461447 11516 tablet_replica.cc:333] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:15:08.469280 11516 raft_consensus.cc:2243] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:08.473659 11516 raft_consensus.cc:2272] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:08.477941 10321 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:08.480365 11516 ts_tablet_manager.cc:1916] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:08.482210 11504 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:08.487622 10395 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:08.489449 11504 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.512797 11516 ts_tablet_manager.cc:1929] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:15:08.513614 11516 log.cc:1199] T 0ed60181ed2d4e3782c0247f5c8a145f P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/0ed60181ed2d4e3782c0247f5c8a145f
I20260709 13:15:08.515729 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet 0ed60181ed2d4e3782c0247f5c8a145f (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:08.600214 10395 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:08.606990 10241 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:08.607798 10362 consensus_peers.cc:597] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f26aceb684204af4b9a75341f4d72c53. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:08.606945 10321 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:08.608728 11467 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.609725 11423 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.616962 11496 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.619652 10321 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.618935 10241 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.636655 10146 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.634574 10321 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:08.650202 10392 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:15:08.652125 10288 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab10f00e071642849d7b7c7d29ee29ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:08.653111 11466 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:08.653529 10241 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:08.655402 11466 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:08.671332 11272 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.674907 10243 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.676038 10392 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.686151 10395 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:08.689932 10145 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.689986  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:08.700443 10392 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:08.701838 11504 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:08.711721 10362 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15565c698f45442aa353abbe927bfc68. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:08.717337 10318 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:08.717919 10243 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:08.719846 11395 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.720938 10318 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:08.722605 11496 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.727911 11511 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.730808 11467 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.744767 10243 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.751132 10318 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.757334 10319 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:08.764629 10146 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.785636 10395 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:08.789085 11435 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.802973 10241 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:08.806423 10392 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:08.807797 11466 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:08.810508 10288 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5db7cef2154f4a63901d966c49530263. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:08.812095 11534 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:08.820581 10243 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:08.821897 11504 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:08.844424 11466 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.850160  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:08.860603 10395 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.872277 10243 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:08.897316 10145 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:08.923929 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:08.924662 10395 raft_consensus.cc:606] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:08.930962 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:08.931825 10395 raft_consensus.cc:606] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:08.935992 10243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d43312af804527af89708edfbd9177"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:08.937821 10243 raft_consensus.cc:606] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:08.940557 10318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:08.941068 10318 raft_consensus.cc:606] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:08.943703 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:08.944195 10395 raft_consensus.cc:606] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:08.946849 10243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:08.947561 10243 raft_consensus.cc:606] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:08.949149  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:08.950817  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:08.957231 11395 raft_consensus.cc:993] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.957721 11395 raft_consensus.cc:1081] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:08.959863 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:08.960340 11001 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:08.960716 11001 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.966553 11001 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.968005 11001 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:08.970041 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:08.971619 10318 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.969642 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:08.974632 10395 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:08.974994 10395 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:08.977758 10318 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.976776 10395 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.978892 11478 raft_consensus.cc:993] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:08.979730 11463 raft_consensus.cc:1081] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:08.979940 10395 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.980417 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:08.981290 11504 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:08.981412 10392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:08.981818 11504 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:08.981983 10392 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:08.982389 10392 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.982745 11504 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:08.990481 10395 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:08.993636 10392 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:08.997502 10392 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:08.998282 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:08.998883 10243 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:08.999259 10243 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:08.999425 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:09.000066 10318 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:08.999617 10146 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.000231 10243 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:09.001770 10243 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.007411 10318 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:09.009027 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:09.010128 11467 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.011370 11467 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:09.012336 11467 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:09.020394 10243 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:09.034520 10146 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.071275 11542 ts_tablet_manager.cc:933] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:09.078184 11542 tablet_copy_client.cc:323] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:15:09.080796 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet ab10f00e071642849d7b7c7d29ee29ee from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:15:09.081446 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet ab10f00e071642849d7b7c7d29ee29ee from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-ab10f00e071642849d7b7c7d29ee29ee
I20260709 13:15:09.087563 10334 tablet_copy_source_session.cc:215] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:09.090875 11542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab10f00e071642849d7b7c7d29ee29ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.107204 11542 tablet_copy_client.cc:806] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:09.107925 11542 tablet_copy_client.cc:670] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:09.111861 11542 tablet_copy_client.cc:538] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:09.118521 11542 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:09.129855 11496 raft_consensus.cc:993] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:09.130596 11496 raft_consensus.cc:1081] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:09.132370 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:09.133234 11001 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.133626 11001 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.148111 11001 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:09.153174 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:09.153463 11001 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:09.153857 10243 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.155318 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:09.155987 10392 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.156322 10392 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:09.157035 10392 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:09.161937 10392 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.161795 10243 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:09.163643 10967 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:09.164414 11504 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.164904 11504 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:09.161196 11542 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:09.166100 11542 tablet_bootstrap.cc:492] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:09.165750 11504 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:09.166890 11542 ts_tablet_manager.cc:1403] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.012s
I20260709 13:15:09.169835 11542 raft_consensus.cc:359] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.170691 11542 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:09.171336 11542 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.173154 11542 ts_tablet_manager.cc:1434] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:09.174844 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-ab10f00e071642849d7b7c7d29ee29ee received from {username='slave'} at 127.0.0.1:52922
I20260709 13:15:09.175256 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-ab10f00e071642849d7b7c7d29ee29ee on tablet ab10f00e071642849d7b7c7d29ee29ee with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:09.182322 10392 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:09.185000 10146 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.198283 11542 ts_tablet_manager.cc:933] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:09.233989 11496 raft_consensus.cc:993] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:09.234560 11496 raft_consensus.cc:1081] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:09.237208 10318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:09.237769 10318 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.238646 10318 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.249953 11542 tablet_copy_client.cc:323] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:09.252000 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet f26aceb684204af4b9a75341f4d72c53 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:09.252594 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet f26aceb684204af4b9a75341f4d72c53 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-f26aceb684204af4b9a75341f4d72c53
I20260709 13:15:09.254134 10318 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:09.256654 10318 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:09.257015 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:09.257637 10243 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.263370 11466 raft_consensus.cc:993] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:09.263964 11534 raft_consensus.cc:1081] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:09.264643 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:09.265264 10395 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.265556 10395 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:09.266292 10395 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:09.268852 10395 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.266254 10243 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:09.271340 10393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:15:09.271869 10393 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.272207 10393 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.273659 10409 tablet_copy_source_session.cc:215] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:09.280114 10393 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.282784 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:09.282959 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:09.283565 10241 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.283944 11272 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.284228 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:09.284410 11272 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:09.284806 10318 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:09.285228 10318 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:09.285270 11272 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:09.286278 10318 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.287809 10318 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.289342 10393 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:09.296307 10318 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:09.297631 10362 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:09.298781 11423 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.299252 11423 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:09.300078 11423 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.304889 10241 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:09.309630 10395 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:09.306816 11542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f26aceb684204af4b9a75341f4d72c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.317553 10146 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.338828 10147 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.344857 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:09.352249 10392 raft_consensus.cc:606] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:15:09.350445 11548 ts_tablet_manager.cc:933] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:09.358114 11549 ts_tablet_manager.cc:933] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:09.359256 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:09.359894 10392 raft_consensus.cc:606] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:15:09.361950 11542 tablet_copy_client.cc:806] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:09.363039 11542 tablet_copy_client.cc:670] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:09.366926 11549 tablet_copy_client.cc:323] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:09.367698 11548 tablet_copy_client.cc:323] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:15:09.368060 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:09.368633 10392 raft_consensus.cc:606] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:15:09.368826 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 15565c698f45442aa353abbe927bfc68 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:09.369028 11542 tablet_copy_client.cc:538] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:09.369401 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 15565c698f45442aa353abbe927bfc68 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-15565c698f45442aa353abbe927bfc68
I20260709 13:15:09.370291 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 5db7cef2154f4a63901d966c49530263 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:15:09.370843 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 5db7cef2154f4a63901d966c49530263 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-5db7cef2154f4a63901d966c49530263
W20260709 13:15:09.375561 10196 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:15:09.376027 10196 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ab10f00e071642849d7b7c7d29ee29ee already in progress
W20260709 13:15:09.376299 10196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ab10f00e071642849d7b7c7d29ee29ee already in progress
I20260709 13:15:09.377099 10409 tablet_copy_source_session.cc:215] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:09.379663 11542 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:09.388854 10334 tablet_copy_source_session.cc:215] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:09.391146 11549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15565c698f45442aa353abbe927bfc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.395299 11548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db7cef2154f4a63901d966c49530263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.419883 11549 tablet_copy_client.cc:806] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:09.420612 11549 tablet_copy_client.cc:670] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:09.423283 11548 tablet_copy_client.cc:806] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:09.424973 11549 tablet_copy_client.cc:538] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:09.435551 11549 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:09.452051 10243 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.455909 11423 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.423949 11548 tablet_copy_client.cc:670] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:09.479897 11548 tablet_copy_client.cc:538] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:09.490473 11548 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:09.503991 11542 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:09.505107 11542 tablet_bootstrap.cc:492] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:09.513407 10318 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:09.514343 11542 ts_tablet_manager.cc:1403] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.037s
I20260709 13:15:09.517517 11542 raft_consensus.cc:359] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.518496 11542 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:09.519243 11542 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.519661 11504 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:09.521934 11542 ts_tablet_manager.cc:1434] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:09.526955 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-f26aceb684204af4b9a75341f4d72c53 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:09.527582 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-f26aceb684204af4b9a75341f4d72c53 on tablet f26aceb684204af4b9a75341f4d72c53 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:09.529311 10318 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.533079 11463 raft_consensus.cc:993] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:09.533695 11515 raft_consensus.cc:1081] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:09.535889 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67d43312af804527af89708edfbd9177"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37908
I20260709 13:15:09.536451 11467 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:09.536515 10999 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.539453 10999 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.547570 11549 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:09.552977 10999 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:09.559870 11549 tablet_bootstrap.cc:492] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:09.561950 11548 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:09.562317 11549 ts_tablet_manager.cc:1403] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.009s
I20260709 13:15:09.562983 11548 tablet_bootstrap.cc:492] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:09.563843 11548 ts_tablet_manager.cc:1403] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.013s
I20260709 13:15:09.566342 11549 raft_consensus.cc:359] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.569170 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:09.572896 10243 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.572791 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:09.573287 10243 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:09.573446 10318 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.583560 10243 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:09.590621 10318 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:09.590570 10243 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.584048 10392 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:09.571385 11548 raft_consensus.cc:359] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.595118 11548 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:09.595619 11504 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:09.595955 11548 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.598937 11548 ts_tablet_manager.cc:1434] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.004s
I20260709 13:15:09.601490 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:09.603061 11435 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.603581 11435 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:09.604403 11435 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:09.607949 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-5db7cef2154f4a63901d966c49530263 received from {username='slave'} at 127.0.0.1:52922
I20260709 13:15:09.608422 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-5db7cef2154f4a63901d966c49530263 on tablet 5db7cef2154f4a63901d966c49530263 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:09.608985 10395 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:09.612406 11511 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:09.626833 11549 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:09.627686 11549 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.632197 10999 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:09.633584 10243 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:09.637557 10241 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:09.639509 11511 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:09.636986 10145 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.665714 11549 ts_tablet_manager.cc:1434] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 13:15:09.668358 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-15565c698f45442aa353abbe927bfc68 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:09.668825 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-15565c698f45442aa353abbe927bfc68 on tablet 15565c698f45442aa353abbe927bfc68 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:09.712610 10243 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:09.717069 11423 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:09.720330 10319 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:09.722681 11496 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:09.729358 11423 raft_consensus.cc:993] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:09.731769 11423 raft_consensus.cc:1081] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:09.738539 11000 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Advancing to term 3
I20260709 13:15:09.743129 10243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39884
I20260709 13:15:09.743842 10243 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.744201 10243 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.744342 10999 raft_consensus.cc:1217] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:09.751319 10243 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.753883 10243 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:09.757169 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:09.757522 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:09.757758 10392 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.758088 10392 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:09.758848 10392 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.758106 10321 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.766999 10321 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:09.779332 10317 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:09.772791 10999 raft_consensus.cc:1217] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:09.772763 11000 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:09.777170 10392 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.817530 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:09.818418 11478 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.819192 11478 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:09.820158 11478 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:09.842823 10392 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:09.849268 10146 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 3 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 4 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.872524 10392 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.873632 10241 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.874413 11466 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.876295 11466 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.951788  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:09.961273 11000 raft_consensus.cc:1217] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:10.013708  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:10.072391 10241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:10.072979 10241 raft_consensus.cc:606] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:10.075822 10317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38076f481679473aac7854c07b22e381"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:10.076413 10317 raft_consensus.cc:606] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:10.080227 10241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:10.080798 10241 raft_consensus.cc:606] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:10.083336 10241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:10.083884 10241 raft_consensus.cc:606] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:10.086627 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:10.087127 10393 raft_consensus.cc:606] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:10.089756 10241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:10.090386 10241 raft_consensus.cc:606] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:10.091562  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:10.092779  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:10.139523 11463 raft_consensus.cc:993] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:10.139999 11463 raft_consensus.cc:1081] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:10.141637 10393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:10.142217 10393 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.142625 10393 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.149848 10393 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:10.152249 10393 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:10.152446 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:10.153070 10243 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.153391 10243 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:10.153388 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:10.154080 10317 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.154194 10243 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:10.155193 10243 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.159726 10243 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:10.160951 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:10.162166 11496 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.162779 11496 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:10.163546 10241 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:10.160995 10317 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:10.164741 11496 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:10.165690 11435 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:10.189996 10145 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.217979 10317 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:10.219470 11435 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:10.237972 11467 raft_consensus.cc:993] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:10.238474 11467 raft_consensus.cc:1081] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:10.240485 11515 raft_consensus.cc:993] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:10.248235 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:10.248559 11515 raft_consensus.cc:1081] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:10.248966 10999 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.249495 10999 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.245187 11000 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEARNER]: Advancing to term 4
W20260709 13:15:10.249686 11572 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:15:10.257112 11272 raft_consensus.cc:1064] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:10.259522 11272 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.262497 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37908
I20260709 13:15:10.263124 11001 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.263509 11001 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.263051 10999 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.272258 10999 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:10.272997 11001 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.273627 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:10.272244 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:10.274435 10393 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.274734 10241 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.274981 10393 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:10.276031 10393 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.277544 10393 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.284772 10317 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:10.291040 11478 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:10.292943 11478 raft_consensus.cc:993] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:10.293370 11478 raft_consensus.cc:1081] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:10.295480 10999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37908
I20260709 13:15:10.296093 10999 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.296510 10999 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.299770 11002 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.301486 11464 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:10.306485 11000 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:10.309629 10393 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:10.311148 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:10.311805 11001 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:10.312041 11511 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:10.312633 11511 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:10.313472 11511 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.315582 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:10.316252 10321 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.317610 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:10.318209 10246 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.318564 10246 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:10.319238 10246 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.320362 10246 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.322962 10393 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.324523 10321 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:10.324479 11466 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.325934 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:10.326769 11435 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.327265 11435 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:10.328269 11435 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.328833 10396 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:10.334612 10999 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.338276 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:10.339083 10243 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:10.339401 10243 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:10.340068 10243 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.341085 10243 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.342556 11478 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:10.357293 11423 raft_consensus.cc:1064] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:10.359429 10241 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:10.359843 11423 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.361003 11272 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.366828 10999 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:10.370003 10244 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.368194 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:10.371182 10321 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:10.372135 10243 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:10.373101 10967 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:10.373955 11504 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:10.382216 10321 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:10.387667 10318 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:10.389300 11466 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:10.398761 10148 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 3, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 3 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.401371 11463 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:10.413048 10250 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.417176 10146 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.426486 11478 raft_consensus.cc:1064] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:10.436211 11504 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:10.414981 10999 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.382508 10246 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:10.396478 10393 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.461079 11478 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.464485 11466 raft_consensus.cc:993] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:10.465042 11466 raft_consensus.cc:1081] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:10.471095 11504 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.476099 10999 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.476982 10250 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.479660 11467 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.480259 10246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38076f481679473aac7854c07b22e381"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:15:10.480996 10246 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.481390 10246 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.484763 11467 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.479220 10321 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.501066 11467 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:10.511510 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 78169.9us
I20260709 13:15:10.522356 11001 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:10.525382 10393 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:10.527988 10246 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:10.535604 10246 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:10.530596 10319 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:10.543382 11586 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:10.544557 10148 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.546473 11587 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:10.548506 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:10.549103 10321 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.549430 10321 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:10.550257 10321 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:10.551486 10321 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.551674 11423 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.554139 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:10.554169 11587 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:10.554899 10396 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.563421 11569 raft_consensus.cc:1064] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:10.563159 10148 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.565091 10250 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.565349 10999 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.577111 11569 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:10.578584 10319 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.581117 11463 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.585089 10396 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:10.590031 11587 raft_consensus.cc:993] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:10.590900 11587 raft_consensus.cc:1081] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:10.599756 10321 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:10.607957 10999 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:15:10.637562 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56930.8us
I20260709 13:15:10.643846 10246 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.644811 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:10.655611 10393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:10.656894 10393 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:10.657470 10393 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.658790 10319 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:10.660820 10318 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:10.688979 11423 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.697714 11467 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.714500 11588 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.717885 11587 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:10.711984 10393 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:10.746124 10393 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:10.798460 11587 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:10.800417 11587 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:10.805878 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 69268.3us
W20260709 13:15:10.855533 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 128839us
I20260709 13:15:10.858340 10145 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.867225 10318 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:10.901355 10319 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.906669 10392 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:10.910696 11582 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:10.934017 10246 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:10.924175 11582 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:10.982255 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:10.983119 10241 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.983486 10241 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:10.984589 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:10.985679 10318 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.028470 10318 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:11.031503 10147 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.035264 10323 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:10.984591 10241 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:11.067553 10249 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:11.068481 10245 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:11.071554 11599 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:15:11.073334 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 104146us
I20260709 13:15:11.074805 10241 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.077442 11582 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:11.083663 11435 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:11.084050 10250 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:11.094291 11589 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:11.095779  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:11.102051 11504 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:11.112327 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:11.126456 11603 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:11.127123 11603 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:11.128108 11511 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:11.128276 11603 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:11.135895 11001 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:11.203754 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 91507.8us
I20260709 13:15:11.245807 10241 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:11.297365 10393 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:11.383806 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 219543us
W20260709 13:15:11.404707 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 59183.6us
I20260709 13:15:11.419664 10393 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:11.439751 10321 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:11.441300 11463 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:11.453823 11423 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:11.489856 10323 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:11.494800 10249 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:11.591918 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82129.8us
I20260709 13:15:11.620253 10393 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:11.733853 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 102975us
I20260709 13:15:11.750841 10147 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 3, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:11.791887 11630 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:15:11.793576 11631 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:15:11.818888 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 281390us
I20260709 13:15:11.930477 11000 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:11.932717 11463 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:11.937420 11002 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:15:11.938359 11626 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.464s	user 0.008s	sys 0.004s
W20260709 13:15:11.981861 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 81829.6us
I20260709 13:15:11.998082 11588 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:11.998509 10246 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:12.003064 10322 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:12.005627 10998 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:12.002381 10317 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:12.012712 11621 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.551s	user 0.009s	sys 0.003s
I20260709 13:15:12.015941 11637 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:15:12.013576 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 81432.3us
I20260709 13:15:12.038043 11618 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:12.052630 10322 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.069231 11649 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:15:12.094518 11569 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:12.103554 11653 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:15:12.269194 11624 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.809s	user 0.013s	sys 0.009s
I20260709 13:15:12.270977 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 65) took 1120 ms. Trace:
I20260709 13:15:12.270358 11636 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.271561 10392 rpcz_store.cc:276] 0709 13:15:11.150577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.150712 (+   135us) service_pool.cc:224] Handling call
0709 13:15:11.172814 (+ 22102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.188242 (+ 15428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.188272 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.188815 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.390463 (+201648us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:11.390508 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.390609 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.242504 (+851895us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:12.270601 (+ 28097us) raft_consensus.cc:1685] finished
0709 13:15:12.270627 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.270888 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":287,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":125,"spinlock_wait_cycles":4307840,"thread_start_us":201023,"threads_started":1,"wal-append.queue_time_us":242298}
I20260709 13:15:12.296697 11272 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.321115 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5db7cef2154f4a63901d966c49530263 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:12.324430 11001 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.335057 10247 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.342404 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f26aceb684204af4b9a75341f4d72c53 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:12.343554 10996 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.369510 10246 raft_consensus.cc:2955] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.375471 10248 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:12.387856 10148 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.393962 10148 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.421485 10323 raft_consensus.cc:2955] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.471374 11496 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:12.474884 11001 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:12.476846 10321 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:12.479926 11586 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:12.486940 11607 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:12.487195  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:12.514505 11607 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.522330 10996 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.540056 10146 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.568704 10391 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:12.570196 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db7cef2154f4a63901d966c49530263 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:12.576516 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab10f00e071642849d7b7c7d29ee29ee with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:12.577320 10145 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.582681 10996 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:12.580658 10319 raft_consensus.cc:2955] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.589912 11496 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:12.590255 10246 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:12.594599 11496 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:12.596462 11671 tablet_replica.cc:333] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:12.597877 11671 raft_consensus.cc:2243] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.598742 11671 raft_consensus.cc:2272] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.598074 11636 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.599341 10996 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.635643 10243 raft_consensus.cc:2955] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.638505 10146 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 6 to 7, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 4 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.642458 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet f26aceb684204af4b9a75341f4d72c53 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:12.660791 11672 tablet_replica.cc:333] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:12.661633 10148 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:12.666734 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet ab10f00e071642849d7b7c7d29ee29ee with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:12.679881 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet 15565c698f45442aa353abbe927bfc68 with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:12.702081 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15565c698f45442aa353abbe927bfc68 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:12.704551 11671 ts_tablet_manager.cc:1916] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:12.724419 10243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:12.727663 10243 raft_consensus.cc:606] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:12.730168 11673 tablet_replica.cc:333] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:15:12.737429 10323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:12.737983 11671 ts_tablet_manager.cc:1929] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:12.738111 10323 raft_consensus.cc:606] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:12.741255 11671 log.cc:1199] T 5db7cef2154f4a63901d966c49530263 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/5db7cef2154f4a63901d966c49530263
I20260709 13:15:12.743798 11671 tablet_replica.cc:333] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:12.740212 11672 raft_consensus.cc:2243] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.744247 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 5db7cef2154f4a63901d966c49530263 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:12.744879 11672 raft_consensus.cc:2272] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.731453 11673 raft_consensus.cc:2243] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.748324 11672 ts_tablet_manager.cc:1916] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:12.747598 11673 raft_consensus.cc:2272] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.744786 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:12.750408 10391 raft_consensus.cc:606] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:12.751889  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:12.753829  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:12.755460 11673 ts_tablet_manager.cc:1916] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:12.766448 11671 raft_consensus.cc:2243] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:12.767514 11671 raft_consensus.cc:2272] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:12.771584 11671 ts_tablet_manager.cc:1916] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:12.773082 11672 ts_tablet_manager.cc:1929] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:12.773536 11672 log.cc:1199] T f26aceb684204af4b9a75341f4d72c53 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/f26aceb684204af4b9a75341f4d72c53
I20260709 13:15:12.775292 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet f26aceb684204af4b9a75341f4d72c53 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:12.789664 11671 ts_tablet_manager.cc:1929] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:15:12.790154 11673 ts_tablet_manager.cc:1929] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:12.790724 11673 log.cc:1199] T 15565c698f45442aa353abbe927bfc68 P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/15565c698f45442aa353abbe927bfc68
I20260709 13:15:12.790195 11671 log.cc:1199] T ab10f00e071642849d7b7c7d29ee29ee P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/ab10f00e071642849d7b7c7d29ee29ee
I20260709 13:15:12.793258 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet 15565c698f45442aa353abbe927bfc68 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:12.796037 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet ab10f00e071642849d7b7c7d29ee29ee (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:12.944504 11605 raft_consensus.cc:993] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:12.945094 11607 raft_consensus.cc:1081] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:12.946693 10391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:12.947232 10391 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.947613 10391 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.953662 10391 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:12.957056 10391 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:12.957897 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:12.960070 10243 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.960497 10243 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:12.961293 10243 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:12.962834 10243 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.963250 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:12.963860 10319 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.970655 10243 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:12.971133 10319 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:12.972653 10364 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:12.973618 11496 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.974097 11496 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:12.974951 11496 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:12.978919 11606 raft_consensus.cc:993] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:12.979508 11606 raft_consensus.cc:1081] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:12.986868 10243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:15:12.987504 10243 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.987861 10243 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.992498 10145 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.996587 10243 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:12.999677 10243 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:13.005535 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:13.006155 10319 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.006475 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:13.007040 10319 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:13.007395 10393 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.007851 10319 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:13.009258 10319 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.016656 10319 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:13.018016 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:13.018858 11607 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.018839 10393 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:13.019572 11607 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:13.020507 11607 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:13.038676 10145 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.261389 11636 raft_consensus.cc:993] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:13.261922 11496 raft_consensus.cc:1081] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:13.263415 10319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:13.263880 10319 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.264194 10319 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.270617 10319 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:13.272347 10319 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:13.273063 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:13.273258 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:13.273711 10246 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.273840 10393 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:13.274196 10393 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:13.274924 10393 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:13.276157 10393 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:13.281189 10393 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:13.283685 10246 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:13.285804 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:13.286628 11272 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:13.287387 11272 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:13.289999 11272 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:13.309134 10145 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 3, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.451543 10243 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.452857 11636 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.469720 10323 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.471287 11599 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.479588 10393 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.481048 11605 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.495055 10323 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.496672 11605 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.738782 10243 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.740273 11272 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:13.748855 10393 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:13.754906  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.766682 10391 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.768407 10323 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:13.769196 10362 consensus_peers.cc:597] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b0293dc4ca94845b6d1f8991514db3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:13.771497 11636 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.774480 10247 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:13.779419 11636 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.780130 11272 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:13.785149 11599 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.796155 10319 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.801460 10247 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.807332 10393 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:13.827064 10145 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.852972 10319 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:13.853744 10362 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23ce7c1f0ea74a808f62e7870ca8579f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:13.853806 10246 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:13.856264 11496 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.857867 11636 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:13.880201 11692 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:15:13.884446 11599 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.895159 10247 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.917073 10247 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:13.925901 10319 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.939968 10319 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:13.942303 11605 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.943125 10391 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:13.948267 10213 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc2db78b356a4f57af63adec3766d44b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:13.949234 10148 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.924557  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:13.957674 11684 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.963984 11684 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.990635 10393 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.993580 10323 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:13.996357 10391 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.004951 10146 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:14.027834 10362 consensus_peers.cc:597] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ae4445ee896464a9b9905cf5ca48e67. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:14.029834 10319 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:14.031240 11697 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.032905 10247 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:14.035719 11496 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.049263 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:14.050041 10391 raft_consensus.cc:606] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:14.058801 10323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:14.059492 10323 raft_consensus.cc:606] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:14.068005 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:14.068696 10246 raft_consensus.cc:606] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:14.071686 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:14.072362 10391 raft_consensus.cc:606] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:14.074394  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:14.074939 10323 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:14.076038  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:14.077140 11697 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:14.077787 10246 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:14.096529 10145 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:14.299281 11706 ts_tablet_manager.cc:933] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:14.301306 11706 tablet_copy_client.cc:323] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:14.303433 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 7b0293dc4ca94845b6d1f8991514db3e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:14.304035 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 7b0293dc4ca94845b6d1f8991514db3e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-7b0293dc4ca94845b6d1f8991514db3e
I20260709 13:15:14.310670 10409 tablet_copy_source_session.cc:215] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:14.314301 11706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0293dc4ca94845b6d1f8991514db3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.323257 11708 ts_tablet_manager.cc:933] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:14.325160 11708 tablet_copy_client.cc:323] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:14.327384 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet dc2db78b356a4f57af63adec3766d44b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:14.327977 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet dc2db78b356a4f57af63adec3766d44b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-dc2db78b356a4f57af63adec3766d44b
I20260709 13:15:14.334316 11706 tablet_copy_client.cc:806] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:14.335117 11706 tablet_copy_client.cc:670] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:14.336447 10260 tablet_copy_source_session.cc:215] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:14.339066 11706 tablet_copy_client.cc:538] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:14.340864 11708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2db78b356a4f57af63adec3766d44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.348079 11706 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:14.361625 11708 tablet_copy_client.cc:806] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:14.362447 11708 tablet_copy_client.cc:670] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:14.367523 11697 raft_consensus.cc:993] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:14.368096 11697 raft_consensus.cc:1081] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:14.371300 10319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:14.371917 10319 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.372288 10319 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.375631 11706 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:14.380038 10319 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.381620 11708 tablet_copy_client.cc:538] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:14.383147 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:14.383726 10247 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.376634 11706 tablet_bootstrap.cc:492] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:14.387064 11706 ts_tablet_manager.cc:1403] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.012s
I20260709 13:15:14.390506 11706 raft_consensus.cc:359] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.391372 11706 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:14.392042 11706 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.394943 11706 ts_tablet_manager.cc:1434] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:14.403992 10247 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:14.411669 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-7b0293dc4ca94845b6d1f8991514db3e received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:14.411926 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:14.412225 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-7b0293dc4ca94845b6d1f8991514db3e on tablet 7b0293dc4ca94845b6d1f8991514db3e with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:14.413635 11644 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.413795 11708 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:14.414165 11644 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:14.415259 11644 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.427980 10319 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:14.434520 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:14.435293 10391 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.436851 10391 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:14.441556 11684 raft_consensus.cc:993] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:14.442080 11684 raft_consensus.cc:1081] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:14.443109 11708 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:14.444098 11708 tablet_bootstrap.cc:492] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:14.444025 10392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:14.444739 10392 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.445013 11708 ts_tablet_manager.cc:1403] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.011s
I20260709 13:15:14.445087 10392 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.447019 10146 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.448355 11708 raft_consensus.cc:359] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.449292 11708 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:14.450037 11708 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.438112 10391 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.455132 10391 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.452833 11708 ts_tablet_manager.cc:1434] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:14.458741 11606 raft_consensus.cc:993] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:14.459275 11606 raft_consensus.cc:1081] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:14.460812 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-dc2db78b356a4f57af63adec3766d44b received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:14.461308 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-dc2db78b356a4f57af63adec3766d44b on tablet dc2db78b356a4f57af63adec3766d44b with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:14.463357 10247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:15:14.464017 10247 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.464381 10247 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.464320 10392 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:14.466447 10392 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:14.467082 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:14.467675 10246 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.467983 10246 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:14.468037 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:14.468626 10319 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.468807 10246 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:14.470111 10246 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.472935 10391 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:14.475594 10319 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:14.476907 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:14.477104 10246 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:14.478471 11697 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.479000 11697 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:14.479944 11697 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:14.482925 11496 raft_consensus.cc:993] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:14.483423 11496 raft_consensus.cc:1081] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:14.485622 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:14.486123 11001 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.486536 11001 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.486795 10247 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:14.490131 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:14.490698 10321 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.490990 10321 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:14.491751 10321 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:14.491984 10319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:14.492506 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:14.492852 10321 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.493690 10391 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.493393 10319 raft_consensus.cc:606] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:15:14.496644 11001 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:14.499565 10323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:14.500168 10323 raft_consensus.cc:606] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:15:14.500034 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:14.500715 10246 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:14.501929 10132 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 23ce7c1f0ea74a808f62e7870ca8579f already in progress [suppressed 1 similar messages]
I20260709 13:15:14.492172 10247 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:14.564910 10321 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
W20260709 13:15:14.567639 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 65752.7us
I20260709 13:15:14.568681 10391 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:14.568882 10246 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:14.570041 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:14.571336 10319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:14.575358 10319 raft_consensus.cc:606] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:15:14.576943 11683 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.577490 11683 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:14.578437 11683 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:14.581100 11708 ts_tablet_manager.cc:933] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:14.579509 11001 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:14.583150 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:14.583768 10392 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:14.584076 10392 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:14.584921 10392 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:14.586258 10392 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.576547 10145 catalog_manager.cc:5697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:14.588141 10196 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:15:14.592173 10196 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 23ce7c1f0ea74a808f62e7870ca8579f already in progress
W20260709 13:15:14.592527 10196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 23ce7c1f0ea74a808f62e7870ca8579f already in progress
I20260709 13:15:14.600371 11708 tablet_copy_client.cc:323] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:14.600967 10392 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:14.602015 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:14.602495 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 4ae4445ee896464a9b9905cf5ca48e67 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:14.603071 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 4ae4445ee896464a9b9905cf5ca48e67 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-4ae4445ee896464a9b9905cf5ca48e67
I20260709 13:15:14.603097 11711 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.604097 11711 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:14.604971 11711 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:14.614692 10409 tablet_copy_source_session.cc:215] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:14.625931 11708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4445ee896464a9b9905cf5ca48e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.634126 10146 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:14.634754 10145 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.657461 11708 tablet_copy_client.cc:806] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:14.659031 11708 tablet_copy_client.cc:670] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:14.662778 11708 tablet_copy_client.cc:538] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:14.669649 11708 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:14.691494 11708 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:14.692497 11708 tablet_bootstrap.cc:492] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:14.693107 11708 ts_tablet_manager.cc:1403] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:15:14.695391 11708 raft_consensus.cc:359] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.696084 11708 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:14.696630 11708 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.701606 11708 ts_tablet_manager.cc:1434] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:15:14.703481 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-4ae4445ee896464a9b9905cf5ca48e67 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:14.703940 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-4ae4445ee896464a9b9905cf5ca48e67 on tablet 4ae4445ee896464a9b9905cf5ca48e67 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:14.817198 10391 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:14.818627 11272 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.825160 11272 raft_consensus.cc:993] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:14.827828 10996 raft_consensus.cc:1217] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:14.846671 11272 raft_consensus.cc:1081] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:14.851768 10391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:15:14.860193 10391 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:14.860674 10391 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.861095 10246 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:15:14.861541 10288 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23ce7c1f0ea74a808f62e7870ca8579f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:14.862557 11720 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:14.868465 10391 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.874344 10391 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:14.874895 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:14.876816 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:14.877462 10319 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:14.877748 10319 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:14.878516 10319 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.879869 10319 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.882074 11001 raft_consensus.cc:1217] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:14.899375 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:14.900107 10246 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.901679 11496 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.907516 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:14.909042 11496 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:14.909551 11496 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:14.910941 11496 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:14.914966 10319 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.926523 11496 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:14.934890 10148 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.077051  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.137043 10319 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.138008 10391 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:15.141309 11717 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:15.146772 10391 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:15.147667 11684 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:15.166805 10996 raft_consensus.cc:1217] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:15.178741 11726 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:15.207854 10246 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:15.220292  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.226140 11717 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:15.312049 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:15.312700 10392 raft_consensus.cc:606] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:15.315341 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:15.315894 10392 raft_consensus.cc:606] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:15.318631 10247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:15.319216 10247 raft_consensus.cc:606] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:15.320510  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:15.321622  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:15.333474 11705 raft_consensus.cc:1064] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:15.336122 11705 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:15.342604 10323 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.343433 10247 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.344117 11705 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:15.345021 10996 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.345049 11496 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:15.346786 11728 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:15.361131 11728 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.363091 10996 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.379729 10323 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.381781 10148 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.417281 10247 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.433501 10392 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:15.439527 10323 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:15.439543 10996 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:15.441053 11705 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.443061 11728 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.451231 11697 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.452527 10323 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:15.458611 10362 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23ce7c1f0ea74a808f62e7870ca8579f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:15.462419 10996 raft_consensus.cc:2955] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.472985 10148 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.476624 11726 raft_consensus.cc:1064] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:15.480504 11726 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:15.483654 10323 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:15.487223 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b0293dc4ca94845b6d1f8991514db3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:15.488392 11496 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.493180 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b0293dc4ca94845b6d1f8991514db3e with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:15.495913 10247 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.504612 10996 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.506112 11727 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:15.518283 11636 raft_consensus.cc:993] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:15.518283 10323 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.519022 11636 raft_consensus.cc:1081] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:15.523854 11727 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:15.525081 10323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:15.525719 10323 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.526075 10323 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.530618 10392 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.533766 11726 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:15.536643 10323 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:15.537307 10247 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:15.554736 10319 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:15.559147 11728 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.560134 10323 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:15.561666 11739 tablet_replica.cc:333] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:15.567689 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:15.569063 10391 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:15.569521 10391 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:15.570389 10391 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:15.573985 11636 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.574672 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:15.575410 10247 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.578858 10391 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.588352 11727 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.601831 11739 raft_consensus.cc:2243] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.602695 11739 raft_consensus.cc:2272] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.607080 11739 ts_tablet_manager.cc:1916] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:15.607805 11726 raft_consensus.cc:993] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:15.608484 11726 raft_consensus.cc:1081] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:15.605554 10996 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.613819 10393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:15.614437 10393 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.614786 10393 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.617528 10391 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:15.622154 10247 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:15.624017 11697 raft_consensus.cc:993] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:15.624727 11697 raft_consensus.cc:1081] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:15.625092 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:15.626483 11644 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:15.626726 10319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:15.626993 11644 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:15.627364 10319 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.627774 10319 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.627980 11644 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:15.635236 10319 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:15.635084 10318 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.635458 10391 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.637918 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:15.638499 10247 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.623240 10393 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:15.640379 10393 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:15.641453 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:15.642053 10323 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.642541 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:15.643103 10248 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:15.643356 10248 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:15.644106 10248 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:15.645049 10248 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:15.645215 10247 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:15.647047 10290 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:15.649304 11606 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:15.649812 11606 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:15.652503 10323 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:15.653816 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:15.654922 10319 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:15.656243 11728 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:15.656780 11728 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:15.657735 11728 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:15.676734 11606 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:15.688072 11705 raft_consensus.cc:1064] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:15.692617 11705 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:15.694458 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:15.696784 10391 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:15.697144 10391 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:15.661381 10148 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.699493 10391 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:15.702381 10391 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.704900 11739 ts_tablet_manager.cc:1929] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:15.705466 11739 log.cc:1199] T 7b0293dc4ca94845b6d1f8991514db3e P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/7b0293dc4ca94845b6d1f8991514db3e
I20260709 13:15:15.706264 10145 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 3 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.707347 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 7b0293dc4ca94845b6d1f8991514db3e (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:15.717142 10391 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:15.729648 11001 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.731207 11705 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:15.735015 10318 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.735169 10243 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:15.736690 11705 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:15.739596 11636 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:15.763649 11705 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.770398 10248 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:15.773257 10318 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.776316 10145 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.785422 10247 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:15.791258 11001 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.793730 10996 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:15.795711 11605 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.803609 10319 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:15.804955 10247 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.808497 11743 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:15.808832 10148 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.820129 11727 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.823056 10996 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.828526 10144 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 3, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.833119 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc2db78b356a4f57af63adec3766d44b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:15.844995 10391 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:15.852816 10318 raft_consensus.cc:2955] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.861030 10145 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 3 to 4, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.867017 11001 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:15.868491 11705 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.873827 10319 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:15.875667 11705 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:15.884912 11697 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.890372 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet dc2db78b356a4f57af63adec3766d44b with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44050
I20260709 13:15:15.895010 10319 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.897184 10996 raft_consensus.cc:2955] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:15.920164 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ae4445ee896464a9b9905cf5ca48e67 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:15.926350 11751 tablet_replica.cc:333] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:15:15.927488 11751 raft_consensus.cc:2243] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.928242 11751 raft_consensus.cc:2272] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.931969 11751 ts_tablet_manager.cc:1916] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:15.935652 10144 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 3 to 4, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.953635 11751 ts_tablet_manager.cc:1929] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:15.954269 11751 log.cc:1199] T dc2db78b356a4f57af63adec3766d44b P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/dc2db78b356a4f57af63adec3766d44b
I20260709 13:15:15.956046 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet dc2db78b356a4f57af63adec3766d44b (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:15.966472 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ae4445ee896464a9b9905cf5ca48e67 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39862
I20260709 13:15:15.967415 11739 tablet_replica.cc:333] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:15:15.968425 11739 raft_consensus.cc:2243] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:15.969161 11739 raft_consensus.cc:2272] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:15.972172 11739 ts_tablet_manager.cc:1916] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:15.989943 11739 ts_tablet_manager.cc:1929] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:15.990437 11739 log.cc:1199] T 4ae4445ee896464a9b9905cf5ca48e67 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/4ae4445ee896464a9b9905cf5ca48e67
I20260709 13:15:15.992029 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 4ae4445ee896464a9b9905cf5ca48e67 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:15:16.130268 10247 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.131724 11599 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.138860 10319 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.142752 11705 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:16.150004 10391 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:16.153818 11644 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:16.165302 10288 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23ce7c1f0ea74a808f62e7870ca8579f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:16.169114 10393 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:16.170459 11272 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.204087 10247 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:16.207537 11644 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.211480 10248 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:16.214061 11272 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:16.322659  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.428838  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.467897 10318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:16.468426 10318 raft_consensus.cc:606] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:16.470741 10248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54badd91404d4f7894752c8769345dca"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:16.471174 10248 raft_consensus.cc:606] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:16.473508 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:16.474185 10391 raft_consensus.cc:606] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:16.476253  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:16.478530  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:16.526690 11496 raft_consensus.cc:993] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:16.527174 11705 raft_consensus.cc:1081] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:15:16.528651 10996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:15:16.529134 10996 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.529430 10996 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.533856 10996 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:16.535567 10996 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:16.536763 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:16.536824 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:16.537523 10319 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.537652 10391 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.538131 10391 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:16.539113 10391 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:16.540053 10391 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.543097 10319 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:16.544394 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:16.545233 11711 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.545939 10391 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:16.546700 11711 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:16.547590 11711 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:16.558640 10145 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.580699 11606 raft_consensus.cc:993] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:16.581195 11747 raft_consensus.cc:1081] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:16.582777 10243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:15:16.583285 10243 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.583648 10243 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.587999 10243 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:16.589639 10243 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:16.590512 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:16.590668 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:16.591163 10319 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.591264 10391 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.591513 10319 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:16.592334 10319 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:16.593283 10319 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.596434 10391 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:16.597692 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:16.598169 10319 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:16.598489 11605 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.599040 11605 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:16.599983 11605 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:16.612480 10145 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.718631 11766 ts_tablet_manager.cc:933] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:16.721441 11766 tablet_copy_client.cc:323] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:15:16.723506 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 23ce7c1f0ea74a808f62e7870ca8579f from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:15:16.724102 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 23ce7c1f0ea74a808f62e7870ca8579f from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-23ce7c1f0ea74a808f62e7870ca8579f
I20260709 13:15:16.733356 10334 tablet_copy_source_session.cc:215] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:16.736536 11766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ce7c1f0ea74a808f62e7870ca8579f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:16.755298 11766 tablet_copy_client.cc:806] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:16.755939 11766 tablet_copy_client.cc:670] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:16.760757 11766 tablet_copy_client.cc:538] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:16.767774 11766 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:16.791024 11766 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:16.791937 11766 tablet_bootstrap.cc:492] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:16.792636 11766 ts_tablet_manager.cc:1403] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:15:16.795660 11766 raft_consensus.cc:359] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:16.796466 11766 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:16.797185 11766 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:16.799538 11766 ts_tablet_manager.cc:1434] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:15:16.802580 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-23ce7c1f0ea74a808f62e7870ca8579f received from {username='slave'} at 127.0.0.1:52922
I20260709 13:15:16.803138 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-23ce7c1f0ea74a808f62e7870ca8579f on tablet 23ce7c1f0ea74a808f62e7870ca8579f with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:16.899935 11727 raft_consensus.cc:993] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:16.900427 11605 raft_consensus.cc:1081] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:16.902012 10391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54badd91404d4f7894752c8769345dca"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:16.902456 10391 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.902686 10391 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.909024 10391 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:16.910562 10391 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:16.911387 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:16.911547 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:16.912035 10243 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.912364 10243 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:16.912133 10318 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.913163 10243 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:16.914487 10243 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.921276 10243 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:16.921633 10318 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:16.922545 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:16.923354 11705 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.923780 11705 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:16.924566 11705 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:16.933727 10145 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.979667 10319 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:16.981168 11717 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:16.993191 10391 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:16.994867 11717 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:17.073263 10243 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.079475 10391 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:15:17.079850 10213 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7df30c54c90e4fcfaeb14736ccbcec7c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.080473 10319 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:17.081441 11765 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.082298 11727 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.091512 11765 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.093650 10391 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.101336 10323 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.103233 11605 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.110285 10393 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.114360 10145 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.103106 10319 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:15:17.151590 10362 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ebd7b007a9b4c7eaa47f51eaea905b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.159324 10323 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:17.161413 10393 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.164073 10243 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:17.170007 11599 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.171865 11605 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.175984 11705 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:17.186018 11705 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.189719 10247 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.214473 10322 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.241474 10392 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.267359 10243 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:17.268707 10319 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:17.269953 11496 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:17.273193 10362 consensus_peers.cc:597] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5315e843bcf14730b0299b712eab40d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.278496 10145 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.305099 11785 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.312651 11496 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.317129 10243 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.331496 10247 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.328701 10319 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.337214 11001 raft_consensus.cc:1217] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEARNER]: Deduplicated request from leader. Original: 3.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:15:17.351078 10144 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 3, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:15:17.359493 10213 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3955117b87304f9c9123136a32ea1aa8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.359694 10393 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:17.361369 10319 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:17.361493 11727 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:17.363176 11605 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.371133 11727 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.373350 10393 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.378871 10319 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:15:17.391439 10144 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index -1 to 2, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.408450 10243 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.409789 11785 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.424427 10319 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.428136 11786 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.479480  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.623265 11796 ts_tablet_manager.cc:933] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:17.625152 11796 tablet_copy_client.cc:323] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:17.626904 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 7df30c54c90e4fcfaeb14736ccbcec7c from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:17.627478 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 7df30c54c90e4fcfaeb14736ccbcec7c from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-7df30c54c90e4fcfaeb14736ccbcec7c
I20260709 13:15:17.635352 10260 tablet_copy_source_session.cc:215] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:17.638840 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df30c54c90e4fcfaeb14736ccbcec7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.659641 11796 tablet_copy_client.cc:806] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:17.660298 11796 tablet_copy_client.cc:670] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:17.661053  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.664161 11796 tablet_copy_client.cc:538] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:17.687608 11796 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:17.693238 11798 ts_tablet_manager.cc:933] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:17.702405 11798 tablet_copy_client.cc:323] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:17.704434 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:17.705006 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-0ebd7b007a9b4c7eaa47f51eaea905b9
I20260709 13:15:17.726799 10409 tablet_copy_source_session.cc:215] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:17.736227 11798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.749914 11796 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:17.751101 11796 tablet_bootstrap.cc:492] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:17.751895 11796 ts_tablet_manager.cc:1403] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.013s
I20260709 13:15:17.756786 11796 raft_consensus.cc:359] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.758533 11796 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:17.759565 11796 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.762907 11796 ts_tablet_manager.cc:1434] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:15:17.773895 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-7df30c54c90e4fcfaeb14736ccbcec7c received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:17.774385 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-7df30c54c90e4fcfaeb14736ccbcec7c on tablet 7df30c54c90e4fcfaeb14736ccbcec7c with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:17.778079 11798 tablet_copy_client.cc:806] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:17.778774 11798 tablet_copy_client.cc:670] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:17.785833 11798 tablet_copy_client.cc:538] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:17.787068 11796 ts_tablet_manager.cc:933] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671)
I20260709 13:15:17.791983 10323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:17.792673 10323 raft_consensus.cc:606] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:17.797107 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54badd91404d4f7894752c8769345dca"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:17.797734 10392 raft_consensus.cc:606] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:17.798946 11798 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:17.802413 10247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:17.803030 10247 raft_consensus.cc:606] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:17.805392  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:17.807051  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:17.807143 11802 ts_tablet_manager.cc:933] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:17.830016 11802 tablet_copy_client.cc:323] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:15:17.832871 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet 5315e843bcf14730b0299b712eab40d0 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:15:17.833281 11747 raft_consensus.cc:1064] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:17.833444 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet 5315e843bcf14730b0299b712eab40d0 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-5315e843bcf14730b0299b712eab40d0
I20260709 13:15:17.833601 11796 tablet_copy_client.cc:323] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.193:40671
I20260709 13:15:17.836110 11747 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:17.837762 11798 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:17.839403 11798 tablet_bootstrap.cc:492] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:17.840142 11798 ts_tablet_manager.cc:1403] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.041s	user 0.028s	sys 0.001s
I20260709 13:15:17.844664 11798 raft_consensus.cc:359] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.846702 11798 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:17.847465 11798 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:17.854167 11798 ts_tablet_manager.cc:1434] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:17.855803 10260 tablet_copy_service.cc:140] P ab33f0a79ddf4f5a8ba81b3b0e120529: Received BeginTabletCopySession request for tablet 3955117b87304f9c9123136a32ea1aa8 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:54378)
I20260709 13:15:17.856130 10408 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-0ebd7b007a9b4c7eaa47f51eaea905b9 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:17.856447 10260 tablet_copy_service.cc:161] P ab33f0a79ddf4f5a8ba81b3b0e120529: Beginning new tablet copy session on tablet 3955117b87304f9c9123136a32ea1aa8 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:54378: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-3955117b87304f9c9123136a32ea1aa8
I20260709 13:15:17.856585 10408 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-0ebd7b007a9b4c7eaa47f51eaea905b9 on tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:17.865972 10409 tablet_copy_source_session.cc:215] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:17.874423 11802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5315e843bcf14730b0299b712eab40d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.875978 10260 tablet_copy_source_session.cc:215] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:17.880622 11796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3955117b87304f9c9123136a32ea1aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:17.892390 11606 raft_consensus.cc:993] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:17.898392 11747 raft_consensus.cc:1081] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:15:17.899919 11796 tablet_copy_client.cc:806] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:17.900113 10243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:15:17.901856 10243 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.902369 10996 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:17.904006 10393 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:17.905907 11802 tablet_copy_client.cc:806] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:17.906126 10247 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:17.906635 11802 tablet_copy_client.cc:670] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:17.906554 10243 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.916837 11802 tablet_copy_client.cc:538] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:17.907358 11796 tablet_copy_client.cc:670] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:17.907227 11807 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:17.918915 11808 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:17.923628 11796 tablet_copy_client.cc:538] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:17.928052 11802 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:17.930153 11644 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:15:17.938133 10243 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:17.941102 10243 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:17.941958 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:17.942588 10323 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:17.942878 10323 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:17.943320 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:17.943919 11001 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.943583 10323 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:17.944779 10323 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.952903 10323 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:17.957578 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:17.959369 11605 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:17.960017 11605 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:17.961689 11796 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:15:17.961094 11605 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.002022 11796 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:18.003068 11796 tablet_bootstrap.cc:492] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:18.003870 11796 ts_tablet_manager.cc:1403] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.042s	user 0.033s	sys 0.006s
I20260709 13:15:18.011972 11599 raft_consensus.cc:993] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:18.012521 11599 raft_consensus.cc:1081] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:18.008360 11796 raft_consensus.cc:359] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:18.014336 11796 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:18.015146 11796 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:18.021872 11796 ts_tablet_manager.cc:1434] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:15:18.025705 10260 tablet_copy_service.cc:342] P ab33f0a79ddf4f5a8ba81b3b0e120529: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-3955117b87304f9c9123136a32ea1aa8 received from {username='slave'} at 127.0.0.1:54378
I20260709 13:15:18.026405 10260 tablet_copy_service.cc:434] P ab33f0a79ddf4f5a8ba81b3b0e120529: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-3955117b87304f9c9123136a32ea1aa8 on tablet 3955117b87304f9c9123136a32ea1aa8 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:18.036156 10323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54badd91404d4f7894752c8769345dca"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:18.036738 10323 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.037096 10323 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:18.039839 11001 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:18.051674 10323 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:18.055979 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:18.056703 10393 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:18.057087 10393 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:18.058064 10393 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:18.059439 10393 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:18.055864 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:18.063510 10243 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:18.073038 10243 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:18.077787 10393 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:18.078306 10323 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:18.080747 10144 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.083412 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:18.085018 11808 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:18.085706 11808 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:18.086802 11808 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:18.098747 11606 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:18.111780 10146 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 3, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.123031 11802 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:18.124249 11802 tablet_bootstrap.cc:492] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:15:18.125044 11802 ts_tablet_manager.cc:1403] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.197s	user 0.066s	sys 0.074s
I20260709 13:15:18.129738 10996 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:18.131016 10392 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:18.140235 11802 raft_consensus.cc:359] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:18.145202 11802 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:15:18.145911 11802 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:18.147446 10243 raft_consensus.cc:2955] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:18.165337 11802 ts_tablet_manager.cc:1434] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:15:18.178054 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-5315e843bcf14730b0299b712eab40d0 received from {username='slave'} at 127.0.0.1:38154
I20260709 13:15:18.178674 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-5315e843bcf14730b0299b712eab40d0 on tablet 5315e843bcf14730b0299b712eab40d0 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:18.175444 10144 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 2 to 6, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.213145 10996 raft_consensus.cc:1217] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:18.242952 10996 raft_consensus.cc:1217] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:15:18.250406 11727 raft_consensus.cc:993] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:18.251076 11605 raft_consensus.cc:1081] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:18.252693 10393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:18.253252 10393 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.253587 10393 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.260751 10393 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.263986 10393 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:18.264494 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:18.265128 10996 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.263564 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:18.265951 10243 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:18.266337 10243 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:18.267410 10243 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.268709 10243 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.272749 10996 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:18.274343 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:18.275151 11786 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.276259 10243 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:18.276692 11786 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:18.280471 11786 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.291384 10996 raft_consensus.cc:1217] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:18.292100 10144 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.382120 10996 raft_consensus.cc:1217] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:15:18.432454 10996 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:18.433786 11765 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:18.470888 10323 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:18.473451 11727 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:18.535105 10243 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.536725 11606 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.547705 10393 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.549623 11606 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.677364 10243 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:18.678787 11599 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:18.690984 10996 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:18.693606 11705 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:18.713421 11727 raft_consensus.cc:1064] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:18.715890 11727 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.728672 11605 raft_consensus.cc:1064] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:18.738046 11605 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.742584 10392 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:18.743188 10998 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:18.756459 10319 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:18.764364 11765 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:18.779485 10392 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:18.783162 10998 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:18.791585 10323 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:18.808060  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:18.819221 11786 raft_consensus.cc:1064] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:18.822047 11786 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:18.775934 11835 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:18.824437 11605 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:15:18.829214 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 48962.3us
I20260709 13:15:18.835443 11727 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.837141 10996 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:18.839505 11765 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.841146 10243 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:18.841753 10323 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:18.841850 11765 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:18.842152 11819 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.843297 11705 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.856065 11819 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:15:18.865011 11836 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:18.905956 11000 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:19.077426 11786 raft_consensus.cc:1064] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:15:19.256844 11786 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:19.838124 11843 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.877s	user 0.002s	sys 0.000s
W20260709 13:15:19.862340 11845 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.641s	user 0.002s	sys 0.000s
W20260709 13:15:19.866631 11846 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:15:20.148413  9152 debug-util.cc:398] Leaking SignalData structure 0x7b080000f2e0 after lost signal to thread 10323
W20260709 13:15:20.149189  9152 kernel_stack_watchdog.cc:198] Thread 10323 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 298ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:15:20.452723 10148 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 301) took 1563 ms. Trace:
I20260709 13:15:20.453452 10148 rpcz_store.cc:276] 0709 13:15:18.889346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.899916 (+ 10570us) service_pool.cc:224] Handling call
0709 13:15:20.452580 (+1552664us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:15:20.531878 10146 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:20.712877 11854 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.713726 11854 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:20.716845 10323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.867s	user 0.025s	sys 0.016s
I20260709 13:15:20.716998 11854 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:20.718762 10323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.869s	user 0.025s	sys 0.018s
I20260709 13:15:20.719493 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1672) took 1872 ms. Trace:
I20260709 13:15:20.719842 10323 rpcz_store.cc:276] 0709 13:15:18.847142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.847353 (+   211us) service_pool.cc:224] Handling call
0709 13:15:18.847947 (+   594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.848301 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.848329 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.849273 (+   944us) log.cc:844] Serialized 564 byte log entry
0709 13:15:20.719087 (+1869814us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:20.719117 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.719223 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.719264 (+    41us) raft_consensus.cc:1685] finished
0709 13:15:20.719275 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.719411 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1869538,"threads_started":1,"wal-append.queue_time_us":395817,"wal-append.run_cpu_time_us":2443,"wal-append.run_wall_time_us":1002455}
I20260709 13:15:20.729333 11856 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:20.730316 11856 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.733422 11856 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.736253 11856 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:20.737021 11856 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.737444 11860 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:20.738153 11860 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.739660 11856 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.740332 11856 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:20.740455 11860 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.741073 11860 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:20.741731 11860 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:20.745052 11860 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.741883 10146 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 199) took 1806 ms. Trace:
I20260709 13:15:20.740971 11856 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.750020 11856 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.746452 10146 rpcz_store.cc:276] 0709 13:15:18.935744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.935956 (+   212us) service_pool.cc:224] Handling call
0709 13:15:20.741793 (+1805837us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:20.716018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:20.716849 (+   831us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:20.716886 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:15:20.716906 (+    20us) tablet.cc:662] Decoding operations
0709 13:15:20.717285 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:20.717361 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:20.717390 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:20.717604 (+   214us) tablet.cc:701] Row locks acquired
0709 13:15:20.717623 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:15:20.717782 (+   159us) write_op.cc:270] Start()
0709 13:15:20.717908 (+   126us) write_op.cc:276] Timestamp: P: 1783602920717729 usec, L: 0
0709 13:15:20.717931 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:20.718644 (+   713us) log.cc:844] Serialized 599 byte log entry
0709 13:15:20.728473 (+  9829us) op_driver.cc:464] REPLICATION: finished
0709 13:15:20.735395 (+  6922us) write_op.cc:301] APPLY: starting
0709 13:15:20.735481 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:20.735583 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:20.735718 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:20.735945 (+   227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:20.736133 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:20.736201 (+    68us) write_op.cc:312] APPLY: finished
0709 13:15:20.736404 (+   203us) log.cc:844] Serialized 23 byte log entry
0709 13:15:20.736604 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:20.736689 (+    85us) write_op.cc:454] Released schema lock
0709 13:15:20.736727 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1499445,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":6702,"num_ops":1,"prepare.queue_time_us":3922,"prepare.run_cpu_time_us":3561,"prepare.run_wall_time_us":3777,"raft.queue_time_us":6871,"raft.run_cpu_time_us":6573,"raft.run_wall_time_us":6962,"replication_time_us":10414,"thread_start_us":25055,"threads_started":4,"wal-append.queue_time_us":1040}]]}
I20260709 13:15:20.755795 11861 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.756541 11861 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.759023 11861 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:20.768391 10243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.868s	user 0.010s	sys 0.023s
W20260709 13:15:20.768863 10243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.869s	user 0.010s	sys 0.023s
I20260709 13:15:20.769804 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 1662) took 1891 ms. Trace:
I20260709 13:15:20.770277 10243 rpcz_store.cc:276] 0709 13:15:18.878001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.878213 (+   212us) service_pool.cc:224] Handling call
0709 13:15:18.878752 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.898772 (+ 20020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.898807 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.899797 (+   990us) log.cc:844] Serialized 564 byte log entry
0709 13:15:20.769279 (+1869482us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:20.769340 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.769440 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.769501 (+    61us) raft_consensus.cc:1685] finished
0709 13:15:20.769520 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.769668 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1869126,"threads_started":1,"wal-append.queue_time_us":267773}
I20260709 13:15:20.780418 11861 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.781289 11861 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.785228 11861 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.787307 11868 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:20.778800 11866 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.789460 11870 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.789608 11866 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.790118 11870 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.792209 11866 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.793366 11870 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:20.785764 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1682) took 1945 ms. Trace:
I20260709 13:15:20.797583 10319 rpcz_store.cc:276] 0709 13:15:18.840486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.843839 (+  3353us) service_pool.cc:224] Handling call
0709 13:15:18.844374 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.844718 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.844747 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.845757 (+  1010us) log.cc:844] Serialized 564 byte log entry
0709 13:15:20.785231 (+1939474us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b5400298c20. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a52090 00007f58c3a5f6b8 00007f58c3ae892b 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c
0709 13:15:20.785288 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:20.785335 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:20.785410 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.785451 (+    41us) raft_consensus.cc:1685] finished
0709 13:15:20.785461 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.785705 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18829056,"thread_start_us":54512,"threads_started":1,"wal-append.queue_time_us":49771,"wal-append.run_cpu_time_us":2069,"wal-append.run_wall_time_us":1013241}
I20260709 13:15:20.802119 11861 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.803712 11861 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.805945 11861 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.808210 11863 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:20.808807 11863 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.795531 11868 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.811102 11863 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.812664 11868 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.803341 11864 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:20.817514 11863 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:20.818274 11863 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.820547 11863 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.822566 11863 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:20.813660 11864 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.823212 11863 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.824971 11864 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.832221 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 333) took 1984 ms. Trace:
I20260709 13:15:20.832688 10996 rpcz_store.cc:276] 0709 13:15:18.847358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.850054 (+  2696us) service_pool.cc:224] Handling call
0709 13:15:18.850884 (+   830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.851383 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.851426 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.853170 (+  1744us) log.cc:844] Serialized 564 byte log entry
0709 13:15:18.958374 (+105204us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:18.958441 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.958556 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.831989 (+1873433us) raft_consensus.cc:1685] finished
0709 13:15:20.832006 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.832134 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":104664,"threads_started":1,"wal-append.queue_time_us":105115}
I20260709 13:15:20.835529 11866 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.837347 11866 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.839381 11866 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:20.835345 11868 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:20.840155 11868 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.842335 11865 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.842914 11865 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.842036 11868 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:20.825207 11863 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:20.856961 11875 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:20.858814 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:20.890317 10996 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:20.848229 11871 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:20.891242 11871 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.848553 11868 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:20.894601 11868 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.897275 11868 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.860157 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:20.846562 11870 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:20.898787 11870 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.876565 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:20.900146 11002 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:20.859114 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:20.900578 11875 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.903761 11870 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.897917 11868 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:20.904693 11868 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:20.908210 11868 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.908929 11868 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.846808 11866 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.909431 11868 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.909705 11866 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:20.894030 11871 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.846465 11865 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.911747 11866 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:20.911851 11875 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:20.915920 11868 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.039337 11872 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.039846 11872 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.041497 11872 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.092553 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:21.112354 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:21.167732 11856 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.114538 11877 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.183689 11870 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:21.184434 10318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.275s	user 0.072s	sys 0.106s
W20260709 13:15:21.185076 10318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.276s	user 0.072s	sys 0.107s
I20260709 13:15:21.186658 11876 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.186909 11873 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.187512 11861 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:21.188515 11861 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.188993 11866 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.189097 11861 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.190616 11867 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:20.845934 11711 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.192855 11875 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.193253 11854 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.190661 11865 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.194631 11871 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.194623 11854 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.195312 11865 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.195982 11871 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.186934 11869 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.185001 11868 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.169184 11856 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.179586 11874 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.178890 11877 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.193765 11875 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.185240 11870 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.212968 11860 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.214318 11860 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.187669 11876 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.191987 11867 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.189987 11866 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.219619 11869 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.233824 11879 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.217975 11860 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.207828 11711 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.229660 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1683) took 2319 ms. Trace:
I20260709 13:15:21.245106 11870 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.248864 11866 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.249891 11869 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.231603 11854 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.235827 11871 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:21.207216 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 93244us
I20260709 13:15:21.187793 11873 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.303182 11711 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.268818 11860 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:21.309391 11865 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.266760 11868 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.295715 11871 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.311906 11879 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.316502 11881 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.317360 11875 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.319000 11879 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.320040 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:21.320884 11871 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.322583 11864 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.322834 11882 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.323518 11864 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.305774 11860 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.324079 11871 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.241940 10318 rpcz_store.cc:276] 0709 13:15:18.880265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.880446 (+   181us) service_pool.cc:224] Handling call
0709 13:15:18.881008 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.907490 (+ 26482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.907535 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.909214 (+  1679us) log.cc:844] Serialized 564 byte log entry
0709 13:15:21.185939 (+2276725us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:21.186048 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.186272 (+   224us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.186369 (+    97us) raft_consensus.cc:1685] finished
0709 13:15:21.186386 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.199299 (+ 12913us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2276064,"threads_started":1,"wal-append.queue_time_us":812485,"wal-append.run_cpu_time_us":3456,"wal-append.run_wall_time_us":1151734}
I20260709 13:15:21.333024 11868 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.318145 11875 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.337379 11875 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.341305 11875 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.343174 11856 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.344074 11873 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.345901 11877 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.327086 11870 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.324590 11865 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.347438 11880 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.348076 11865 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.331907 11860 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:21.323817 11882 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.322659 11874 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.345903 11867 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.348364 11880 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.347445 11870 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.355485 11871 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.383563 11871 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.317420 11881 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.377482 11887 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.378810 11888 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.379415 11886 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:21.376168 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.114s	user 0.035s	sys 0.100s
I20260709 13:15:21.380756 11876 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.382103 11863 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.382303 11872 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.373391 11873 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.396452 11000 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:15:21.396579 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.150s	user 0.036s	sys 0.101s
I20260709 13:15:21.397102 11879 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.397184 11881 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.367012 11874 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.401520 11866 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.401790 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:21.401885 11882 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.402966 11854 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.403483 11869 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.374042 11856 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.428400 11879 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.393069 11867 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.430992 11891 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.431115 11866 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.436736 11869 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.392519 11886 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.415472 11872 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.434032 11882 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.432243 11001 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:21.415495 11873 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.431769 11887 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.467629 11865 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.660454 11882 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.439322 11869 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.610092 11870 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.663937 11882 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.647847 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:21.441660 11884 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.667624 11873 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.665748 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:21.439677 11856 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.437987 11880 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.434155 11854 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.670559 11894 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:20.846691 11819 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.674954 11872 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.439898 11878 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.627872 11871 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.608623 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:21.647310 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:21.668249 11884 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.482023 11864 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.688584 11895 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.684782 10396 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:21.463137 11881 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.583793 11711 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.463202 11883 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.680518 11879 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.440289 11867 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.694499 11872 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.705801 11903 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.706007 11872 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.466529 11863 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.711016 11900 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:21.689420 11819 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.689424 11895 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.626060 11888 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.704867 11887 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.711220 11878 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.711061 11884 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.776805 10399 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
W20260709 13:15:21.841603 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 144559us
I20260709 13:15:21.837857 11860 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.863058 11860 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:20.846098 11795 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.864600 11795 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.839583 11866 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.871506 11888 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.719692 11711 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.706588 11903 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.792755 11864 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.837505 11883 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.876101 11877 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:21.853665 11861 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.664s	user 0.015s	sys 0.003s
I20260709 13:15:21.793992 11881 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.704332 11891 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:21.853399 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08000ecc80 after lost signal to thread 9150
I20260709 13:15:21.855340 11896 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:21.719327 11894 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.880750 11863 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.902645 11864 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.904026 11883 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.832921 11900 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.903187 11867 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.887763 11905 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.910204 11002 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:21.918398 11913 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.895960 11873 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.921362 11898 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:21.886502 11861 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.947070 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:21.949646 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:21.949885 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:21.950688 10323 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:21.951083 11877 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:21.951617 11795 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.952261 11795 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.950541 10319 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:21.914734 11856 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:21.950626 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 79866.6us
I20260709 13:15:21.963490 11889 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:21.963896 11900 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:21.964221 11889 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:21.967648 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:21.993165 11897 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:22.021122 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 60159.2us
I20260709 13:15:21.994047 11897 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.036474 11913 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.039307 11913 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.953032 11795 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.039103 11898 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.067250 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.039765 11873 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.071012 10319 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.071063 11912 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:22.030634 11908 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:21.967267 11889 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:21.995432 11869 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.013509 11864 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.060768 11900 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.059967 11911 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.086635 11902 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:22.086944 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.034278 11819 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.087692 11795 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:22.076370 11908 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.087473 11902 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.084553 11910 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.098214 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:22.091076 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.077075 11863 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.059710 11872 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.089753 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.079206 11913 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.106923 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.107267 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.057777 11916 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.103667 11897 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.085139 11711 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:21.982954 11896 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.112418 11914 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.112258 11863 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.114440 11881 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.104130 11908 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.119105 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.098657 11907 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.021359 11905 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.084182 11889 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.120321 11864 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.122172 11917 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:22.122577 11904 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.122373 11913 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.140200 11001 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:22.123621 11886 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.127143 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.125456 11819 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.128623 11877 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.117679 11878 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.132522 11902 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.105664 11869 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.135357 11889 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.120198 11914 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.071902 11912 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.142302 11795 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.147769 11864 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.148172 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.147815 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.117429 11900 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.142709 11916 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.156309 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.135232 11907 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.159606 10999 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:22.169585 10392 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:22.103444 11910 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.192167 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.154985 11886 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.155611 11904 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.139709 11911 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.157950 11917 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.249600 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.230425 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.188720 11894 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.256408 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.255316 10247 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:22.259534 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.260085 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.260430 10391 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:22.260865 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.261567 10996 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:22.262055 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.262712 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.263309 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.261587 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.200187 11895 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:22.247943 11024 debug-util.cc:398] Leaking SignalData structure 0x7b0800263280 after lost signal to thread 10182
I20260709 13:15:22.266970 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.267385 11910 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.268666 11001 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:22.297341 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:15:22.297966 11024 debug-util.cc:398] Leaking SignalData structure 0x7b0800354060 after lost signal to thread 10274
I20260709 13:15:22.274973 10241 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:22.301045 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.200412 11866 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:15:22.250938 11891 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.301045 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.306156 10321 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.252343 11907 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.307083 11901 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.309908 11865 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.325188 11865 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.325639 11865 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.317046 11911 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.317436 11869 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.323056 11873 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.327373 11916 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.327952 11904 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.328354 11864 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.329213 11900 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.341620 11917 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.329274 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.342348 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.342981 10996 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:22.310175 11863 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.331568 11912 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.343451 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.333055 11795 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.344136 11795 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.344784 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.336203 11898 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.335690 10244 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:22.339850 11901 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.344852 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.339164 11896 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.347476 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.348086 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.348308 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.348840 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:22.349224 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.347354 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.308925 11886 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:22.348634 11905 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.357307 10245 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.357808 11886 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.335443 11854 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:22.358459 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 44449.2us
I20260709 13:15:22.358701 11867 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.359153 11867 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.359539 11867 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.353521 10250 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.354008 10241 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:22.362942 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.363231 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.363694 10317 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:22.363787 10321 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.365998 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.352083 11908 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.424638 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.403082 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:22.403810 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.402577 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.366480 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.409228 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.413452 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.461241 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.373428 10321 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:22.395874 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.399945 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.404220 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:22.373772 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.463657 10325 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.383909 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.373414 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.372002 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.466120 10319 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:22.468051 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.406421 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.468096 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.467233 10244 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:22.470340 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.470948 10317 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.470196 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.469051 10324 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.375653 11913 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.375257 11861 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.377399 11889 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:22.400626 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08003533a0 after lost signal to thread 10349
I20260709 13:15:22.405699 11906 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:22.477638 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.431517 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.479274 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.478488 10396 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.460495 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.480746 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.405419 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.416052 11914 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.488385 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.386409 11903 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:22.408555 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:22.482635 10996 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.375263 11901 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.469700 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:22.484527 10364 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.617s (SENT)
I20260709 13:15:22.484767 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.507668 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.487604 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.486033 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.488799 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.484987 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.495347 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.509641 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.511847 10998 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:15:22.498884 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.499902 10318 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:22.500511 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.489259 11000 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:22.502157 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.509418 10244 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.509207 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:22.514051 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.512107 10993 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:15:22.515530 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.515780 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.530300 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.531262 10241 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:22.533404 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:22.533654 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08003578c0 after lost signal to thread 10423
I20260709 13:15:22.537070 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.538189 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.538843 10244 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:22.541002 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.540365 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:22.543850 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 61212us
I20260709 13:15:22.545712 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.546314 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.546963 10246 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:22.547694 11908 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.547787 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.549975 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.550601 10318 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.551121 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.551362 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.551738 10323 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:22.552472 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.553725 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.552623 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.555068 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.546423 10321 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.401954 11892 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.562601 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.565330 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.566725 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:22.560571 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe960 after lost signal to thread 11027
I20260709 13:15:22.567358 10318 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.544750 10320 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:22.570196 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.570477 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.552701 11865 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.572197 10398 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.574024 11865 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.575896 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.577713 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.578678 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.578934 11000 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:15:22.579185 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.580010 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.581423 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.491766 11906 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.581555 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.584183 10325 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:22.584122 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.587750 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.590580 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.591264 10395 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.587213 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.594650 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.570391 11795 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.599136 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.599844 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.604219 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.604990 10317 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:22.608129 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.608940 11002 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.614585 10994 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.614827 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.590965 11906 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.616202 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:22.614895 11795 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.622645 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.630208 10246 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:22.627642 11867 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.628180 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.628965 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.632907 11867 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:22.633725 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.634047 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.634429 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.634701 10396 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:22.629570 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.624450 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.636317 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.636559 10996 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:22.637703 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.638518 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.638592 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.639189 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.640125 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.640859 10316 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:22.641204 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.641400 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.640880 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.643810 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.644299 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.645344 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.649099 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.650460 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.640152 10965 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:22.631649 10146 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.650691 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:22.654016 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 51589us
I20260709 13:15:22.661070 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.662029 10317 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:22.664345 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.654597 11795 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.665180 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.659451 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.669641 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.670207 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.673393 10244 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.666334 11795 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.680649 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.680389 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.669626 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.679613 11795 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.683414 10244 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.686528 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.691355 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.695941 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.696300 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.696009 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.699086 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.701540 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.701874 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.708455 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:22.718508 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.723464 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.727428 10996 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.730389 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.730422 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.731446 10394 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:15:22.731700 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.731972 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.732360 10250 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:22.733237 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.733927 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.735524 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:22.735661 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.738348 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.739516 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.740084 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.740574 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.741205 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.741653 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.738456 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.745126 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.749564 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:22.750849 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.752264 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.753428 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.754577 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:22.755623 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:22.756588 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:22.757393 11879 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.757794 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:22.757982 11879 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.761670 11879 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:22.762180 11861 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.762665 11861 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.763082 11861 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:22.764210 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.765098 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.765496 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.765686 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.758441 11795 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.766930 10398 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.768086 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.768431 11795 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:22.758457 11854 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.769256 11854 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:22.769783 11854 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:22.759626 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.770328 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.758992 10394 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:22.776364 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 67100.8us
I20260709 13:15:22.784087 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.784153 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.786450 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.788172 10317 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.790665 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.792131 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.794595 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.783231 11914 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.795389 11914 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.795840 11914 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:22.798000 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.782572 11908 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.800076 11908 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:22.799309 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.800501 11908 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.802860 10250 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:22.786564 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:22.805938 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.807339 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.806586 11002 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.815785 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.822662 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.822965 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.825382 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.825884 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:22.826216 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.827009 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.827678 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.828125 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:22.828378 10967 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:22.824913 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.829470 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.831228 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.832326 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:22.832641 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.833236 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.833431 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.834056 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.834187 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.834510 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.835125 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:22.835649 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:22.835808 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:22.836513 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.837281 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.833918 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:22.844254 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:22.838590 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:22.831055 11878 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.843072 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.838682 10321 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:22.857118 10967 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:22.870823 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:22.871999 10395 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:22.879504 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:22.870365 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:22.857645 11878 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:22.909500 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 77263.3us
I20260709 13:15:22.865310 11866 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:22.908088 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 168779us
I20260709 13:15:22.917209 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:22.928932 11865 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.929148 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:22.929466 11865 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:22.929977 11865 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.931551 11886 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:22.925180 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:22.933763  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:22.940243 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:22.924134 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:22.911607 11878 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:22.887019 11854 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.911829 11866 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:22.950768 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71912.1us
I20260709 13:15:22.922804 11856 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:22.909260 11913 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:22.939149 11898 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:22.952062 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:22.979406 11901 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:22.979975 11901 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:22.980435 11901 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.980098 11867 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:22.982034 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 128748us
I20260709 13:15:22.978124 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:22.966544 11866 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:22.960564 11905 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:22.965613 11856 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.024374 11898 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:23.025364 11928 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:15:22.972309 11914 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:22.983284 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.022730 11906 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:23.036067 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 58048.6us
W20260709 13:15:23.039768 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56554.7us
I20260709 13:15:23.032873 11856 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.038122 11906 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:23.042686 11860 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.047000 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.015532 11879 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:22.955717 11861 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:23.103768 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 172740us
I20260709 13:15:23.050100 11908 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.124981 11892 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.125483 11892 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:23.125936 11892 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:23.126063 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 148512us
I20260709 13:15:23.097162 11866 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:23.126943 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 186705us
I20260709 13:15:23.127202 11906 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:23.124830 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 267803us
I20260709 13:15:23.129029 11889 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:23.129390 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.073391 11854 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:23.127285 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 80367.2us
I20260709 13:15:23.075165 11914 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.130295 11938 raft_consensus.cc:3055] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.130450 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.130693 11938 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:23.067974 11886 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.131320 11854 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:23.131570 11886 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:23.132143 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.131778 11938 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.132638 11886 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.133853 11888 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.096815 11903 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.134353 11888 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.134874 11888 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.076201 11865 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.136121 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.136433 11938 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.136766 11939 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.127528 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:23.137113 11865 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.138139 11930 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.138587 11930 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.138955 11930 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.139533 11903 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.140009 11903 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.140466 11879 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.141024 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.142647 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:23.143508 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 189740us
I20260709 13:15:23.143709 11936 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.144236 11936 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:23.144618 11936 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.145625 11944 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:23.130748 11860 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.149260 11860 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.150110 10364 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:23.150211 11939 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.151401 11861 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.153637 11942 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.154035 11942 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.154429 11942 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.154800 11908 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.155308 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:23.156265 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.092893 11901 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.157387 11865 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.157483 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.156538 11944 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.136730 11866 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.158299 11944 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.158996 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.159289 11901 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.149216 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.133980 11886 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.160709 11914 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.160791 11906 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.164328 11861 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.161338 11935 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.161655 11866 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.164809 11861 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.165727 11861 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.162433 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:23.162706 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.159008 11944 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.167176 11906 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.168289 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.131803 11854 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.148912 11930 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.179266 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.179781 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:23.180099 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.180764 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.181528 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:23.185273 11941 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.188480 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:23.184602 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 147239us
I20260709 13:15:23.186300 11914 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.186517 11865 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.187161 11884 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:23.191141 11865 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.191565 10288 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.188048 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.191861 11865 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.192580 11914 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.186841 11908 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.191290 11884 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.185544 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:23.170935 11878 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.212813 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:23.217849 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 54055.2us
I20260709 13:15:23.215301 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.215463 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.178627 11935 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.234541 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.178597 11854 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.236886 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:15:23.239441 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53966.5us
I20260709 13:15:23.240794 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.241982 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.242074 11951 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.210961 11866 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:23.217567 11884 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.246436 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:23.247426 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.248577 11953 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.217231 11867 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:23.217234 11946 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.257392 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.234700 11887 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.237159 11905 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.265208 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.266959 11942 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.255187 11819 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:23.254174 11866 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.271081 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.269579 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.258035 11867 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.261548 11951 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.263134 11887 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:23.283147 11956 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:23.285746 11954 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.279479 11889 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.287457 11887 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.275887 11906 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.272984 11866 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.278223 11867 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.298883 11878 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:23.325474 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 101683us
W20260709 13:15:23.333269 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49397.7us
I20260709 13:15:23.270406 11905 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.300436 11930 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:23.313835 11819 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.297972 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.331453 11906 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.345837 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.346611 11002 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 2: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:23.333526 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:23.334529 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:23.343429 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 74842.9us
W20260709 13:15:23.348214 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 63911.5us
W20260709 13:15:23.346849 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48996.5us
I20260709 13:15:23.351038 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.360437 11960 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.361002 11960 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:23.361372 11960 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.361406 10967 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.362984 11941 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:23.370183 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 135350us
I20260709 13:15:23.371718 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.298123 11952 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.344513 11819 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:23.382416 11942 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:23.349099 11906 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:23.388861 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54425.5us
I20260709 13:15:23.360507 11908 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.392159 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.388048 11819 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.389802 11951 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.428582 11903 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.432091 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.405421 11879 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:23.442926 11879 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.443353 11879 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.383348 11952 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:23.457109 10247 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:23.452514 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 84363.6us
I20260709 13:15:23.458432 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:23.437448 11865 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.445824 11888 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:23.467027 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 77505.9us
W20260709 13:15:23.468591 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 135145us
W20260709 13:15:23.473984 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.476641 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.479050 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.479696 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.481293 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.455102 11952 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.482465 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.472656 11951 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.479030 11946 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:23.478593 11913 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:23.492935 11946 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.492839 11860 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.493358 11913 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.495213 11946 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.495390 11913 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.497514 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:23.498368 11930 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.498837 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:23.499032 11930 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.481542 11954 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.499702 11930 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.500329 11865 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:23.496614 11936 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.507915 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.502454 11966 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:23.504814 11903 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.500801 11957 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.468073 11953 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:15:23.529222 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50255.7us
I20260709 13:15:23.530378 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:23.510432 11865 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.535027 11942 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.531783 11854 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.536463 11888 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.568982 11854 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.569481 10245 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.541055 11879 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.571029 11860 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.573074 11879 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.575704 11953 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.576113 11953 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:23.536564 11866 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.565706 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.578351 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:23.579519 11000 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.579968 11914 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:23.581957 11914 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.582346 11965 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.583104 11965 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.582350 11914 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:23.580245 11866 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:23.583742 11861 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.584252 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.586710 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.589421 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.570171 11867 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.590797 11861 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.527328 11959 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.537892 11892 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.600178 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.588096 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.600670 11856 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.600688 11867 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:23.595789 11951 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:23.584991 11914 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.630162 11938 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.630846 11914 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.632223 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.634270 11856 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.634521 11951 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:23.636899 11951 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.615461 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.615859 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.616214 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.619215 10397 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.640864 11939 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.640544 11884 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.643162 11905 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:23.641176 10148 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.622639 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.645079 11963 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.625662 11861 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:15:23.628438 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:23.646241 11861 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.646622 11861 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:23.586032 11953 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.647581 11953 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.647394 11861 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.585364 11887 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.653827 10394 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.654884 11887 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.649016 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.656999 11903 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:23.643486 11952 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.621011 11819 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.640370 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:23.647585 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.660952 10244 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:23.661765 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.564361 11957 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:23.662663 10392 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.637850 11906 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.645519 11884 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:23.652976 11861 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.661999 11819 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.663482 10248 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.664312 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.665607 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:23.667102 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 295491us
I20260709 13:15:23.625079 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.692422 11906 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.674520 11905 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:15:23.665289 11963 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.694175 11905 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.694653 11905 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:23.666522 11887 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.695657 11905 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:23.697829 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 72821.1us
I20260709 13:15:23.699904 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:23.700347 11887 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:23.686842 11889 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:15:23.714641 11960 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.715814 11889 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.716228 11889 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:23.716758 11886 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 13:15:23.717039 11889 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.717552 11960 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.718187 11936 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.718632 11889 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:23.719935 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54404.6us
I20260709 13:15:23.710348 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.703832 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:23.702128 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.713654 11952 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.660212 11966 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:23.725742 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.722018 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.727221 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.727377 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.702597 11856 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.732163 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.727347 11966 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.810736 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:23.811144 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 82378.9us
I20260709 13:15:23.811921 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.812402 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.813017 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.813947 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.730084 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.715886 11892 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.689049 10244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:23.815371 10244 raft_consensus.cc:606] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:15:23.758868 11905 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.817143 11884 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.734668 11936 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.818818 11960 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.821286 10319 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:23.821583 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.824725 10249 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.825107 10241 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:23.826051 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.826378 10241 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.827080 10249 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.827523 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.724601 11951 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.730593 11903 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:15:23.727532 11886 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.795038 11969 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:23.796765 11971 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.123s	user 0.000s	sys 0.004s
I20260709 13:15:23.795514 10320 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:23.837834 11937 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.837973 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.838349 11937 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:23.690595 11957 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.831040 11936 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:23.839630 11957 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.839253 11937 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.663446 11944 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.724529 11908 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:15:23.727519 10248 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.798449 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:23.802418 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.730577 10250 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.783231 10247 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:15:23.814730 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.818907 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.844807 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:23.852028 10999 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.853921 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:23.837298 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0659642500002064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 13:15:23.857715 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.851614 10245 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.858534 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.859645 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.862170 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.863258 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.866526 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.866626 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.869026 11001 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.869647 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.868011 10288 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.851614 11884 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.846575 11937 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.871327 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.877313 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.859634 11819 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.878196 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.879142 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.877156 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:23.882900 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.889463 11930 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:23.860443 11951 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.891396 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.892246 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.893186 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.885432 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:23.886777 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.896291 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.897394 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:23.897881 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.888777 11865 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:23.884572 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.887089 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.899052 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.899309 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:23.860090 11960 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:23.881628 11952 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:15:23.900043 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.911720 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.885916 11889 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.881142 11965 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.890591 11930 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:23.914870 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.914945 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.894457 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.914403 11954 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:23.894984 11866 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.936632 11866 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:23.937682 11866 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:23.939049 11866 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.939659 11969 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.940105 11969 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:23.940985 11969 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:23.941881 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.916663 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.917131 10323 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.898329 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:23.852138 11936 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.919955 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:23.920397 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.921628 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:23.922576 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64880.3us
I20260709 13:15:23.922602 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.927698 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.933485 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:23.934288 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:23.936128 11939 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.919970 11906 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:23.955477 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.942898 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:23.945701 11967 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:15:23.946476 11905 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.915947 11966 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.967751 10399 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:23.918828 11819 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:15:23.968835 11966 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:23.970661 11905 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.942209 11969 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.973169 11905 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:23.951969 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0110642500001177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 13:15:23.953629 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:23.974900 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.952800 11939 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:23.959563 11938 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:23.962320 10245 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
W20260709 13:15:23.976879 10213 connection.cc:256] RPC call timeout handler was delayed by -1.000734310000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 13:15:23.977017 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:23.978130 10247 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:23.982002 11886 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:23.983731 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49560.6us
I20260709 13:15:23.987108 11939 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:23.988404 11939 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.993996 10999 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:23.994769 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.996680 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:23.962054 10997 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.999387 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:23.951308 11903 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:23.989797 11913 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.002830 11966 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:23.997200 11906 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.007290 11951 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.010823 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.012547 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.013634 11968 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.015196 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.016369 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.017398 11819 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.001503 11889 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.019896 11938 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.021934 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.028097 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:24.010902 11963 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.030357 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:24.031013 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.031708 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:24.033854 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:24.035656 11960 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.013643 11967 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.006125 10995 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
W20260709 13:15:24.039505 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.041757 10394 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:24.043329 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:24.043576 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.044286 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.045758 10391 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.026551 11903 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.038713 11886 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:24.032810 11963 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.039603 11856 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:24.032557 11953 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:24.057644 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.050036 11888 raft_consensus.cc:993] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:24.042111 11819 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:24.059742 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.061364 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.063827 10390 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.064402 11979 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.050266 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.068650 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.069761 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.069770 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.065567 11978 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.057765 11886 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.102891 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.104614 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:24.058521 11960 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.062387 11954 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.079672 11861 raft_consensus.cc:1081] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:15:24.119457 10395 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:24.109845 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.127416 11963 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.128265 10993 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:24.111662 10317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db7cef2154f4a63901d966c49530263"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:49594
I20260709 13:15:24.105437 10323 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:24.111074 11949 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.129292 11906 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.129690 11903 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:24.129912 10317 raft_consensus.cc:606] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.130739 11979 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.131115 11979 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.130296 11906 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:24.131965 11979 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.130326 10317 raft_consensus.cc:614] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:24.133319 10995 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.062688 11953 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.059434 11856 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:24.134465 11856 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.136022 11939 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:24.136749 11939 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.052912 11937 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:15:24.133095 11906 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:24.138583 11865 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.138959 11937 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.139084 11865 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.139541 11937 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:24.140077 11865 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.140386 11937 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.141480 11865 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.075455 11819 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.138900 11906 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.142949 11913 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.143695 11906 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.144493 11913 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.145531 11906 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.148272 11946 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.148664 11946 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.149143 11938 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.149509 11938 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.106338 11879 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:24.150673 11879 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:24.151067 11879 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.152534 11884 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.152944 11884 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.152987 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.106606 11888 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.155879 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.153836 11884 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:24.145610 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 60147.4us
I20260709 13:15:24.141557 11937 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.159282 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.165525 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.166462 10399 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:24.171267 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.149461 11946 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:24.160553 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 96807.3us
I20260709 13:15:24.172735 11892 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.194711 10994 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:24.196039 11949 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:24.200122 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.174507 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.163465 11939 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:24.199921 11884 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:24.181526 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.206911 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:24.209556 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 69260.9us
I20260709 13:15:24.215330 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.205765 11888 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.207233 11967 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.217473 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.217411 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.222014 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.226212 11953 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:24.217121 11949 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.202689 11938 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.214955 11819 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.231117 10997 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.232636 11983 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:24.217360 11892 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.234689 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.219349 11946 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.238022 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.238140 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.246142 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.238742 11888 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.237084 11983 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.240264 11879 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.248725 11983 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.249302 11879 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:24.249666 11892 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.208981 11886 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.223973 11968 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.252300 11886 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:24.249933 11879 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.256417 11963 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.243655 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.260006 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.262054 11944 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:24.263871 11879 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.264401 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:24.262117 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.265050 10249 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:24.268201 11879 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.268791 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.264451 10246 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.265376 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:24.267156 11942 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.272397 11942 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.272502 11865 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.273380 11942 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.275003 11942 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.278805 11865 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:24.279160 11887 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:24.279574 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.280169 11954 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:24.280390 11981 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.280635 11954 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.280813 11981 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.281697 11954 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.281718 11981 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.282828 11954 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.283119 11981 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.283317 11938 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:24.290033 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 43988.3us
I20260709 13:15:24.291766 10246 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:15:24.294575 10399 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.295378 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.296170 10392 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:24.297345 10390 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.298075 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:24.298981 10994 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:15:24.301090 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.301620 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.302044 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.303061 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:24.303231 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.303565 11865 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.304064 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:24.304922 10316 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:24.305588 11888 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.306320 11888 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.307607 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:24.304008 10391 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:24.311765 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.312002 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.299402 11968 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.313985 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.314769 11982 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.314810 11957 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.318565 11879 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.316175 11985 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:24.322824 11985 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.323222 11985 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.324115 11985 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.324867 11856 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.327687 11856 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:24.327750 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.333364 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.334527 11903 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.337643 10391 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:24.298873 10993 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:24.330214 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.330937 11982 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:24.334569 11908 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.316733 11936 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:15:24.317461 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:24.325275 11985 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.339728 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.339764 11965 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:15:24.346393 11906 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.348237 10245 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.349299 11906 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.349689 11906 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.347193 11951 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.347571 11966 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.344108 11970 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.348565 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.354972 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:24.342736 11982 consensus_queue.cc:1243] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:24.356848 10391 raft_consensus.cc:606] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.356002 11966 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.357997 11936 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.358783 11966 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.359448 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:24.360216 11976 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 13:15:24.360407 11936 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.360641 11970 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.361667 11970 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.362807 11970 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.364780 10247 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.365125 10995 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:24.342470 11937 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:24.366921 11937 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:24.367303 11937 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.363382 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.368211 11979 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.368484 11936 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:24.369424  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:24.369793 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:24.343101 10320 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:24.360291 11966 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.370899 11944 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.371739 11944 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.372874 11944 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.382269 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.383077 11936 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.385970 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.386534 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:24.386971 11978 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.386806 10246 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.386050 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.387537 11978 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.388239 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.388594 11978 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.393142 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.395313 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.395658 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.396728 10395 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:24.413870 10323 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.386902 10249 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:24.423935 10390 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.425150 11903 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:24.416947 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.427153  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:24.437654 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.443130 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.446064 10392 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:24.427115 11936 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.428737 11946 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:24.397055 11968 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:24.440423 11939 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:24.457157 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.442202 11988 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:24.446957 10395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44068
I20260709 13:15:24.473461 10395 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.474050 10395 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.354810 11906 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.442262 11949 consensus_queue.cc:1059] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:15:24.455698 11968 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.477130 11936 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.460722 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.459218 11939 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:24.461270 11988 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.494623 10391 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:15:24.495141 11949 raft_consensus.cc:3055] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.495556 11949 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.495296 11988 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.453370 11982 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:24.454000 11889 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:15:24.496379 11949 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.497141 11982 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.488953 11906 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.489229 11968 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.456059 11981 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:15:24.484009 10249 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.460695 11946 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.503055 11981 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.505822 11913 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.512594 11966 raft_consensus.cc:993] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:24.513118 11966 raft_consensus.cc:1081] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:24.514846 11913 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.515271 11913 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.516847 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.494640 11939 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.519050 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:24.521265 10999 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:24.497524 11982 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.499706 10397 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.521569 10391 raft_consensus.cc:1813] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Handling vote request from an unknown peer cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.523984 10391 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:24.510548 11981 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:24.527411 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.527024 11913 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.518394 11946 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:24.524570 11968 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:24.539216 11981 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.539121 11982 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.523399 11949 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.520782 10320 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:24.546602 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.550598 11987 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:24.566741 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.567698 11959 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.551107 10395 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.551738 11957 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:24.560698 11993 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:15:24.561375 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.578095 10317 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.561640 10995 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:24.571950 11937 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.581776 10320 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.573966 10249 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:24.573796 11987 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:24.574690 11981 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.583694 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:24.588974 10247 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:24.583797 10323 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
W20260709 13:15:24.583765 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.582305 10320 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:24.590517 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 152967us
I20260709 13:15:24.597894 11982 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.603053 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.606994 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.591814 10397 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:24.623857 11937 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:24.640023 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.598452 11959 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.722321 11913 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.722982 11908 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.750070 11908 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.752422 11908 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:24.724989 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:24.725533 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 118617us
I20260709 13:15:24.754132 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.730566 10146 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.755821 11949 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.731794 11879 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.758456 11949 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.732333 10390 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.759426 11949 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.760005 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.732894 11988 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.761616 11856 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.762212 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:24.763871 11879 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.764330 11936 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.764992 11936 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.764904 11879 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.765957 11936 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.769253 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.772663 10321 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.779105 10395 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:24.780005 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:24.780970 10247 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.781348 10247 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.786217 10247 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.787114 10317 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:24.786563 10145 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:24.621572 11996 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.787271 10247 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.789296 11996 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.790441 11996 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.769358 11856 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:24.797071 10247 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:24.797330 10320 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.798506 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:24.799381 11979 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.799943 11979 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.801762 11979 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.738499 10148 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:24.812387 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:24.814791 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:24.817128 10148 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 4, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.818917 10148 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.822453 11968 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:24.761009 11939 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.826718 11939 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:24.826747 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.827925 10317 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.834853 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.836863 10317 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:24.846575 10392 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.851061 10320 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:24.852428 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.852797 10246 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.854585 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:24.855244 10995 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.861300 11987 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.866964 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:24.867257 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:24.867889 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:24.868633 10394 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:24.847101 11966 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:24.872961 10323 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:24.869297 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:24.848917 11906 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.876225 11939 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:24.876798 11939 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:24.876636 11906 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.877753 11939 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.878978 11906 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:24.880018 11966 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.880568 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:24.881196 10999 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:24.880997 11966 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:24.881531 10997 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:24.882505 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:24.872342 11981 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:15:24.883375 11988 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:24.884500 11988 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.884869 11988 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.884951 10997 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:24.886683 11981 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:24.848214 11968 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:15:24.891292 11953 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.891825 11953 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.892242 11968 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.892719 11968 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.893985 11953 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:24.896960 11987 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:24.897354 10390 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:24.897748 10390 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:24.898669 10390 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.903137 10996 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:24.904313 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.905194 10246 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:24.908203 10390 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.911198 10999 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:24.918900 10392 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:24.915745 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:24.923269 11970 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:24.923626 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:24.924335 10993 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:24.924577 10394 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:24.926362 11936 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.927510 11856 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.927875 11856 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:24.928763 11856 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.893522 11968 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.930399 11856 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.931056 11968 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:24.934703 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.947674 11949 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.951802 10320 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.958424 10321 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.958811 11998 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:24.959441 11998 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.959906 11998 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:24.962456 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 46781.3us
I20260709 13:15:24.963049 11970 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.958490 11953 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.966096 11953 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:24.970887 10320 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:15:24.977094 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 58150.1us
I20260709 13:15:24.983428 10397 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:24.982985 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:24.993345 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:24.999418 11905 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.000069 11905 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.003938 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.004850 10246 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.002609 11908 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:24.982337 11970 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:15:25.025246 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:25.028455 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.012023 11953 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.030810 10392 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.033488 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.018924 11905 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.034209 10394 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.014817 10995 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:25.027019 11908 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:25.032344 11937 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:25.040403 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:25.044517 11999 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.046418 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:25.045812 11905 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:25.042029 11937 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.051509 10390 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:25.045186 11999 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.054685 11953 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.060539 11953 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.061116 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.062268 10246 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:25.057559 11937 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.063040 11908 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.052237 11988 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.068107 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.068428 11988 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.069273 10317 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:25.049384 11905 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.070771 11905 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.074712 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.078969 11999 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.079974 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.080730 10392 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.050125 11987 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:25.088713 11937 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.134218 11913 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.137395 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.116678 11987 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:25.142760 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.143420 10246 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.141597 11987 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.114319 11998 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:25.149137 12008 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 13:15:25.137367 11913 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.153652 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.154068 10318 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:25.152475 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:25.155918 10323 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.155938 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:25.159456 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:25.153650 11998 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.154935 10245 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.161962 11939 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.167943 10317 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.178642 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:25.182588 12010 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 13:15:25.183061 11905 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.185679 10246 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.186484 11998 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:25.187731 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:25.189049 11913 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.189711 11913 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:25.190131 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.194465 10317 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:25.158674 11903 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:25.200516 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:25.210410 12014 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:25.192431 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.213752 10390 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.215395 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.199656 10997 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:25.221262 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:25.203869 10392 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.213830 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:25.200559 11953 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.224864 11906 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:25.204366 11999 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.225342 11906 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.225741 11906 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.232893 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.233554 10392 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.234521 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.235234 10394 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:25.225549 11999 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.238152 10146 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.239933 10146 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 3, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.241484 10146 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.243748 10146 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.222462 11998 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.251967 10323 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:25.233316 11937 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.235194 11953 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:25.255792 11998 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.234969 11968 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:25.235409 11979 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:15:25.269253 11953 raft_consensus.cc:697] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:25.269374 11856 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:15:25.300344 10245 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.302471 11953 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.307356 10390 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.308568 11939 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:25.310745 10996 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:25.312841 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:25.314994 11903 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:25.315501 11903 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:25.316020 11905 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.316394 11903 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.319427 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.320333 10394 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:25.326395 10245 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.330935 11939 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.309201 11999 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.335362 10246 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:25.337932 10397 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:25.339241 11981 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:25.344586 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.345199 10247 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.353367 10323 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.363082 10392 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.370472 11819 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.371009 11819 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.373267 11819 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:25.374924 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.375620 10242 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:25.378185 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:25.378401 10148 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.380507 11979 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:25.380985 11979 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.381376 11979 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.391443 11942 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.391989 11942 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.394109 11942 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.396643 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.419458 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.421940 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.411514 10148 catalog_manager.cc:5697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.420187 10320 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:25.427456 10323 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:25.439545 10319 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:25.419106 11987 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.444813 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:25.449760  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:25.448267 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.454344 11987 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.454734 11988 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.455272 11988 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.456537 11987 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.429987 11913 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.457376 11988 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.457340 11913 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.458115 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.451524 11981 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:25.460383 11981 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.460743 11981 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.461745 11913 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.461678 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.462648 10392 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:25.451690 11888 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:15:25.463989 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:25.464429 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.465108 11913 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:25.466732 10392 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:25.421962 11819 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.453161 10318 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:25.474680 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:25.471985 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 159225us
I20260709 13:15:25.478302 10246 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:25.481110 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.481767 10392 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.495414 12034 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:25.499240 10392 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:25.476156 11913 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.509229 10999 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:25.510051 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:25.447691 11998 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.516068 11968 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:25.517105 11997 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.519851 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:25.526849 10996 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:25.489902 11988 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:25.523083 11937 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:25.508790 11913 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:25.536046 11937 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:25.484603 11906 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.481160 11819 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.512861 11939 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.530889 10144 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.565584 11939 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.567672 11939 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.566994 10144 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.532051 11908 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:25.570413 11908 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.570863 11908 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.572482 11981 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.554198 11937 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.518008 11949 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:15:25.531777 11988 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.542999 10993 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:25.532346 11968 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:15:25.581987 10318 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.587111 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:25.587915 10996 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:25.587699 11939 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.579123 11988 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.596582 11913 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.576092 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.605659 10397 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.578708 10320 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.579326 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.567013 11936 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:25.611987 11936 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:25.613235 11936 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.614739 11987 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:25.614912 11936 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.615336 11987 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.617169 12025 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.617894 11987 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.618806 11970 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.619346 11970 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.562346 11906 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.620484 11906 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.598384 11957 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.620927 11906 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.621472 11957 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.579998 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.623274 10392 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.601893 11997 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:25.623550 11957 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.618505 11987 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:25.634569 11987 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.635555 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:25.625327 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.636686 11987 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.623564 11819 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:25.638185 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 56946.1us
I20260709 13:15:25.628316 11913 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.642622 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:25.633194 11981 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.626720 10397 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:25.635385 11979 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.668747 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.669955 10397 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:25.643942 12025 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:25.675958 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.681794 10246 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:25.685883 10364 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:25.687528 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.689266 10246 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.690372 11908 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.695202 11998 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.695963 11908 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.692600 12033 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.697314 12033 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.697733 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.698448 10392 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.701025 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.701831 10996 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:25.681582 12025 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.690946 11979 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:25.706828 12025 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.706964 11942 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:25.719208 11942 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.707039 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.720113 10245 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.721107 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.708032 11906 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.708323 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.723290 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.723722 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:25.724550 11970 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:25.725811 10246 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:25.727200 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.704469 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.728415 10397 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:25.705893 10390 raft_consensus.cc:2368] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:25.714598 11998 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.730604 11998 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.716535 10394 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.717475 11988 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.740195 10395 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:25.719650 11942 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.738884 11939 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.741036 11988 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.746452 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.742342 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:25.744755 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:25.681353 11949 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:25.748880 10392 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:25.748874 10246 raft_consensus.cc:2368] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:25.750403 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.751137 10247 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:25.753422 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.754070 10247 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:25.760700 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.761633 10247 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:25.763871 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:25.764708 10392 raft_consensus.cc:2368] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3.
I20260709 13:15:25.766966 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.769811 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.764734 11998 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:25.699615 12033 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.757737 11978 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:25.774585 10965 leader_election.cc:400] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3.
I20260709 13:15:25.774989 10965 leader_election.cc:403] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:25.775784 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.776438 10249 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.765465 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:25.761873 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.782851 10247 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:25.778116 10245 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.764556 11979 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:25.786499 10288 leader_election.cc:400] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:25.786986 10288 leader_election.cc:403] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:25.787811 11998 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.788646 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:25.790985 11979 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:25.791253 12039 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:25.795845 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:25.797127 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:25.806298 10320 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.806636 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:25.806941 11002 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.807272 10325 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.781520 10148 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.801573 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:25.808460 10395 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.803495 11988 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:25.815538 10319 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:25.762820 11906 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:25.818256 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.819451 10319 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:25.818102 11979 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.824120 10247 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:25.818082 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.825340 12033 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.825603 10319 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.825906 12033 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:25.826478 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:25.827018 11953 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:25.828684 10322 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:25.816754 10320 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:25.834529 10325 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:25.839397 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:25.840379 10394 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:25.840417 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:25.841972 10246 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:25.843362 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:25.809324 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:25.816021 11905 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.815851 11913 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:25.816743 11939 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.834527 11906 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:25.846354 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:25.863325 10395 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:25.851584 11987 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.847337 11949 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:25.856494 11978 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:25.862260 11999 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:25.881889 11949 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.841262 12025 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.884335 10319 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:25.877893 11978 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.862470 12038 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:15:25.856112 11939 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.896149 12034 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.896765 11968 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:25.856000 11913 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.879406 11987 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.888830 11949 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:25.904305 10249 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:25.902933 11966 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.899618 11999 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:25.925004 12046 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.855748 11905 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.942075 10996 raft_consensus.cc:2368] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:25.943720 12049 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:25.944624 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 83919.8us
I20260709 13:15:25.952047 11888 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:15:25.959257 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:25.946307 12047 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.904266 11978 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:25.951586 11970 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.970777 10320 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:25.907884 11981 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:15:25.957592 10390 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:26.003402 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 73956.1us
I20260709 13:15:25.957608 12039 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:25.966496 11819 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.019075 10290 leader_election.cc:400] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:25.950579 11968 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:26.013130 12010 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:25.999461 10320 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:26.018736 12054 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:25.922505 11906 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:25.951738 12034 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:26.016095 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 113528us
I20260709 13:15:25.958616 11966 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.026093 11819 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.055330 12056 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.059360 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:26.073839 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:26.021634 11979 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.998742 11970 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:26.085484 12037 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:15:26.028810 12039 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.029153 12038 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:26.085717 12049 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:25.967851 12046 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.092268 10324 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:26.070989 11957 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:26.094671 12039 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.096662 12034 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.097210 11819 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.097730 12039 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.099046 11939 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.097302 12034 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.087355 12028 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:15:26.087540 12040 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:15:26.094379 11981 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.127810 11981 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.014758 12047 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.130106 12047 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:26.108222 12043 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.218s	user 0.003s	sys 0.004s
I20260709 13:15:26.137713 12046 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:26.141036 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 121144us
I20260709 13:15:26.125571 12034 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.108844 11968 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.108259 11957 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:26.080951 12056 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.099505 12039 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.071493 11908 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:26.134987 11939 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:26.155232 11939 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.155735 11905 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.071218 12054 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.157485 11939 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:26.117343 12050 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:15:26.129961 11981 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.159124 12054 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.148217 10242 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:26.123508 12042 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:15:26.100358 11999 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.106695 12055 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.161469 12055 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.161515 11957 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.117650 12049 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:26.169036 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.169936 10242 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:26.089848 11979 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.163756 12055 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.125650 12038 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.142803 11936 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:26.168833 12039 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.149389 11996 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:26.157918 12056 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.173867 12054 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.201192 12054 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.203401 12054 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.143759 11949 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.190220 11905 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:26.169523 11942 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.193099 11970 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.193252 12033 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.193944 11936 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.217470 11936 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.194634 12025 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.217852 11942 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.196367 11966 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.218523 10399 raft_consensus.cc:2368] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:26.211736 11996 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.215111 11987 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.260003 12034 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.261619 11996 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.231426 11936 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.257001 11997 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.211519 11949 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.270910 11997 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.272348 12039 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.267208 11913 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.265395 11979 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:26.288414 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 329205us
I20260709 13:15:26.266474 12038 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.299728 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.302274 10996 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.316169 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.316956 10996 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.264070 11978 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.288055 11998 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3.
I20260709 13:15:26.277042 11936 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:26.301016 11997 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.345634 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.346683 10996 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.322635 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.354075  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:26.359563 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.360404 10996 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:26.364539 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.373394 10249 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.380505 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.381606 10325 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:26.384774 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:26.385556 10320 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.389372 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.390075 10317 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:26.400542 10320 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:26.371243 11978 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.394090 10249 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:26.415823 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.416745 10318 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:26.368770 10993 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:15:26.437680 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:26.407373 11949 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.405937 12034 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.417917 10288 leader_election.cc:400] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:26.454288 10288 leader_election.cc:403] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:26.447887 12033 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:26.435750 11953 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:15:26.461794 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 319867us
I20260709 13:15:26.466614 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.460500 12039 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:26.504024 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.459316 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:26.484340 12059 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.505679 10249 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
W20260709 13:15:26.506035 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 46845.6us
W20260709 13:15:26.508100 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 434357us
I20260709 13:15:26.484517 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.486749 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.486874 11957 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.464044 11942 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:26.454454 12034 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.481752 12049 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:26.462066 12054 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:26.499264 11936 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.459790 11987 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:26.509907 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:26.459281 10245 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.011s	sys 0.008s
I20260709 13:15:26.510728 11856 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.519451 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.520234 10288 leader_election.cc:400] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:26.520644 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.551717 10288 leader_election.cc:403] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:26.523890 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.551772 10392 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.552320 10395 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.524678 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.552994 10397 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.553210 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.553974 10395 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:26.553839 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.554447 10397 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:26.554659 10398 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:26.524780 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.555393 10391 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
W20260709 13:15:26.529067 10322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.032s	sys 0.035s
W20260709 13:15:26.555934 10322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.032s	sys 0.036s
I20260709 13:15:26.551921 10996 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:26.525666 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.558650 10394 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:26.529263 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.559155 10396 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.512995 12066 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:26.526624 11957 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.559312 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.546960 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.566843 10393 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.548811 10249 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:26.571329 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:26.572100 10249 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.526358 11913 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:26.557776 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.586442 11000 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:26.560045 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.560788 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.592765 10244 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:26.589717 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:26.516518 11988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.019s
I20260709 13:15:26.576288 10364 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.598752 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.598930 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.593928 10394 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:26.599555 10392 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:26.601135 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:26.601759 10243 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.584390 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.561570 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.594058 10247 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:26.602535 10248 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:26.603257 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.603822 10247 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.603906 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.604703 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.605305 10247 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.590590 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.606734 10391 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:26.592190 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.607429 10395 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:26.595894 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.596287 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.610425 10397 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:26.596889 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.611436 10250 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:26.611994 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.612555 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.612711 10248 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.613673 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.613739 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.614480 10248 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:26.615393 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.615958 10248 raft_consensus.cc:1813] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Handling vote request from an unknown peer cb71def93f904f619a1527aa48a32294
I20260709 13:15:26.616577 10248 raft_consensus.cc:2410] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:26.617156 11978 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.618453 12033 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.618567 12055 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.618955 12033 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.619087 12055 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.619411 12033 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.619611 12055 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.621331 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:26.621994 10396 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.556669 11987 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.624330 11987 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.564262 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:26.548650 12049 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.514318 12059 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.618016 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.642271 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.617662 11978 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.564985 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.590329 11957 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.636420 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.587740 12046 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.646214 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.647050 10250 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:26.654474 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.639756 10394 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:26.628578 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.601261 11819 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.655236 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.626124 12075 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.602419 11988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.001s	sys 0.019s
I20260709 13:15:26.627673 12034 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:26.653581 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.593712 11937 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:26.548310 12054 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.644533 12039 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.586071 11913 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.653748 11987 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.630558 12068 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.635771 12051 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:26.655953 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.710625 10320 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:26.711634 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.606076 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.656731 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.564782 11856 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.627727 11949 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.650763 10397 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:26.732975 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.733559 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:26.734274 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 135579us
I20260709 13:15:26.647812 12061 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:26.660955 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.749698 10317 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:26.687944 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.672528 10390 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.671600 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.689283 10249 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:26.651516 12038 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.668929 11988 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:26.690449 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 97541.8us
I20260709 13:15:26.691246 10325 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:26.691946 10396 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:26.648705 10997 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:26.660624 12056 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.654654 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:26.700497 10243 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:26.668632 11970 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.712852 10247 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:26.674568 12075 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.734874 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.700560 11913 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:26.750653 10321 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:26.688432 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.777312 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:26.777976 10396 raft_consensus.cc:606] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:26.778352 10396 raft_consensus.cc:614] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:26.701524 11968 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.756541 10318 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:26.757524 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.761297 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:26.686839 11937 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.763031 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:26.727725 12051 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:26.786039 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:26.786435 12051 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.765268 10241 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:26.669165 11819 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.766918 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.766355 12039 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.747906 11949 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.772073 12056 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:26.771101 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 116512us
W20260709 13:15:26.713037 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56380.7us
I20260709 13:15:26.774049 10250 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:26.710796 11987 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.780272 11905 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:26.782150 10249 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:26.811069 12053 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:26.811509 12053 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.782866 11942 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:26.782315 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.785737 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:26.813221 10317 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:26.764395 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.803542 12077 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:26.803730 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.804117 12063 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:26.768253 12061 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:26.771101 11970 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.807407 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.727298 12068 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.811853 12053 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:26.810907 12071 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:26.807027 11906 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:26.808707 12056 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:26.885963 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 68182.4us
I20260709 13:15:26.818473 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.767081 12038 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.819039 10244 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:26.819478 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:26.799396 12039 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:26.829759 12079 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 13:15:26.821467 12072 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.822738 12049 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.816926 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.826454 11970 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.824293 12054 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.822870 12059 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.850996 11856 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.825698 12075 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.874615 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:26.794791 11968 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.881294 11998 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:26.825007 12061 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.964010 11968 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:26.824502 12070 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.826050 12077 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.882449 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:26.914363 11936 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.820883 12034 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:26.823592 11988 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:26.815229 11942 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.813740 11905 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:26.884250 11949 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:26.884382 12051 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:26.827149 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:15:26.974891 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 147864us
I20260709 13:15:26.886510 10320 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
W20260709 13:15:26.815831 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51535.2us
I20260709 13:15:26.899935 10317 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:15:26.899991 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 81604.5us
I20260709 13:15:26.977069 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:26.885528 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 204) took 1090 ms. Trace:
I20260709 13:15:26.955525 10396 raft_consensus.cc:606] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:26.968880 10318 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:26.825939 12063 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:26.969980 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 83144.7us
W20260709 13:15:26.972354 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 165079us
I20260709 13:15:26.944283 12049 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:26.945169 12072 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.977720 10323 rpcz_store.cc:276] 0709 13:15:25.795513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.795628 (+   115us) service_pool.cc:224] Handling call
0709 13:15:26.835370 (+1039742us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400115154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:26.885447 (+ 50077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053123456}
I20260709 13:15:26.983613 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.987943 12025 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:26.988072 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.003376 10392 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:27.004634 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.989969 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:26.991405 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.005788 10364 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:26.974215 11942 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.994269 12063 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.974455 11905 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:26.984064 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:27.009730 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.010058 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:27.009783 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:27.010762 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.013932 10246 raft_consensus.cc:2368] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5.
I20260709 13:15:27.007442 10317 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:26.973572 11936 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.006558 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:27.012109 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.019992 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.020617 10323 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:27.021943 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.022768 10323 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:27.023666 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:26.971953 12034 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.023937 10290 leader_election.cc:400] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5.
I20260709 13:15:26.983204 12070 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.024387 10290 leader_election.cc:403] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:27.015461 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.033385 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:26.998013 11861 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:27.025905 10396 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:27.050884 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.025350 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.051604 10392 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:26.970196 12077 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.034389 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.035118 10243 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:26.996688 12049 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:27.025023 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.024139 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.057416 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.002981 12025 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:27.005570 12072 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.058166 10398 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:27.059054 10396 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:27.025023 11936 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.025249 12075 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.037264 12046 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:27.026400 12034 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:27.065105 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75675.4us
I20260709 13:15:26.998941 11888 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:15:27.050549 11979 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:27.017568 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 557) took 1204 ms. Trace:
I20260709 13:15:27.037562 12070 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:26.974519 12053 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.057524 12049 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.088023 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.061542 11981 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:27.064327 12025 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.098191 12091 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:27.098353 12088 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 13:15:27.098990 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 65684.9us
I20260709 13:15:27.074702 11997 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:27.104913 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.110023 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.096478 11981 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.096370 11979 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:27.101943 12067 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:27.111611 11002 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:27.104475 11997 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.094570 11908 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:15:27.102964 11987 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.096772 11906 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:15:27.115353 11981 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:27.120535 12055 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.000s
I20260709 13:15:27.126199 11997 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.153805 12055 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.157254 12096 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.142807 11861 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.143554 12067 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:27.135581 12038 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.120404 12033 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.152747 12074 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:27.182005 12092 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:15:27.159685 12053 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.158035 12096 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.161837 12032 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:27.134779 12098 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.185408 12074 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.170274 11861 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.195358 10391 raft_consensus.cc:2368] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:27.174127 12051 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.196020 12074 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.189277 12055 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.188342 12067 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.213851 11861 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.192248 12095 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5.
I20260709 13:15:27.185842 12090 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.200276 12032 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:27.169346 11979 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.217540 11981 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:27.229857 12080 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.434s	user 0.004s	sys 0.000s
I20260709 13:15:27.240104 12032 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.263077 11970 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.267206 12096 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.263223 12034 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.227909 12063 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:27.266033 12097 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:15:27.089672 10995 rpcz_store.cc:276] 0709 13:15:25.794837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.798533 (+  3696us) service_pool.cc:224] Handling call
0709 13:15:25.837932 (+ 39399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.870160 (+ 32228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.871538 (+  1378us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.952472 (+ 80934us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.562161 (+609689us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:26.564150 (+  1989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.592368 (+ 28218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.972174 (+379806us) raft_consensus.cc:1685] finished
0709 13:15:26.974115 (+  1941us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.999512 (+ 25397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1381,"raft.queue_time_us":4905,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4063,"thread_start_us":502851,"threads_started":1,"wal-append.queue_time_us":699759}
I20260709 13:15:27.242766 12033 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.275200 10397 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:27.267963 11957 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.002s
I20260709 13:15:27.206696 12098 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.280601 12034 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.285864 11970 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.243137 12056 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.291195 11913 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.292097 10316 raft_consensus.cc:2368] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:27.304607 10324 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.305507 10317 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.320180 11978 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.320544 12091 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:27.282357 11957 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:27.321768 12081 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.526s	user 0.005s	sys 0.000s
I20260709 13:15:27.253569 12090 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.326175 12091 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:27.347990 11913 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.391760 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:27.492663 10289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.014s
I20260709 13:15:27.409853 11981 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.327414 12039 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.293579 12072 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.343458 11905 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.376732 12070 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.346732 11942 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.343709 12091 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.355625 12046 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.493564 12059 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.520865 12046 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.495421 11000 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:27.521633 12059 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.523015 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.496862 12095 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.342474 12047 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.496627 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:27.511343 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:27.519526 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:27.519891 12072 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.520148 12038 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.521262 11905 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.523664 12046 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.341322 12056 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.508293 10321 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:27.551704 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:27.493039 10289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.003s	sys 0.014s
I20260709 13:15:27.536320 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.524161 12095 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.538425 12103 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:27.539623 11942 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.559468 12068 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.532367 12049 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.539848 12091 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.562023 12049 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.562913 10318 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:27.557826 12103 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.563819 12103 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.539494 12038 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.542102 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.541296 10319 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.543620 10995 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.543913 12070 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.543968 10994 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.531728 11987 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:27.497797 11978 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:27.548022 12075 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:27.503896 11981 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.548609 12054 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:27.504400 12105 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.556406 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.573789 12098 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.536242 11913 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:27.523685 12059 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.554077 11936 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.553848 12047 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.599236 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:27.600069 12115 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:15:27.601254 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.636838 12038 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:27.603111 12077 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:15:27.608506 11978 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.557281 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.644616 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.642910 12077 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.645814 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.614912 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.612126 11981 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.611559 12105 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.641810 10995 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:27.616614 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.618424 11913 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.633412 10399 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.646519 10324 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:27.649819 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.653707 10323 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.632597 11957 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.673692 10394 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:27.658701 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:27.662186 12082 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.930s	user 0.002s	sys 0.002s
I20260709 13:15:27.662376 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.665396 10241 raft_consensus.cc:2368] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:27.664039 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.678053 10242 raft_consensus.cc:2410] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:27.663513 10994 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
W20260709 13:15:27.671175 10965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.043s	sys 0.060s
I20260709 13:15:27.673471 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:27.685699 10965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.043s	sys 0.060s
I20260709 13:15:27.685914 10248 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.574542 12025 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.687225 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:27.671005 10213 leader_election.cc:400] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:27.688762 10213 leader_election.cc:403] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:27.664587 12046 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:27.675431 12066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.011s	sys 0.023s
I20260709 13:15:27.691136 12038 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.695133 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:27.717285 11001 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.694293 11970 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.695660 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.696957 10324 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:27.737375 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1783) took 1039 ms. Trace:
I20260709 13:15:27.697391 11861 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.698716 11913 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.699155 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.698773 11978 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.671947 10316 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:27.609459 11987 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.701224 12049 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.662909 12074 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.707895 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:27.761663 10242 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.706430 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.710534 12060 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.694625 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:27.723062 12110 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:27.724454 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.727456 11953 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.727631 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:27.712352 12046 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.772625 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.735407 11002 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:27.773032 10395 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:27.677135 12059 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:27.707456 12066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.011s	sys 0.024s
I20260709 13:15:27.737742 10324 rpcz_store.cc:276] 0709 13:15:26.697950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.696249 (+998299us) service_pool.cc:224] Handling call
0709 13:15:27.696615 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.737076 (+ 40461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.737315 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.743615 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.699214 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.700758 11936 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.708474 12072 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:27.765825 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:27.779160 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.739383 11970 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.728158 12091 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:27.731937 10248 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:27.786351 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:27.770501 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:27.782080 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.735132 12038 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.784724 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 433) took 1490 ms. Trace:
I20260709 13:15:27.729967 12103 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.790596 11001 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:27.740127 12032 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.763659 12049 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.791507 12070 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:27.791973 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:27.792564 10246 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.787587 10999 rpcz_store.cc:276] 0709 13:15:26.294564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.295073 (+   509us) service_pool.cc:224] Handling call
0709 13:15:26.295430 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.323124 (+ 27694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.323170 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.340085 (+ 16915us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.525686 (+185601us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:26.525731 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.525795 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.655597 (+1129802us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b24000d4fa8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a3a09d 00007f58c366c10e 00007f58c368388c 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221
0709 13:15:27.765146 (+109549us) raft_consensus.cc:1685] finished
0709 13:15:27.765166 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.784638 (+ 19472us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31532,"raft.queue_time_us":33155,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2406,"spinlock_wait_cycles":9532672,"thread_start_us":155870,"threads_started":1,"wal-append.queue_time_us":306365}
I20260709 13:15:27.796306 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.792721 10247 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:27.798748 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.799750 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.773986 12090 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.803843 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.801502 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.801991 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:27.804884 10396 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:27.805178 10999 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:15:27.806914 11997 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.006s
I20260709 13:15:27.807348 11997 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:27.808776 12101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.027s
W20260709 13:15:27.809278 12101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.003s	sys 0.027s
I20260709 13:15:27.809464 11997 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.811161 11937 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.811511 11819 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.778937 11953 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.780269 12066 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:27.780628 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:27.821539 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.793684 12034 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:27.822132 10324 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.792948 12095 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.802495 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.824648 10394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:27.798542 11936 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:27.783963 12059 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.780582 12060 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:27.800758 12111 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:15:27.828541 12034 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.841032 10394 raft_consensus.cc:606] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:27.855062 10394 raft_consensus.cc:614] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:27.841117 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:27.831601 12065 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:27.788188 12072 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:27.843057 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52772.9us
I20260709 13:15:27.843957 10324 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:27.806927 12103 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.804208 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.849653 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1742) took 1047 ms. Trace:
I20260709 13:15:27.864208 10397 rpcz_store.cc:276] 0709 13:15:26.800700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.801252 (+   552us) service_pool.cc:224] Handling call
0709 13:15:27.847510 (+1046258us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b540010c054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:27.848123 (+   613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059988864}
W20260709 13:15:27.850594 12083 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.064s	user 0.003s	sys 0.005s
I20260709 13:15:27.857631 10246 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:27.822090 12112 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:27.859119 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 1778) took 1166 ms. Trace:
I20260709 13:15:27.861480 10243 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:27.862309 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.783244 12110 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.842032 11936 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.865032 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:27.868908 10319 rpcz_store.cc:276] 0709 13:15:26.688039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.688176 (+   137us) service_pool.cc:224] Handling call
0709 13:15:27.854002 (+1165826us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54000cc954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:27.854180 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755572096}
I20260709 13:15:27.871150 11987 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.872540 12038 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.872393 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.879087 12046 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:27.879717 10390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1176) took 1356 ms (client timeout 1702 ms). Trace:
I20260709 13:15:27.870515 10316 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:27.893985 10399 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:27.879535 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.881670 12074 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.846969 10994 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:27.860894 12034 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.902441 11968 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:27.902822 12073 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.271s	user 0.007s	sys 0.000s
I20260709 13:15:27.903064 11968 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:27.903987 11968 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.905452 12049 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.894078 12066 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:27.908202 10244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1101) took 1308 ms (client timeout 1650 ms). Trace:
W20260709 13:15:27.908643 10244 rpcz_store.cc:269] 0709 13:15:26.599613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.602382 (+  2769us) service_pool.cc:224] Handling call
0709 13:15:27.907967 (+1305585us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540043cbd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:27.908107 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382286592}
I20260709 13:15:27.910775 11970 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.910962 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.911616 10318 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:27.911813 12059 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.886847 12025 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.889310 11936 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.912559 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.913740 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.914479 10318 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.915251 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.915537 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:27.915828 10318 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:27.916318 10995 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.916698 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.917395 10318 raft_consensus.cc:2368] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4.
I20260709 13:15:27.918159 12077 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:27.895010 10390 rpcz_store.cc:269] 0709 13:15:26.523244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.526956 (+  3712us) service_pool.cc:224] Handling call
0709 13:15:27.879504 (+1352548us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400001754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:27.879635 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34586880}
I20260709 13:15:27.919737 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.888413 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:27.928226 10390 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.928536 10319 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:27.929435 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.930573 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.931208 12063 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.888706 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 1774) took 1234 ms. Trace:
I20260709 13:15:27.934388 10325 rpcz_store.cc:276] 0709 13:15:26.654805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.654957 (+   152us) service_pool.cc:224] Handling call
0709 13:15:27.888550 (+1233593us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b54001888d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:27.888651 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74887040}
W20260709 13:15:27.935379 12125 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:27.935534 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.893676 12067 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.936421 12067 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.859632 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:27.893743 12095 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:27.887373 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.956215 10324 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.956683 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:27.959002 10319 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:27.893833 12032 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.893178 12110 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.966449 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:27.967033 10998 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:27.931344 10392 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:27.938689 12072 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.968077 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.934055 12039 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:27.936703 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.969064 12034 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:27.969482 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.970147 10325 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:27.970528 12049 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:27.970594 12095 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.971197 12049 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:27.971467 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1790) took 1273 ms. Trace:
I20260709 13:15:27.897508 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.972189 12049 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.972810 12095 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.955837 11996 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:27.974409 11996 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:27.971894 10325 rpcz_store.cc:276] 0709 13:15:26.698352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.970728 (+1272376us) service_pool.cc:224] Handling call
0709 13:15:27.971002 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.971165 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.971191 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.971232 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:27.971260 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.971324 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.971421 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:27.976723 11996 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.950170 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:27.960402 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.980283 10392 raft_consensus.cc:2368] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3.
I20260709 13:15:27.980754 10324 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:27.963743 12126 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:27.964254 12067 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.968256 10993 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:28.002197 12032 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:28.005926 11888 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:28.006349 12057 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:27.995923 11905 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:28.006585 11888 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.006942 12057 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.007068 11905 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.008882 11888 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.009092 12057 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:27.981980 10242 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:28.009320 12126 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:28.015029 12124 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:15:28.016199 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.016701 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.017019 12126 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.017248 10243 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:28.017587 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 1790) took 1010 ms. Trace:
I20260709 13:15:27.996614 12063 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:28.017954 10317 rpcz_store.cc:276] 0709 13:15:27.007568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.015222 (+  7654us) service_pool.cc:224] Handling call
0709 13:15:28.017421 (+1002199us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540021ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.017536 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624171776}
I20260709 13:15:28.019519 12077 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:28.019924 12077 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:28.020654 11981 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.020740 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1186) took 1001 ms. Trace:
I20260709 13:15:28.009092 11905 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:28.021277 10391 rpcz_store.cc:276] 0709 13:15:27.019383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.019631 (+   248us) service_pool.cc:224] Handling call
0709 13:15:28.020560 (+1000929us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000109d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.020684 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388256640}
I20260709 13:15:28.020819 12077 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:28.022668 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:28.023131 12077 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.023787 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:28.024389 10391 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.026882 12126 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:27.898701 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:28.028223 10397 raft_consensus.cc:2368] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3.
I20260709 13:15:28.028797 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1792) took 1329 ms. Trace:
I20260709 13:15:28.029088 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:28.029836 10397 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:28.029247 10324 rpcz_store.cc:276] 0709 13:15:26.698989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.981302 (+1282313us) service_pool.cc:224] Handling call
0709 13:15:28.028131 (+ 46829us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:28.028340 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.028511 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.028534 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.028573 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:28.028599 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.028651 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.028749 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4774144}
I20260709 13:15:27.983301 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:27.990689 12122 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.021507 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.030658 12122 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.031304 10244 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:28.032747 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:27.991034 11861 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:27.990717 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:27.992655 12034 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:27.979909 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:27.992983 10316 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:27.994819 11936 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:27.999861 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49782us
I20260709 13:15:27.974751 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1770) took 1322 ms. Trace:
I20260709 13:15:28.004940 12074 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:15:27.951659 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.012455 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.013027 12105 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:28.005620 12103 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.983134 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1791) took 1284 ms. Trace:
I20260709 13:15:28.038192 10394 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:28.054304 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 74458.3us
I20260709 13:15:28.057337 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1746) took 1066 ms. Trace:
I20260709 13:15:28.058151 10398 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:28.040346 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:28.059417 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1797) took 1356 ms. Trace:
I20260709 13:15:28.060740 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.046353 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.103101 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1107) took 1093 ms. Trace:
I20260709 13:15:28.009344 11953 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:28.103205 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:27.918174 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:28.110299 10322 rpcz_store.cc:276] 0709 13:15:26.652566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.652749 (+   183us) service_pool.cc:224] Handling call
0709 13:15:26.669531 (+ 16782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.958748 (+289217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.958786 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:26.959342 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:15:27.056629 (+ 97287us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:27.064133 (+  7504us) log.cc:844] Serialized 14 byte log entry
0709 13:15:27.973796 (+909663us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400294620. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a63733 00007f58c3ae8dbf 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c
0709 13:15:27.973845 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.974449 (+   604us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540020ab54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:27.974489 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.974532 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:27.974547 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.974671 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":819,"prepare.queue_time_us":6206,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":33368,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":5072,"spinlock_wait_cycles":753996800,"thread_start_us":398488,"threads_started":2,"wal-append.queue_time_us":160328}
W20260709 13:15:28.121640 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 170093us
I20260709 13:15:28.132123 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1801) took 1402 ms. Trace:
W20260709 13:15:28.123253 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 84380.9us
I20260709 13:15:28.122483 10325 rpcz_store.cc:276] 0709 13:15:26.698670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.976855 (+1278185us) service_pool.cc:224] Handling call
0709 13:15:27.982493 (+  5638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:27.982735 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.982774 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:27.982832 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:27.982877 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.982955 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.983082 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.126186 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.118216 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:28.130270 10318 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:28.123221 10324 rpcz_store.cc:276] 0709 13:15:26.702812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.058459 (+1355647us) service_pool.cc:224] Handling call
0709 13:15:28.058780 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.058990 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.059026 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.059085 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:28.059127 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.059194 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.059348 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.123778 10249 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:28.128213 10244 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:28.143289 10322 rpcz_store.cc:276] 0709 13:15:26.730052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.131046 (+1400994us) service_pool.cc:224] Handling call
0709 13:15:28.131442 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.131678 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.131714 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.131773 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.131815 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.131882 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.132052 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.122838 10395 rpcz_store.cc:276] 0709 13:15:26.990881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.991074 (+   193us) service_pool.cc:224] Handling call
0709 13:15:28.057121 (+1066047us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b540045b854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.057269 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762149760}
I20260709 13:15:28.146317 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:28.147413 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:28.124377 10241 rpcz_store.cc:276] 0709 13:15:27.009305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.009458 (+   153us) service_pool.cc:224] Handling call
0709 13:15:28.062781 (+1053323us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b540005e1d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.103020 (+ 40239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499725184}
I20260709 13:15:28.111491 10243 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:28.033980 12122 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.063982 12059 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:28.058765 11981 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:28.154742 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1785) took 1169 ms. Trace:
I20260709 13:15:28.155304 10324 rpcz_store.cc:276] 0709 13:15:26.985004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.153478 (+1168474us) service_pool.cc:224] Handling call
0709 13:15:28.153924 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.154195 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.154264 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.154323 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.154360 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.154512 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.154670 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.156939 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1802) took 1145 ms. Trace:
I20260709 13:15:28.157892 10242 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:28.157280 10324 rpcz_store.cc:276] 0709 13:15:27.011389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.156217 (+1144828us) service_pool.cc:224] Handling call
0709 13:15:28.156497 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.156650 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.156674 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.156714 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.156741 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.156793 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.156888 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.161365 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1803) took 1148 ms. Trace:
I20260709 13:15:28.161680 10324 rpcz_store.cc:276] 0709 13:15:27.012937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.160663 (+1147726us) service_pool.cc:224] Handling call
0709 13:15:28.160931 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.161079 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.161102 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.161137 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:28.161164 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.161213 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.161308 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.163225 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1804) took 1150 ms. Trace:
I20260709 13:15:28.163553 10324 rpcz_store.cc:276] 0709 13:15:27.013176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.162513 (+1149337us) service_pool.cc:224] Handling call
0709 13:15:28.162771 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.162936 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.162960 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.162997 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:28.163026 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.163075 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.163178 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.165022 10324 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:28.165552 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 214) took 1052 ms. Trace:
I20260709 13:15:28.165848 10324 rpcz_store.cc:276] 0709 13:15:27.113203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.164479 (+1051276us) service_pool.cc:224] Handling call
0709 13:15:28.164716 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.165325 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.165504 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.166860 12048 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:28.167312 12048 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:28.167411 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1788) took 1171 ms. Trace:
I20260709 13:15:28.167716 12048 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.167835 10318 rpcz_store.cc:276] 0709 13:15:26.995850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.166612 (+1170762us) service_pool.cc:224] Handling call
0709 13:15:28.166916 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.167087 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.167111 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.167151 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:28.167201 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.167253 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.167362 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.137976 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:28.145699 10362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.638s (SENT) [suppressed 6 similar messages]
I20260709 13:15:28.171336 10965 leader_election.cc:400] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4.
I20260709 13:15:28.171471 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.159691 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1784) took 1175 ms. Trace:
I20260709 13:15:28.172986 10325 rpcz_store.cc:276] 0709 13:15:26.984653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.158958 (+1174305us) service_pool.cc:224] Handling call
0709 13:15:28.159217 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.159390 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.159414 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.159461 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:28.159490 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.159541 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.159638 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.178908 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.179997 10242 raft_consensus.cc:2410] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:28.171721 10965 leader_election.cc:403] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:28.194360 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:28.197943 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:28.204639 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.205785 10241 raft_consensus.cc:2410] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:28.223688 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 52302.7us
I20260709 13:15:28.129968 12039 raft_consensus.cc:2764] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:28.224649 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.120896 11861 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.032472 12126 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.131153 12103 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:28.202549 11905 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:28.225232 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:28.446097 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 300394us
I20260709 13:15:28.595796 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:28.452723 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.507813 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.431109 10246 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:28.270363 10245 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:15:28.303957 10320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 1781) took 1612 ms (client timeout 1638 ms). Trace:
I20260709 13:15:28.173218 12059 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.153143 11997 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:28.266419 10390 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:28.360598 12075 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:28.225232 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:28.202392 12099 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:28.265621 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1799) took 1562 ms. Trace:
I20260709 13:15:28.314864 12039 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:28.279737 12104 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:28.231536 11856 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:28.274209 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.158329 11968 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.264520 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.223671 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.203431 11981 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.239305 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.268910 12049 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:28.482507 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 257933us
W20260709 13:15:28.270668 10321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 1779) took 1582 ms (client timeout 1876 ms). Trace:
I20260709 13:15:28.614452 10247 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.625387 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.222890 12122 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.406s
I20260709 13:15:28.615972 11997 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.629873 11997 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:28.618938 12039 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:28.628799 12049 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:28.631876 12039 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:28.624110 10249 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:28.623029 11968 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.635653 11968 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.534749 11996 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:28.637988 10250 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
W20260709 13:15:28.624769 10321 rpcz_store.cc:269] 0709 13:15:26.688346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.785462 (+ 97116us) service_pool.cc:224] Handling call
0709 13:15:28.270507 (+1485045us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540022d8d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.270603 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230153088}
W20260709 13:15:28.615376 10320 rpcz_store.cc:269] 0709 13:15:26.691515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.711359 (+ 19844us) service_pool.cc:224] Handling call
0709 13:15:28.303740 (+1592381us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400113d54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.303892 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333406976}
I20260709 13:15:28.646484 10247 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:28.651677 10249 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:28.639240 12034 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:28.656607 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 1808) took 1635 ms. Trace:
I20260709 13:15:28.597373 10965 leader_election.cc:400] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3.
I20260709 13:15:28.663975 10965 leader_election.cc:403] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:28.663134 10323 rpcz_store.cc:276] 0709 13:15:27.022285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.023781 (+  1496us) service_pool.cc:224] Handling call
0709 13:15:28.656377 (+1632596us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400187ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:28.656536 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356348800}
W20260709 13:15:28.665939 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68773.4us
I20260709 13:15:28.662477 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:28.669410 10391 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.001s
I20260709 13:15:28.669543 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.669853 10391 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:28.615687 12059 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.675212 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.640336 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.677841 12034 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.689263 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.613567 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.663173 11861 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:28.683863 12077 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.000s
I20260709 13:15:28.830494 10248 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:28.831362 10319 raft_consensus.cc:2410] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:28.681377 10323 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:28.679402 12062 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4.
I20260709 13:15:28.689949 12100 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.833618 12095 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.834429 12100 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.835235 12095 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.671873 12049 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:28.837342 12100 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:28.838446 12077 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:28.838060 12100 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:28.839231 12100 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.831610 11861 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:28.844066 12100 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:28.848897 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1809) took 1151 ms. Trace:
I20260709 13:15:28.849331 10318 rpcz_store.cc:276] 0709 13:15:27.697867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.168890 (+471023us) service_pool.cc:224] Handling call
0709 13:15:28.169163 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.848079 (+678916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.848108 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.848148 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:28.848177 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.848676 (+   499us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54000cc454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:28.848712 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.848844 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560929664}
I20260709 13:15:28.851053 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.852246 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.853497 10998 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:28.854809 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.622956 11856 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.854919 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.857782 11856 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.858875 10146 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.861704 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.860888 10146 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 3 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.863452 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.865192 10146 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 3 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.866974 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.867247 10247 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:28.869532 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:28.613474 12103 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:28.870298 10248 raft_consensus.cc:2368] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4.
I20260709 13:15:28.872532 10391 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:15:28.873979 10391 pending_rounds.cc:85] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 3
I20260709 13:15:28.618491 12099 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.882481 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.892799 10148 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 280) took 3119 ms. Trace:
I20260709 13:15:28.895284 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.899050 10364 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.619630 12104 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.684968 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 409) took 1019 ms. Trace:
I20260709 13:15:28.688190 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1794) took 1988 ms. Trace:
I20260709 13:15:28.637995 11996 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:28.880448 10391 pending_rounds.cc:107] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 13:15:28.907305 11000 rpcz_store.cc:276] 0709 13:15:27.665446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.665637 (+   191us) service_pool.cc:224] Handling call
0709 13:15:28.684290 (+1018653us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:28.684467 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.684637 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.684659 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.684700 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:28.684729 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.684783 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.684896 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6753536}
W20260709 13:15:28.833017 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 157827us
I20260709 13:15:28.920782 10250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:28.934825 10250 raft_consensus.cc:606] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:28.935340 10250 raft_consensus.cc:614] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:28.678911 10398 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:28.872967 11908 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:28.909345 10317 rpcz_store.cc:276] 0709 13:15:26.699629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.018914 (+1319285us) service_pool.cc:224] Handling call
0709 13:15:28.019219 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.032401 (+ 13182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.032430 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.035753 (+  3323us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.118844 (+ 83091us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.118891 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.687795 (+568904us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54002be154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:28.687850 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.687897 (+    47us) raft_consensus.cc:1685] finished
0709 13:15:28.687909 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.688136 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":449,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":160,"spinlock_wait_cycles":29545088,"thread_start_us":82700,"threads_started":1,"wal-append.queue_time_us":83053}
I20260709 13:15:28.925875 10391 raft_consensus.cc:2917] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 13:15:28.943864 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:28.621989 12126 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.957610 10391 raft_consensus.cc:2889] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:28.960379 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.678105 12039 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:28.671679 11905 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.879974 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:28.700737 12060 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:28.982687 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44050 (request call id 85) took 5359 ms. Trace:
I20260709 13:15:28.687139 11936 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.617465 12075 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:28.979880 10246 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:29.001646 10325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.000s	sys 0.026s
W20260709 13:15:29.002949 10325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.000s	sys 0.026s
I20260709 13:15:28.910889 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:28.911616 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:28.925130 12047 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:28.959465 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 347444us
W20260709 13:15:28.986974 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 340802us
I20260709 13:15:28.981633 10288 leader_election.cc:400] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:28.983135 10391 rpcz_store.cc:276] 0709 13:15:23.616591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.616714 (+   123us) service_pool.cc:224] Handling call
0709 13:15:23.641271 (+ 24557us) log.cc:844] Serialized 501 byte log entry
0709 13:15:28.975952 (+5334681us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73794,"raft.queue_time_us":76097,"raft.run_cpu_time_us":1066,"raft.run_wall_time_us":1160,"thread_start_us":79241,"threads_started":1,"wal-append.queue_time_us":57277,"wal-append.run_cpu_time_us":1574,"wal-append.run_wall_time_us":1001600}
I20260709 13:15:28.975598 12110 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:29.034747 10288 leader_election.cc:403] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:29.035488 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54002.9us
I20260709 13:15:29.035559 12110 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:29.034731 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.040205 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.040874 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.041137 11936 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.041693 11936 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:29.041745 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.042721 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.042968 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.043098 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.043661 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.080502 10399 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:28.618256 10316 rpcz_store.cc:276] 0709 13:15:26.703503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.145259 (+1441756us) service_pool.cc:224] Handling call
0709 13:15:28.231872 (+ 86613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.265196 (+ 33324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.265232 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.265295 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.265339 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.265411 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.265556 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.045724 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.046099 12034 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.046525 12104 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:28.893249 10148 rpcz_store.cc:276] 0709 13:15:25.760098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.760269 (+   171us) service_pool.cc:224] Handling call
0709 13:15:28.879777 (+3119508us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:25.834616 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:25.878968 (+ 44352us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:25.880685 (+  1717us) write_op.cc:435] Acquired schema lock
0709 13:15:25.884631 (+  3946us) tablet.cc:662] Decoding operations
0709 13:15:25.954991 (+ 70360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:25.958115 (+  3124us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:25.970091 (+ 11976us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:26.020363 (+ 50272us) tablet.cc:701] Row locks acquired
0709 13:15:26.022900 (+  2537us) write_op.cc:260] PREPARE: finished
0709 13:15:26.057247 (+ 34347us) write_op.cc:270] Start()
0709 13:15:26.079633 (+ 22386us) write_op.cc:276] Timestamp: P: 1783602926051017 usec, L: 0
0709 13:15:26.082081 (+  2448us) op_driver.cc:348] REPLICATION: starting
0709 13:15:26.108756 (+ 26675us) log.cc:844] Serialized 536 byte log entry
0709 13:15:26.808204 (+699448us) op_driver.cc:464] REPLICATION: finished
0709 13:15:27.038848 (+230644us) write_op.cc:301] APPLY: starting
0709 13:15:27.038974 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:27.039119 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:27.039289 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:27.039624 (+   335us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:27.039848 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:27.039925 (+    77us) write_op.cc:312] APPLY: finished
0709 13:15:27.040184 (+   259us) log.cc:844] Serialized 23 byte log entry
0709 13:15:27.040456 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:27.040561 (+   105us) write_op.cc:454] Released schema lock
0709 13:15:27.040629 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:27.041092 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:27.041131 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9555,"reported_tablets":5,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":213452,"apply.run_cpu_time_us":2225,"apply.run_wall_time_us":2224,"num_ops":1,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":4153,"prepare.run_wall_time_us":274450,"replication_time_us":690556,"thread_start_us":78469,"threads_started":1}]]}
I20260709 13:15:28.967110 11908 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.047454 12060 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:29.047303 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:15:29.046881 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.053169 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:29.002084 10994 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.946656 11997 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.071959 10394 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:29.074595 10398 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:29.072472 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.044459 12066 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:29.095163 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48079us
I20260709 13:15:29.080089 12047 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:29.097292 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54262.8us
I20260709 13:15:29.101118 10213 leader_election.cc:400] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3.
I20260709 13:15:29.101882 10213 leader_election.cc:403] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.095139 12034 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.102967 12047 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:29.107605 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.108448 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.108935 10391 raft_consensus.cc:606] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:29.110585 10391 raft_consensus.cc:614] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:29.110461 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.113751 10241 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:29.115022 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.099938 12104 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:29.121798 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 218316us
I20260709 13:15:29.120476 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.122591 10364 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:29.124200 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 222824us
W20260709 13:15:29.124352 10324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.006s	sys 0.019s
W20260709 13:15:29.125494 10324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.006s	sys 0.019s
I20260709 13:15:29.103120 12034 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.103709 11856 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3.
I20260709 13:15:29.114840 12070 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.042760 11936 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.123832 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:29.134920 11939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.000s	sys 0.021s
I20260709 13:15:29.124310 10288 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.119894 12039 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:29.147992 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.099761 12060 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.140921 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.124310 12049 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:29.119792 12057 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:29.152266 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 404034us
I20260709 13:15:29.157270 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.158582 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.167171 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:29.147640 12048 consensus_meta.cc:287] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.979s	user 0.010s	sys 0.001s
I20260709 13:15:29.174283 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.175925 12034 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.176525 12034 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:29.177141 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.178467 12099 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:29.178750 12139 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:15:29.119477 12138 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:15:29.179198 12146 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.172000 12063 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:29.136328 12104 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:29.182713 10398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:29.139868 11981 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:29.180328 10322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.006s	sys 0.022s
W20260709 13:15:29.181872 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.183377 10398 raft_consensus.cc:606] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
W20260709 13:15:29.185024 10322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.007s	sys 0.022s
I20260709 13:15:29.171204 12066 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:29.185843 12066 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.188657 12066 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.189384 12066 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:29.151005 12039 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.191392 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.192342 10317 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:29.179556 12077 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:29.157258 12105 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:29.194419 11001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.009s	sys 0.022s
W20260709 13:15:29.195590 11001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.009s	sys 0.022s
I20260709 13:15:29.152323 12070 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:29.164491 12057 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.196760 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.199292 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.200559  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:29.189946 12066 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:29.184010 11996 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.177183 12034 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:29.206043 12057 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.182874 12104 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:29.146952 11939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.000s	sys 0.022s
I20260709 13:15:29.208454  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:29.208758 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.208401 10317 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:29.194609 12039 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.222008 10318 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:29.210148 10365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.030s
W20260709 13:15:29.224524 10365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.031s
I20260709 13:15:29.196792 11908 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.185207 12048 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.197058 11981 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:29.212106 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 572) took 1286 ms. Trace:
I20260709 13:15:29.226277 10323 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:29.238183 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.207732 12142 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.195997 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.219233 11953 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:29.235693 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.237247 11001 rpcz_store.cc:276] 0709 13:15:27.925704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.005789 (+ 80085us) service_pool.cc:224] Handling call
0709 13:15:28.006143 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.006367 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:28.361018 (+354651us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.201720 (+840702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.201779 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.210176 (+  8397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.210317 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.212043 (+  1726us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":677345,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"thread_start_us":1175806,"threads_started":2}
I20260709 13:15:29.223774 12104 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.253959 10317 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:29.241919 10323 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:29.179980 12047 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.278726 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.279084 10394 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:29.280459 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.274727 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.232355 12096 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:29.284435 10999 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:29.286055 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.219023 12099 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:29.235917 12034 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:29.294837 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.234426 12095 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.299525 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:29.339576 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 224655us
I20260709 13:15:29.343008 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.344321 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.298122 11997 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.348278 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.352628 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.368306 10290 leader_election.cc:400] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4.
I20260709 13:15:29.233517 12066 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.368304 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.374948 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.376488 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.377075 11908 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:29.380035 12034 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.380978 12060 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.381701 12095 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:29.414077 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.414122 10241 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:29.339515 12140 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:29.427273 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:29.429080 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 262017us
I20260709 13:15:29.296914 12070 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.382030 12059 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.443351 10364 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.454042 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.453025 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:29.438071 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.459784 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.461561 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1811) took 1763 ms. Trace:
I20260709 13:15:29.455511 12110 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.465638 12110 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.466343 12095 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:29.467619 12095 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.468146 12110 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.465437 10324 rpcz_store.cc:276] 0709 13:15:27.698407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.224566 (+526159us) service_pool.cc:224] Handling call
0709 13:15:28.480433 (+255867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.480694 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:29.125992 (+645298us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.460860 (+334868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.461255 (+   395us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.461312 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.461382 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.461503 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734,"prepare.queue_time_us":476877,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2871,"raft.queue_time_us":2419,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":976889,"threads_started":2}
I20260709 13:15:29.470975 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.471127 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.471948 10316 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:29.474747 12143 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:15:29.476825 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1810) took 1778 ms. Trace:
I20260709 13:15:29.477324 10325 rpcz_store.cc:276] 0709 13:15:27.698120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.174066 (+475946us) service_pool.cc:224] Handling call
0709 13:15:28.174393 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.174734 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.174761 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.224097 (+ 49336us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.008881 (+784784us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.028942 (+ 20061us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.029208 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.029321 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.476550 (+447229us) raft_consensus.cc:1685] finished
0709 13:15:29.476577 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.476753 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37874,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":29506,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":42185,"thread_start_us":738057,"threads_started":1,"wal-append.queue_time_us":902114}
I20260709 13:15:29.482373 10316 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:29.483649 11953 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:29.484267 11953 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.487823 12105 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:29.488837 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:29.489318 12151 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:15:29.497686 12147 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:29.499912 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.501353 11939 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.506348 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:29.506121 11939 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.507243 10245 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:29.509063 11939 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:29.510440 10248 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:29.509981 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66767.8us
I20260709 13:15:29.511507 10364 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.512005 10320 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:29.511973 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.512627 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.513523 10318 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:29.515522 12149 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:29.516081 12148 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:15:29.516938 12074 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:29.518570 12075 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.519254 11968 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:29.520242 11968 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.522516 12149 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.523242 12149 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:29.433000 12154 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.430004 12142 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:29.532745 12156 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:29.546991 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 389393us
I20260709 13:15:29.530664 12105 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:29.560622 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 403390us
I20260709 13:15:29.573483 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.576510 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:29.580024 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 453812us
I20260709 13:15:29.535404 12156 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:29.440677 11908 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.591632 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.592288 10393 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:29.591985 12156 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.593107 11908 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.594741 11908 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.595645 10967 leader_election.cc:400] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4.
I20260709 13:15:29.587144 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.588176 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.589807 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:29.560407 11905 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.000s
I20260709 13:15:29.561143 12048 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:29.605911 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:29.510336 12140 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.536526 12154 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.535614 12142 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.618424 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.624351 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.606201 11968 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.613298 11905 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3.
I20260709 13:15:29.615535 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:29.622973 10994 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.008s
I20260709 13:15:29.648535 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.649232 10325 raft_consensus.cc:2376] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4. Re-sending same reply.
I20260709 13:15:29.649749 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.650519 10243 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:29.561690 12149 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.651732 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.656762 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.660981 10324 raft_consensus.cc:2376] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4. Re-sending same reply.
I20260709 13:15:29.661906 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:29.648535 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:29.665205 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:29.665680 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.666072 10324 raft_consensus.cc:2376] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3. Re-sending same reply.
I20260709 13:15:29.628228 12138 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.632272 12075 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:29.682542 12075 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.623486 12165 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:29.683583 11001 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:29.632012 12122 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:29.684223 12144 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:15:29.685999 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1787) took 2690 ms. Trace:
I20260709 13:15:29.628557 12110 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:29.686691 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.690475 12138 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.696048 12059 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.656991 10316 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:29.648962 10994 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:29.686487 10322 rpcz_store.cc:276] 0709 13:15:26.995528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.166493 (+1170965us) service_pool.cc:224] Handling call
0709 13:15:28.167679 (+  1186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.174881 (+  7202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.174924 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.223990 (+ 49066us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.702015 (+478025us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4800270cd8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f 00007f58c8afff37 00007f58c8b1455c 00007f58c8b14508 00007f58c8b14488 00007f58c8b14443 00007f58c8b136ec 00007f58c7a3da96
0709 13:15:29.185606 (+483591us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:29.231005 (+ 45399us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.231316 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.231421 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.685706 (+454285us) raft_consensus.cc:1685] finished
0709 13:15:29.685806 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.685943 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22312,"prepare.queue_time_us":47079,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":55465,"raft.run_cpu_time_us":1145,"raft.run_wall_time_us":484053,"spinlock_wait_cycles":77863680,"thread_start_us":874727,"threads_started":1,"wal-append.queue_time_us":1169165}
I20260709 13:15:29.677755 12161 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:15:29.644728 10390 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:29.707532 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.709026 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:29.674831 12166 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:29.676853 12049 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:29.679165 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:29.679358 12060 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:29.749948 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.751811 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.752056 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.744100 11905 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:29.753647 12100 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:29.754274 11905 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.743568 12103 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.756151 12103 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.757464 12049 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.744829 11979 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:29.761863 11979 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.763386 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.767053 10318 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:29.780628 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.713042 12105 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:29.798462 12105 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.803156 12105 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:29.852581 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 340020us
I20260709 13:15:29.853734 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:29.854948 12177 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:29.855420 12177 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.855813 12177 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.862723 12099 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:29.863556 12099 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:29.898995 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 114444us
I20260709 13:15:29.673655 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.902168 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.903335 10249 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:29.902168 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:29.903913 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 224836us
I20260709 13:15:29.903951 10318 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.675725 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:29.905462 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51861.5us
I20260709 13:15:29.906208 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.909749 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.912812 10318 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:29.898296 12142 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.905665 10247 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:29.916858 11002 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:29.923185 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.924624 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:29.924775 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 213006us
I20260709 13:15:29.925266 11002 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:29.916918 11001 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:29.927405 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.934679 11002 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:29.936509 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.936851 12074 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:29.937417 12057 consensus_meta.cc:287] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.713s	user 0.001s	sys 0.014s
I20260709 13:15:29.936750 11979 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:29.938539 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.939008 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:29.939845 12138 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.939924 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.940137 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.941457 12075 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.941828 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:29.920217 12096 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.942942 12099 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:29.942737 12096 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.943712 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:29.939921 10245 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:29.944032 12104 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.652s	user 0.019s	sys 0.002s
I20260709 13:15:29.944285 11981 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:29.944775 11981 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:29.944677 12104 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:29.945127 12096 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.945832 10995 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:29.937837 12057 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:29.946862 10246 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:29.946638 12164 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:29.945847 10243 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:29.947808 12057 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:29.948504 10317 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:29.949353 12049 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.945214 11981 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.949587 12105 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:29.953751 12039 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.719s	user 0.014s	sys 0.004s
I20260709 13:15:29.957460 12103 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:29.961392 12094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.006s	sys 0.014s
W20260709 13:15:29.961947 12094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.006s	sys 0.014s
I20260709 13:15:29.963574 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:29.967361 12104 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:29.934597 10290 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.969682 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.965330 10967 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.971338 12049 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:29.955857 11905 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:29.973652 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 57886.1us
I20260709 13:15:29.982678 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:29.974246 12095 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:29.971731 10290 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.981629 12049 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:29.984212 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50417.8us
I20260709 13:15:29.986205 10290 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.990589 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:29.991806 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:29.992786 10249 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:29.996757 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.989172 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:29.956961 12039 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.013347 10247 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:30.016929 10242 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:30.017490 12110 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:30.018110 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:29.998829 12049 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.018354 12165 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.017515 12154 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:30.020241 12165 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:30.020517 12049 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:30.020644 12165 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:29.998160 12094 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:30.018658 11953 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.534s	user 0.017s	sys 0.000s
I20260709 13:15:30.030332 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:29.982643 12099 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:30.023160 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:30.024112 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 55360.2us
I20260709 13:15:30.024658 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.027587 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.027966 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.029317 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.031066 10322 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:30.032209 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.035861 10319 raft_consensus.cc:2376] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4. Re-sending same reply.
I20260709 13:15:30.033355 10317 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:30.037492 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:30.038410 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:30.038882 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 121789us
I20260709 13:15:30.039915 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:29.988222 12096 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.035029 10325 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:30.034536 10318 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:30.035037 10320 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:30.034049 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:30.043838 10321 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:30.058573 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.032859 11908 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.998173 12147 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:30.075677 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52109.9us
I20260709 13:15:30.043248 12057 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.076040 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:30.035497 12145 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.077730 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.038619 12103 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.021694 12165 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:30.082182 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48224.5us
I20260709 13:15:30.057653 12095 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:30.084362 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.035303 12099 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:30.070497 12161 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.095227 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:30.032922 12094 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:15:30.057720 12140 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.033126 11953 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.057582 12060 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:15:30.083976 11908 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.110544 12057 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.128015 12149 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.129745 11908 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.095710 12153 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:30.069864 12156 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:15:30.082551 12074 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:15:30.155508 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.094722 10316 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:30.092669 12145 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.133744 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:30.111743 12095 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.165210 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:30.114190 12099 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.113044 12147 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:30.161873 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 74116.6us
W20260709 13:15:30.181757 12184 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:15:30.135061 12161 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.179397 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.130106 12057 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.134053 12075 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.153761 12150 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.195988 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:30.164844 12145 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:30.199606 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 115327us
I20260709 13:15:30.168619 12095 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.168253 11936 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.198433 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.113570 12103 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:15:30.161520 11981 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.192073 12060 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:30.213340 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.203411 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:30.196636 11905 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:30.232944 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 62939.1us
I20260709 13:15:30.234161  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:30.247887 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44565.6us
I20260709 13:15:30.248209 11979 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:30.248692 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:30.248802 11979 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:30.250605 12142 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:30.251123 12142 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:30.245679 12075 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.231853 12060 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.252832 12060 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.234467 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.236591 12103 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.254918 12062 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.260583 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.261528 10316 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:30.262583 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:30.263060 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.198812 11996 raft_consensus.cc:2764] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:30.200835 12150 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.218936 12162 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:30.241415 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.219897 11939 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:30.251981 12142 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.332477 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.333742 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:30.236905 12192 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:30.235688 12202 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:30.331163 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.336887 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:30.264144 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:30.264614 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.264797 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:30.237558 12191 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:15:30.268313 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:30.268414 12198 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:15:30.270991 11981 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.271153 12178 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.348125 12178 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:30.349494 12195 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:15:30.272181 12161 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:30.273207 12189 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:30.274506 12150 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.274852 12149 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.284596 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.351799 12156 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.286546 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.198947 12057 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:15:30.195217 12066 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.246243 11908 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:30.245574 11953 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.345865 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.347550 12034 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.249774 11979 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.265925 12039 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:30.341729 10325 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:30.386718 11981 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:30.385812 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.266288 11905 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.401365 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:30.402805 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.405193 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:30.413962 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 166107us
I20260709 13:15:30.414799 10241 raft_consensus.cc:2393] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:30.414894 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.281250 12177 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.341708 12095 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.341351 12205 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:15:30.415922 12126 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.515268 12126 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.470645 12200 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.524178 10248 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:30.446736 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.438360 12140 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.383630 12066 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:30.578158 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 192496us
I20260709 13:15:30.580179 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.470923 12203 raft_consensus.cc:993] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:30.332677 12162 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.517585 12126 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.592926 10398 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:15:30.446352 12039 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.584767 12199 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.590270 12074 raft_consensus.cc:1081] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:15:30.514070 12145 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.623761 12145 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.623937 11905 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.588272 12060 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.626339 12060 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.609161 12039 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.631520 12162 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.629369 12099 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:30.637308 12207 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.399s	user 0.005s	sys 0.003s
I20260709 13:15:30.646070 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:30.664161 12048 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.664518 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:30.664815 12048 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.666405 10998 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:30.615890 12199 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.667035 12048 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.650375 12146 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:30.668949 12199 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.669641 12095 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:30.670248 12177 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:30.677614 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.717265 12165 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.723376 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.724450 12039 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:30.736902 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 290066us
I20260709 13:15:30.740152 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.741232 12100 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.741694 12100 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:30.742663 12100 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.743973 12142 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:30.744756 12099 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.745082 12198 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:30.745524 12198 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:30.746480 12198 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.747855 12198 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.732426 11996 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.760254 11996 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.766211 11996 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.767016 12104 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:30.767606 12104 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:30.744024 12100 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.768656 12104 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.780172 12066 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.787400 12105 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:30.787803 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:30.787808 12104 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:30.789110 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.796923 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.798105 10318 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:30.802614 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.804042 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.804800 10316 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:30.806327 10320 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:30.809819 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:30.811651 10324 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:30.817067 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:30.817870 10996 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:30.818905 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:30.820873 10998 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:30.821002 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:30.821990 10993 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:30.822947 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:30.823536 11000 raft_consensus.cc:2376] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3. Re-sending same reply.
I20260709 13:15:30.824465 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:30.826121 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:30.826990 10399 raft_consensus.cc:2393] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:30.835939 11001 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:30.841006 11002 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:30.842609 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:30.937391 10245 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:30.847607 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:30.850433 12205 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.938293 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:30.938514 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 90972.1us
I20260709 13:15:30.851281 12164 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.851893 10995 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:30.857075 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.860643 12066 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.942019 12066 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:30.944339 12066 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:30.946026 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:30.949199 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:30.949872 12164 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:30.952160 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:30.952647 12164 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.953246 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.870301 10396 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:30.872385 12178 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:30.872866 10394 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:30.873160 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.873469 12049 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.874163 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:30.875312 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:30.876379 12070 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.878290 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.001863 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:31.002563 10320 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.878779 12074 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:30.880860 10144 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.882930 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:30.884616 10146 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 204) took 4756 ms. Trace:
I20260709 13:15:31.012537 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.889254 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:31.013432 10394 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:30.891463 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:30.895437 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:30.904290 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.011533 12077 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:30.905859 10243 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:30.907274 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:30.908768 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:30.914633 12226 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.101s	user 0.037s	sys 0.048s
I20260709 13:15:31.027453 12204 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.027603 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.028263 12204 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.031159 12074 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:30.914810 12223 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
W20260709 13:15:30.914638 12220 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.152s	user 0.002s	sys 0.004s
W20260709 13:15:30.914638 12197 log.cc:927] Time spent T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.667s	user 0.014s	sys 0.016s
I20260709 13:15:30.916848 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:30.915867 12182 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.784s	user 0.000s	sys 0.021s
I20260709 13:15:30.920527 12156 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:30.921909 12196 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.683s	user 0.003s	sys 0.019s
I20260709 13:15:30.931885 12217 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.934211 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:30.934760 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:31.052523 10395 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.935695 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.054451 10391 raft_consensus.cc:1813] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Handling vote request from an unknown peer cb71def93f904f619a1527aa48a32294
I20260709 13:15:30.936406 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:30.936491 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.054973 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.055452 10392 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
W20260709 13:15:31.055800 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 119398us
I20260709 13:15:31.049276 10325 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:30.939752 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:30.949952 11002 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:30.963817 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:30.939478 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.057260 10322 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.057431 10321 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:30.938797 12205 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:30.971043 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.006902 10397 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:31.009699 10250 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:31.010923 12105 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:31.011303 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.061709 10391 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:15:31.061949 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 50791.3us
I20260709 13:15:31.062821 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.014678 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.064181 10318 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:31.065488 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:31.070277 10318 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:31.071579 10318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:15:31.072335 10318 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.072875 10318 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:31.046043 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.076515 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.077181 10321 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:31.078318 10321 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:31.078898 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.080135 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.000463 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.014645 10323 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:31.081238 12221 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:31.040601 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:31.041584 12074 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:31.016458 12096 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.082336 12096 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.035637 10319 raft_consensus.cc:2410] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:30.966673 11981 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.964007 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.056533 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:31.081359 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 80983.3us
I20260709 13:15:31.042874 10249 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:31.088295 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.089488 10395 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
W20260709 13:15:31.090879 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 126927us
I20260709 13:15:31.050850 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.093868 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:31.097360 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.099417 10320 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:31.104691 10318 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.095348 10324 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:31.047549 12165 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.109342 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.110649 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.110033 10320 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:31.111349 10325 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:31.115187 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.110133 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.122783 10324 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:31.019119 12049 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.135202 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.012818 10146 rpcz_store.cc:276] 0709 13:15:26.127859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.130354 (+  2495us) service_pool.cc:224] Handling call
0709 13:15:30.884495 (+4754141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:29.362471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:29.373556 (+ 11085us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:29.373596 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:15:29.373613 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:29.374174 (+   561us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:29.374248 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:29.374275 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:15:29.374615 (+   340us) tablet.cc:701] Row locks acquired
0709 13:15:29.374632 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:29.374786 (+   154us) write_op.cc:270] Start()
0709 13:15:29.374910 (+   124us) write_op.cc:276] Timestamp: P: 1783602929374741 usec, L: 0
0709 13:15:29.374934 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:15:29.375624 (+   690us) log.cc:844] Serialized 1302 byte log entry
0709 13:15:29.971664 (+596040us) op_driver.cc:464] REPLICATION: finished
0709 13:15:30.099395 (+127731us) write_op.cc:301] APPLY: starting
0709 13:15:30.112559 (+ 13164us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:30.151204 (+ 38645us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:30.183077 (+ 31873us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:30.242463 (+ 59386us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:30.242648 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:15:30.242697 (+    49us) write_op.cc:312] APPLY: finished
0709 13:15:30.242940 (+   243us) log.cc:844] Serialized 35 byte log entry
0709 13:15:30.243126 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:30.243216 (+    90us) write_op.cc:454] Released schema lock
0709 13:15:30.243274 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:30.243639 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:30.243668 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":868011,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":107434,"apply.run_cpu_time_us":3205,"apply.run_wall_time_us":158692,"num_ops":3,"prepare.queue_time_us":463277,"prepare.run_cpu_time_us":10689,"prepare.run_wall_time_us":327955,"raft.queue_time_us":285004,"raft.run_cpu_time_us":4794,"raft.run_wall_time_us":68152,"replication_time_us":596597,"thread_start_us":929167,"threads_started":4,"wal-append.queue_time_us":296490}]]}
I20260709 13:15:31.122663 10967 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.083984 12202 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.035532 12070 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.045593 12077 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.106961 12171 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:31.105141 12062 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.107216 12163 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:31.104744 12066 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:31.144920 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 1833) took 1111 ms. Trace:
I20260709 13:15:31.135890 11979 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:31.150962 11979 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.138325 12204 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.150862 10319 rpcz_store.cc:276] 0709 13:15:30.037073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.037250 (+   177us) service_pool.cc:224] Handling call
0709 13:15:31.144683 (+1107433us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400114c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:31.144841 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292757248}
I20260709 13:15:31.151536 11979 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.156922 12205 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:31.158596 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:31.145200 12099 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:31.160025 12060 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.114194 12214 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:31.160559 12060 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.161022 12060 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.160941 12214 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.159088 12096 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.164381 12049 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.125874 12165 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.165324 12214 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.166425 12074 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:31.139647 12202 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:31.171275 12202 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.175381 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:31.176743 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52984.6us
I20260709 13:15:31.178156 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:31.180014 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.149580 12062 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:31.192934 12062 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.193240 10245 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:31.188752 10249 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:31.097502 12105 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.197574 12105 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.198117 12140 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.106947 12153 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:15:31.191866 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.203754 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.204855 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.148900 12190 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.149698 12221 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:31.223647 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.107506 11981 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.083758 12217 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.191164 11996 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.191556 12178 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:31.184010 12171 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:31.238269 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 163163us
I20260709 13:15:31.208554 12239 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.145622 12039 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:15:31.210286 12047 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.215253 12096 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.208635 11856 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:31.250699 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.239449 11996 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:31.215176 12149 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:15:31.258755 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.209249 12204 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:15:31.246194 12140 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:31.271343 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:31.274477 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 159380us
I20260709 13:15:31.282444 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.283010 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:31.265009 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 152380us
I20260709 13:15:31.278090 11996 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.273006 12105 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:31.274533 12096 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.270753 12047 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.266352 12239 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.307832 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.311239 12070 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.312368 12077 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.264645 12200 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:15:31.313603 12165 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.315022 12062 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.298416 12163 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:31.265944 12066 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:15:31.305051 12171 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.303234 12074 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:31.300182 12103 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.392969 12103 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:31.393546 12103 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.383988 12142 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:31.336333 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.341741 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.394357 12142 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:31.394729 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 53121.2us
I20260709 13:15:31.394930 12142 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:31.395702 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.397329 12096 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.397858 12096 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:31.398433 12163 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:31.398444 12204 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:31.346411 10318 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:31.348430 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 56461.5us
I20260709 13:15:31.400120 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.343340 12202 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:31.379271 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 71528.1us
I20260709 13:15:31.402254 12202 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.402140 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.334061 12075 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:31.402961 12075 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:31.403043 12154 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.403414 12075 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.404696 12205 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:31.405350 12205 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.298007 12039 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:15:31.389876 12239 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.338798 10322 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:31.391191 12062 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.399463 12163 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.426040 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:31.426682 10241 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.426934 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.428208 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.399945 12047 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.400724 12096 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:31.429489 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:31.430052 10394 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:31.430430 10394 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:31.430151 12096 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:31.430846 12238 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:15:31.431151 10394 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.432230 10394 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.385851 11979 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.438529 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.439766 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.440200 11979 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.441974 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:31.447757 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.449061 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:31.449970 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45654.7us
I20260709 13:15:31.450973 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:31.282470 12140 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:31.451639 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.451874 12140 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:31.450906 12039 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:31.452873 12178 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.453269 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.395754 11981 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.410477 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.455842 10243 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:31.456903 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.415936 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.416666 10399 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:31.425042 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.461714 10391 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:31.463034 11979 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:31.463523 11979 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.464171 11979 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:31.464535 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.464982 12156 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:31.465489 12216 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:31.465915 12216 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.466202 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.466602 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.467541 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.467711 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.468508 12198 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:31.468788 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.466327 12216 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:31.468887 12198 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.469792 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.470067 12198 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:31.467473 12178 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.470619 12178 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.453661 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.470475 11002 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 1.
I20260709 13:15:31.471081 12178 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.472350 10244 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:31.475605 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.476708 11002 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:31.466075 12074 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:15:31.479839 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.481469 12047 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.481865 12047 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.482209 12047 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.487210 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.487953 10322 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:31.489415 11996 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.491180 10318 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:31.506825 10318 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:31.492995 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.499768 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.500527 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.503320 10394 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:31.523197 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.526588 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:31.576329 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47865.2us
I20260709 13:15:31.449031 12060 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.534466 12205 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.537290 12190 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.575208 12077 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:31.520763 12075 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:31.589545 12238 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:15:31.525756 12095 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:15:31.535398 12070 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:15:31.532523 12142 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.590425 12205 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.582168 12154 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:15:31.619333 12217 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.631718 12237 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:31.632324 12237 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:31.623028 12205 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.633404 12237 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:31.655915 12232 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.429s	user 0.000s	sys 0.006s
I20260709 13:15:31.678794 12237 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.707515 12178 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:31.788096 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 210724us
I20260709 13:15:31.789103 11996 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:31.790402 10967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.019s	sys 0.045s
W20260709 13:15:31.791006 10967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.019s	sys 0.045s
I20260709 13:15:31.791456 12105 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.793097 12142 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:31.794538 12153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.002s	sys 0.006s
W20260709 13:15:31.795176 12153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.003s	sys 0.006s
I20260709 13:15:31.437830 10241 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
W20260709 13:15:31.748876 10144 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.000s	sys 0.020s
I20260709 13:15:31.798851 12075 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:31.799464 10144 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.000s	sys 0.021s
I20260709 13:15:31.789734 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:15:31.494406 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 158101us
I20260709 13:15:31.801906 12142 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:31.756186 10250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.001s	sys 0.000s
W20260709 13:15:31.803877 10250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.001s	sys 0.001s
I20260709 13:15:31.756644 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:31.757078 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 230331us
I20260709 13:15:31.714110 12198 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.712637 12216 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.789964 12178 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:31.585439 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 408240us
I20260709 13:15:31.605096 12077 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:31.829435 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.009s
I20260709 13:15:31.831704 10395 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:31.834426 11856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.018s
W20260709 13:15:31.837175 10997 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.006s
W20260709 13:15:31.847597 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44006.5us
I20260709 13:15:31.848290 12075 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:31.849170 12150 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:31.866406 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.005s	sys 0.010s
I20260709 13:15:31.866564 12150 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:31.866806 10997 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
W20260709 13:15:31.866621 11856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.018s
I20260709 13:15:31.868180 11856 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:31.848349 12060 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:31.802053 12070 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.870014 11856 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.862283 10248 raft_consensus.cc:1813] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Handling vote request from an unknown peer 73825599c2644b898cebaafbccd86e99
I20260709 13:15:31.870386 12070 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.871503 10248 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 4 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:31.870505 12077 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.854569 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:31.882433 12070 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:31.868409 12150 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.885603 12150 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:31.886650 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 77296.3us
I20260709 13:15:31.886967 12075 consensus_queue.cc:1243] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:31.887869 12075 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:31.888309 12075 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:31.890506 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:31.892867 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:31.894642 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 105263us
I20260709 13:15:31.895056 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:31.890679 12105 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:31.896309 12156 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.896941 12105 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:31.897099 10993 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:31.898571 12162 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:31.898471 12105 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:31.899523 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 46129us
I20260709 13:15:31.922967 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:31.924225 11001 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.936896 12205 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:31.953063 10997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 597) took 1668 ms (client timeout 1518 ms). Trace:
I20260709 13:15:31.941289 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.959141 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:31.959697 10391 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:31.960145 10248 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:31.943270 10399 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:31.944387 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:31.962931 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:31.944661 12216 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:31.945693 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:31.964411 10393 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.947291 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:31.948472 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:31.889698 12075 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:31.950939 12162 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:31.953907 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:31.955425 10396 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:31.939464 10246 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:31.976734 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:31.954097 12205 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:31.994900 12198 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:31.998714 12218 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:31.999364 12218 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:32.000721 10390 consensus_meta.cc:287] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.005s
I20260709 13:15:32.001307 10390 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:32.000993 12218 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.015761 11001 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:32.021947 12047 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.003s
I20260709 13:15:32.030577 12199 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.044910 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:32.043462 10397 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:32.031164 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.050591 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.045500 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:31.958681 10997 rpcz_store.cc:269] 0709 13:15:30.284517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.330835 (+ 46318us) service_pool.cc:224] Handling call
0709 13:15:30.875137 (+544302us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:31.952702 (+1077565us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400611554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:31.952935 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470365440}
I20260709 13:15:32.029981 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 328) took 1094 ms. Trace:
I20260709 13:15:32.055054 10390 rpcz_store.cc:276] 0709 13:15:30.935132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.945761 (+ 10629us) service_pool.cc:224] Handling call
0709 13:15:32.029667 (+1083906us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540021b454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:32.029893 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503810304}
I20260709 13:15:32.047327 10394 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.060750 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:32.029043 12258 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:32.035982 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.062692 11000 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:32.062755 12074 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:32.064316 12074 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:32.034473 12140 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.006s
I20260709 13:15:32.064822 12074 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.065496 12140 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.068538 10249 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:32.073151 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 124906us
I20260709 13:15:32.073484 12221 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:32.064433 12103 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.670s	user 0.004s	sys 0.009s
I20260709 13:15:32.022194 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.075122 10322 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.074412 12103 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.075693 12221 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:32.076574 10241 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.042604 12077 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:32.035017 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 97967.8us
I20260709 13:15:32.079807 10320 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:32.080571 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.089956 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:32.076206 12221 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.044379 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.015034 12100 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.097555 10393 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:32.019992 12218 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.118381 10248 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:15:32.107671  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:32.119611 10396 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:15:32.119208 10248 pending_rounds.cc:85] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 3
I20260709 13:15:32.110554 12237 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:32.105432 12077 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.133337 10322 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:32.105768 12140 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:32.131434 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2759551230001307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 13:15:32.135809 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2642551230001118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:15:32.136111 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1641929689999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:15:32.136415 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1013634910000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:15:32.131664 12237 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.138448 12140 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:32.138758 12237 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:32.139175 12257 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
I20260709 13:15:32.139691 12162 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:32.112849 12074 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.139293 12140 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.103284 12047 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.122675 10248 pending_rounds.cc:107] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 13:15:32.144402 12075 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:32.155922 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 50934.1us
I20260709 13:15:32.157115 12039 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:32.175769 10323 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:32.145337 11979 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.005s
I20260709 13:15:32.157405 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.176492 11979 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.179383 11979 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:32.145557 12199 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:32.180590 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:32.181056 12199 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.134608 12100 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.166112 12140 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:32.166391 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 85983.2us
I20260709 13:15:32.167148 12171 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.167687 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.162982 12237 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.169215 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.174665 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.174968 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.170843 10248 raft_consensus.cc:2917] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 13:15:32.163046 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.189402 11979 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:32.190420 12269 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.145s	user 0.000s	sys 0.003s
I20260709 13:15:32.189440 12205 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:32.191998 12259 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 13:15:32.193889 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:32.194795 12163 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:32.196245 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:32.196921 12266 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.146s	user 0.001s	sys 0.001s
I20260709 13:15:32.197904 12047 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.199846 11000 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:32.151638 12103 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.213963 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.205132 10394 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:32.225766 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:32.243598 12205 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:32.244136 12205 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.223528 12163 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:32.245217 12205 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.246089 12163 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.248373 12198 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:32.249043 12198 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.225600 12140 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.251374 10248 raft_consensus.cc:2889] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:32.252180 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39862 (request call id 83) took 7907 ms. Trace:
I20260709 13:15:32.252625 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:32.256565 12265 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.226s	user 0.002s	sys 0.001s
W20260709 13:15:32.259232 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 96348.7us
I20260709 13:15:32.259972 12216 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:32.260116 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.260665 12216 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.261740 12103 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:32.263301 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.246088 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.264556 12171 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.268569 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:32.269332 10393 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:32.269577 10396 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:32.266229 10145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 307) took 5597 ms. Trace:
I20260709 13:15:32.204722 12251 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:32.277777 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51285.2us
I20260709 13:15:32.236497 12074 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.270929 10145 rpcz_store.cc:276] 0709 13:15:26.668857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.669084 (+   227us) service_pool.cc:224] Handling call
0709 13:15:32.265985 (+5596901us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133107,"reported_tablets":4}
I20260709 13:15:32.245250 12100 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:32.312387 12271 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.241s	user 0.003s	sys 0.000s
I20260709 13:15:32.314805 10321 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:32.319113 12273 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 13:15:32.319310 12198 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:32.320227 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 53197.6us
I20260709 13:15:32.321204 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:32.324971 10324 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.326819 10324 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.329290 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.329684 10144 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 312) took 5808 ms. Trace:
I20260709 13:15:32.285667 12218 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:32.340583 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 171514us
W20260709 13:15:32.333356 12257 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:32.347434 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.252553 10248 rpcz_store.cc:276] 0709 13:15:24.345216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.346155 (+   939us) service_pool.cc:224] Handling call
0709 13:15:24.359015 (+ 12860us) log.cc:844] Serialized 501 byte log entry
0709 13:15:32.252046 (+7893031us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8629,"raft.queue_time_us":12762,"raft.run_cpu_time_us":990,"raft.run_wall_time_us":990,"thread_start_us":121191,"threads_started":1,"wal-append.queue_time_us":121571,"wal-append.run_cpu_time_us":1596,"wal-append.run_wall_time_us":1003642}
I20260709 13:15:32.326855 12164 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.351078 12205 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.354858 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.358134 12216 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.358469 12140 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:32.366102 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:32.362123 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.362617 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 55206.7us
I20260709 13:15:32.362694 12103 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:32.370065 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.369995 11856 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:32.364372 12164 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.373998 12164 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:32.374500 10134 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:15:32.375334 12164 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.370352 12140 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:32.376704 12140 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.370925 12218 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.379206 12218 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.382400 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.382839 12199 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:32.383495 12199 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.385635 12199 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.365579 12163 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.389834 10288 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.395804 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.407545 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.391206 11996 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.412949 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:32.413719 10321 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.423919 12100 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:32.426084 12100 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:32.426612 12100 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.428103 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.429150 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.435334 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:32.430111 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:32.458199 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 112189us
W20260709 13:15:32.446779 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80739.9us
I20260709 13:15:32.485689 10393 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:32.409734 12199 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:32.498215 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 90834.3us
I20260709 13:15:32.434887 10997 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:32.336367 10144 rpcz_store.cc:276] 0709 13:15:26.520931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.521101 (+   170us) service_pool.cc:224] Handling call
0709 13:15:31.800203 (+5279102us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:31.800269 (+    66us) write_op.cc:454] Released schema lock
0709 13:15:32.329613 (+529344us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:31.639932 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:31.649567 (+  9635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:31.649612 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:15:31.649638 (+    26us) tablet.cc:662] Decoding operations
0709 13:15:31.650043 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:31.650138 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:31.650177 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:31.650436 (+   259us) tablet.cc:701] Row locks acquired
0709 13:15:31.650462 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:15:31.650640 (+   178us) write_op.cc:270] Start()
0709 13:15:31.650776 (+   136us) write_op.cc:276] Timestamp: P: 1783602931650584 usec, L: 0
0709 13:15:31.650805 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:15:31.651639 (+   834us) log.cc:844] Serialized 541 byte log entry
0709 13:15:31.705577 (+ 53938us) op_driver.cc:464] REPLICATION: finished
0709 13:15:31.711426 (+  5849us) write_op.cc:301] APPLY: starting
0709 13:15:31.711542 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:31.711690 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:31.711893 (+   203us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:31.712188 (+   295us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:31.712431 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:31.712525 (+    94us) write_op.cc:312] APPLY: finished
0709 13:15:31.712782 (+   257us) log.cc:844] Serialized 23 byte log entry
0709 13:15:31.712976 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:31.713060 (+    84us) write_op.cc:454] Released schema lock
0709 13:15:31.713099 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":204016,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":5518,"apply.run_cpu_time_us":2028,"apply.run_wall_time_us":2028,"num_ops":1,"prepare.queue_time_us":597531,"prepare.run_cpu_time_us":3971,"prepare.run_wall_time_us":62818,"raft.queue_time_us":4069,"raft.run_cpu_time_us":2395,"raft.run_wall_time_us":8493,"replication_time_us":54568,"thread_start_us":819459,"threads_started":4,"wal-append.queue_time_us":47213}]]}
I20260709 13:15:32.443835 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:32.461843 12237 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.434254 12216 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:32.513935 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.435138 12171 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:32.514318 12198 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.519493 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.410550 12221 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.509094 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.507766 11856 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:32.531337 11856 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:32.508028 12286 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:15:32.541453 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.541435 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.531710 11856 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:32.506336 12162 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:32.550642 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.553751 10241 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.551311 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.551946 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.552593 10249 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:32.555974 10243 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:32.519493 12163 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.527217 12199 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:32.563256 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 57439.4us
W20260709 13:15:32.564749 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 134837us
I20260709 13:15:32.565405 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.568133 10246 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:32.506166 12100 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.513935 12140 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.517323 12190 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:32.573220 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 79900us
I20260709 13:15:32.584609 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:32.577026 12199 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.578197 12142 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:32.578521 10317 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:32.578949 12178 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:32.580210 12100 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:32.553287 12162 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:32.569357 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.596203 10248 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:32.588480 10288 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.589323 12095 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:32.591177 12171 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:32.518734 12216 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:32.598492 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.575103 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:32.562422 12047 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:15:32.597900 12162 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.608767 12288 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.616287 11996 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:32.616452 12216 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.616861 11996 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:32.617142 11856 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.618521 11856 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.620004 12140 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.602540 12178 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.623715 12237 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.628969 10316 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:32.629817 12178 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.622032 12142 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.632409 12075 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.635239 12221 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:32.617797 11996 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.815598 12075 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:32.816253 12142 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.816468 11996 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.816680 12075 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.654368 12199 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:32.654417 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 83576.8us
I20260709 13:15:32.819337 12221 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:32.819864 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:32.821040 12140 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.603081 12190 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:32.679680 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 121826us
I20260709 13:15:32.822907 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.823711 12103 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.823796 12142 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:32.824185 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.824505 12103 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:32.824637 12142 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.825994 12164 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.825471 12103 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.826326 12154 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:32.828025 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.828414 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.842994 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.843956 12149 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:32.844233 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.844609 12149 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:32.845202 12149 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.844954 10145 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.846349 12154 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:32.846683 12154 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.825762 12142 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.847600 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.848390 12154 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.850126 10247 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:32.850728 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:32.855803 10241 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:32.811090 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:32.605166 12156 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:32.823010 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:32.839291 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.817970 12075 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:32.841779 10244 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:32.860903 12099 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.847208 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.846629 10145 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 3 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:32.862129 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 240601us
I20260709 13:15:32.862694 10145 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:32.863201 12199 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:32.864034 12199 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.824131 12190 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:32.864403 12199 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:32.864902 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.865706 10246 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:32.865257 12199 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.868084 12218 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:32.868592 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.868856 12218 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.869844 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.870590 12199 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:32.870954 12218 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.833034 10398 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:32.856873 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.854421 12251 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39862 (request call id 82) took 8468 ms. Trace:
I20260709 13:15:32.874590 12198 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:32.874413 12251 rpcz_store.cc:276] 0709 13:15:24.343046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.343416 (+   370us) service_pool.cc:224] Handling call
0709 13:15:24.389397 (+ 45981us) log.cc:844] Serialized 501 byte log entry
0709 13:15:24.580926 (+191529us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b18001b9e80. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:15:32.729984 (+8149058us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11127,"raft.run_cpu_time_us":1492,"raft.run_wall_time_us":28241,"spinlock_wait_cycles":21079936,"thread_start_us":391179,"threads_started":2,"wal-append.queue_time_us":133693,"wal-append.run_cpu_time_us":2255,"wal-append.run_wall_time_us":1048965}
I20260709 13:15:32.876747 12190 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:32.877179 12190 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:32.878104 12190 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:32.878882 12164 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.879022 10134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7df30c54c90e4fcfaeb14736ccbcec7c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.879558 12190 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:32.881752 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:32.881860 12240 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.886689 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.885356 12240 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.887871 12105 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:32.888504 12105 consensus_queue.cc:1243] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:32.864835 10145 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:32.882401 12291 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:32.891016 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.893146 10997 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:32.892889 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.892825 12291 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.889972 12237 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.889776 12240 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.894977 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.881271 12154 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:32.897565 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 274281us
I20260709 13:15:32.890475 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:32.917410 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.919804 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.916705 12240 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.920588 12240 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:32.920967 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.921702 12240 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.922554 12164 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:32.923168 12164 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.923614 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.916951 12237 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:15:32.925266 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.925395 12164 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:32.916798 12218 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.927687 12099 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:32.928112 12099 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:32.928568 12099 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.930550 12247 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.898842 12075 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:32.933342 12291 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:32.934109 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 111344us
I20260709 13:15:32.860244 12162 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.938167 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.939641 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:32.944152 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.890434 12156 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.950811 12199 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:32.951366 12199 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:32.951296 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.949223 12218 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.952220 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.948367 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.954348 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:32.954589 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 51908.9us
I20260709 13:15:32.958563 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.949991 12217 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:32.963789 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:32.965883 12216 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:32.962595 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:32.939705 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:32.969887 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.955641 12199 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:32.982189 11000 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:32.982420 10325 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:32.983888 12292 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:32.984404 12292 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:32.982508 12216 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:32.986829 10243 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:32.987272 10243 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:32.988344 10243 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:32.989526 10243 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.002373 12047 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.002624 12103 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.004462 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.008909 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.002797 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:32.985507 12292 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.008302 12291 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:15:33.010200 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.011698 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:33.027783 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.019164 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:33.019232 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:33.017652 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:33.017935 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.036552 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.039034 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:33.060786 10243 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:33.062469 10318 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:33.069473 10243 pending_rounds.cc:85] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 1
I20260709 13:15:33.070003 10243 pending_rounds.cc:107] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:33.070346 10243 raft_consensus.cc:2889] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:33.010823 11979 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.074128 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:33.075558 10397 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:33.079854 10398 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:33.017175 12218 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.088346 10393 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:33.042516 12198 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.014830 12100 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:33.016582 12291 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.093811 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:33.068271 11856 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.100032 10396 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:33.078949 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:33.100546 11000 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:33.060310 12149 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:33.041580 12103 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:33.097636 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 89505.9us
I20260709 13:15:33.100610 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:33.018798 12039 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:15:33.015641 12095 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:15:33.119856 10399 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:33.113298 12149 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:33.126721 12149 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:33.126926 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:33.130003 12099 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.130568 12142 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.131162 12142 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.131742 12164 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.132342 12099 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:33.099092 12100 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:33.132290 12164 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.133610 12100 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.135131 10397 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:33.135357 12100 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.089881 12178 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:15:33.138074 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:33.122782 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:33.139029 10390 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:33.131774 12162 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:33.145983 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:33.152252 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.157290 12199 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.159919 12199 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.167704 12156 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.092941 12247 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:33.179646 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:33.187829 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 262681us
I20260709 13:15:33.194211 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.181712 12199 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.161233 12190 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:33.210181 12291 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:33.198573 12103 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.243615 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.219326 12199 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:33.251549 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:33.254145 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:33.264170 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.267038 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:33.270915 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.277827 12142 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.255511 12171 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:33.295187 12164 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.295509 12308 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.279737 10322 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:33.272658 12218 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.239466 12247 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.284018 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:33.305119 10288 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.314632 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:33.315500 11001 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:33.316356 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:33.321269 12177 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:33.321758 12177 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.322121 12177 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:33.332442 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.310722 12047 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.344416 10317 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:33.346202 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:33.350220 10396 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:33.351672 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:33.354581 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:33.355504 10399 raft_consensus.cc:2393] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:33.356348 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:33.358433 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:33.360853 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:33.346645 11856 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:15:33.361665 10243 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:33.362296 11856 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:33.362655 11856 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:33.363612 10323 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:33.363476 11856 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.364698 11856 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.306593 12218 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:33.366771 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:33.350371 10391 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:33.371002 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:33.371810 10394 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:33.365696 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:33.384900 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:33.385133 12199 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:33.395408 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49423.5us
I20260709 13:15:33.400106 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:33.349295 12095 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:33.384093 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.518s (SENT) [suppressed 14 similar messages]
I20260709 13:15:33.415422 10319 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:33.413980 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 67860.9us
I20260709 13:15:33.389683 12163 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:33.393836 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:33.411480 12199 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:33.423158 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.435747 10321 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:33.438699 12163 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:33.444132 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.430998 12199 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.444331 12171 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:33.454856 12171 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:33.455453 12163 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.455902 12171 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.460892 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.448552 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:33.451402 10397 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:33.452430 10243 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.463022 10243 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:33.464259 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:33.460698 12199 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.469862 12074 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:33.472254 12074 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.472710 12074 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.501147 12156 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:33.505057 10243 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:33.550340 12039 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:33.553340 12039 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:33.554370 12039 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.555550 12039 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.558717 10243 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:33.518327 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.465832 12164 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:33.565594 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 58292.6us
W20260709 13:15:33.574532 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 125147us
I20260709 13:15:33.575551 10243 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:33.578017 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 193932us
I20260709 13:15:33.579311 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:33.579783 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.501799 12156 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:33.581496 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.583416 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.505839 12100 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:33.588487 12216 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.609041 12163 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:33.609886 12163 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.611150 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:33.617780 12163 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:33.619267 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:33.619786 11001 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:33.591781 12218 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:33.640707 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.602769 12103 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:33.630754 10134 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ab33f0a79ddf4f5a8ba81b3b0e120529 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:33.543282 12149 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.652163 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:33.589794 12308 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:33.579663 12164 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.631683 12162 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.672830 11002 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:33.681694 11001 raft_consensus.cc:1217] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.4->[2.5-4.6]   Dedup: 4.6->[]
I20260709 13:15:33.628175 12216 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:33.682300 11001 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:15:33.659228 12103 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.666421 12251 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.670050 12162 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.676081 12199 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:33.715528 12149 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.717422 12199 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:33.718421 10993 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:33.719621 12216 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:33.720516 12164 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:33.721220 12310 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:15:33.724903 12074 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.726893 12149 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:33.727680 12074 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.727551 12149 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.729559 10241 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:33.727553 12103 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:15:33.730736 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:33.731854 10243 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:33.732693 12149 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.664490 12198 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 13:15:33.814082 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 230769us
I20260709 13:15:33.733223 11996 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:33.856165 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.857276 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.857556 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:33.886994 12324 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:33.894150 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 234217us
I20260709 13:15:33.790417 12075 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:33.840416 12309 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:15:33.858490 11996 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:33.900141 12075 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:33.900821 11996 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.833187 12199 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:33.838827 12164 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.905532 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48115.4us
I20260709 13:15:33.897524 12156 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:33.917593 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:33.920058 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 267955us
I20260709 13:15:33.905236 11996 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.904755 10390 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:15:33.927165 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 201363us
I20260709 13:15:33.924772 12075 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:33.922685 12039 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:33.919832 12314 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:33.967747 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46573.6us
W20260709 13:15:33.949913 12295 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.819s	user 0.007s	sys 0.000s
I20260709 13:15:33.918570 12164 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:33.923699 12199 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.096253 12292 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.099583 12199 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:34.081581 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 132124us
I20260709 13:15:33.944700 12163 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:34.100934 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:33.996937 12325 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:15:33.927407 12154 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.091001 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:34.103216 12154 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.093155 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.101879 12163 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:34.105038 12164 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.082760 12075 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:15:34.105221 12163 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.105609 12325 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:34.094436 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:34.106141 12325 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:34.106523 10995 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:34.101858 12216 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.107708 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.107784 12216 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.092167 12324 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.106082 12075 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:34.105252 12154 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.091038 12321 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:34.081598 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 164139us
W20260709 13:15:34.013029 12318 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:15:34.096985 12039 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.099319 12292 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.126363 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.127136 10994 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:34.128079 12039 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.110960 12075 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:34.129383 12075 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.113634 10398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:34.130623 10398 raft_consensus.cc:606] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.131017 10398 raft_consensus.cc:614] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:34.110589 12324 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.128335 12292 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.097204 11002 raft_consensus.cc:2955] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:34.132543 10393 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:34.138053 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:34.139597 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.082355 12320 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.148970 11001 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:34.113420 12321 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.163429 10399 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:34.165375 10398 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:34.110208 12216 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.166534 12075 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.167394 12154 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.167933 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.168174 10390 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:34.169679 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.194964 10391 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:34.116202 10995 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:34.197602 11000 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:34.198830 12066 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.166005 12321 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.266877 10998 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:34.201968 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.267201 12066 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.267758 10320 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:34.202872 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.268239 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.268901 10319 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:34.269109 10998 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:34.269690 12066 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.198177 12308 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.271020 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.270794 12308 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.271674 10322 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:34.274031 12308 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.161780 12320 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.276604 12320 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.278800 10316 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:34.107183 12325 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.284004 12163 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:34.291117 12177 consensus_meta.cc:287] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.968s	user 0.018s	sys 0.000s
I20260709 13:15:34.291584 12177 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:34.298694 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 197802us
W20260709 13:15:34.296355 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.306094 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:34.306646 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.307098 10398 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.309873 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.208014 12105 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:34.311371 12105 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.313870 12105 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.194309 12199 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:34.336930 10322 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:34.339100 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.302901 12329 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.271615 12324 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.349371 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.350069 10398 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:34.335115 12291 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.351523 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.357534 10316 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.358973 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.359797 10394 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:34.360337 12066 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.198611 12154 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.348409 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.350081 10250 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:34.367054 10322 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:34.352632 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50174.6us
I20260709 13:15:34.369073 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.373008 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.374668 10399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:34.360934 12066 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.347626 12251 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:34.377727 12100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.017s	sys 0.016s
I20260709 13:15:34.435806 10319 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:34.346016 12199 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.425269 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.437763 10322 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:34.439117 10399 raft_consensus.cc:606] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:34.439532 10399 raft_consensus.cc:614] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:34.439500 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 96449.1us
I20260709 13:15:34.433349 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:34.435442 12100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.017s	sys 0.016s
I20260709 13:15:34.445632 10320 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:34.450858 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.372418 12291 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.458882 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.440922 12333 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.441605 12163 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.442369 12251 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:34.446012 11996 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.007s
I20260709 13:15:34.467515 12177 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.445523 12100 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:34.478585 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:34.479277 10997 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.479075 12100 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.468237 12066 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.467577 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.470611 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.471338 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.482308 10241 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:34.456358 12218 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.484076 12199 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.378726 12329 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.472055 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.486280 12291 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.486774 10250 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:34.487104 12337 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:34.489447 12329 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.468070 12154 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.483628 12218 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.495590 12218 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.495743 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.496510 10998 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:34.496764 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.497452 10241 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:34.497659 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.497937 10243 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:34.498340 10244 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:34.498728 10245 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:34.498827 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.464910 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.501888 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.502554 10246 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:34.476613 12333 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.508870 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.510398 12324 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:34.515898 12333 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.518467 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:34.519423 10246 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:15:34.525705 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 58762.8us
I20260709 13:15:34.583603 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.529651 12218 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:34.530921 12324 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.586639 10999 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:34.588402 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.589780 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.590503 11000 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
W20260709 13:15:34.595134 12311 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.006s	user 0.023s	sys 0.007s
I20260709 13:15:34.598264 12218 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:34.599710 12218 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.600777 12240 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:34.601439 12240 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.603757 12240 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.604452 12099 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.604933 12099 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.605283 12099 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.606575 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.607329 10399 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:34.608458 12296 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.609006 12296 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.610440 12199 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:34.611016 12199 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.612003 12296 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.612859 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:34.613381 12199 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.613636 10391 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:34.615145 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.606150 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.615651 12099 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.617270 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.617894 10320 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.617897 12099 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.618706 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.619097 11001 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:34.619448 12332 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:34.619889 12332 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:34.620131 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 1801) took 1277 ms. Trace:
I20260709 13:15:34.620242 12332 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.620574 12099 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:34.620653 10393 rpcz_store.cc:276] 0709 13:15:33.343084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.343203 (+   119us) service_pool.cc:224] Handling call
0709 13:15:33.344132 (+   929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.144715 (+800583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.619788 (+475073us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54002ddf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:34.620058 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812698368}
I20260709 13:15:34.621572 12099 consensus_queue.cc:1243] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:34.619467 11001 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:34.626658 12162 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.627470 11001 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.628684 11001 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:34.631151 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.632861 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.632928 12321 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:34.634428 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.635594 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:34.636421 12321 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:34.636886 12321 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:34.637348 12321 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:34.538170 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.637853 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.638792 12149 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:34.534746 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.639554 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:34.620184 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.639882 10243 raft_consensus.cc:2410] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:15:34.642158 10250 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:34.626049 10320 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
W20260709 13:15:34.646708 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 277732us
I20260709 13:15:34.646860 10245 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:34.647418 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.650930 11001 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:15:34.651758 11001 pending_rounds.cc:85] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 5
I20260709 13:15:34.642638 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.652581 10391 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:34.507596 12105 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.654626 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:34.655234 11001 pending_rounds.cc:107] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:34.655411 10364 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.543555 10316 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
W20260709 13:15:34.567174 12300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.010s	sys 0.016s
W20260709 13:15:34.661430 12300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.018s
I20260709 13:15:34.663086 12332 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.656574 11001 raft_consensus.cc:2889] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.656889 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:34.666203 10245 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:34.659637 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.666447 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:34.526530 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:34.660666 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.657727 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.667471 12154 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.667591 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:34.667924 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:34.668270 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:34.654011 12337 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:34.668748 12105 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.657899 11856 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:34.687903 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.688042 12105 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.672075 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.672825 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.689016 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.687924 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.689617 10247 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:34.646595 12100 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:34.690147 10249 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:34.676312 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:34.685896 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.691313 10323 raft_consensus.cc:2393] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:34.685000 10319 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:34.687088 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.688288 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.674449 12099 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:34.694075 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:34.694660 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.686364 10245 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:34.681468 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:34.695807 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:34.695909 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:34.689540 10241 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:34.693161 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:34.696480 10250 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:34.697459 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:34.660809 10996 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:34.697016 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:34.701534 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49902us
I20260709 13:15:34.702262 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.702428 10247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:15:34.700614 12039 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:34.703696 12039 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:34.704080 12198 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.703698 12171 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:34.705014 12326 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.705509 10316 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:34.704613 12039 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.705468 12326 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.707325 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.697497 12100 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.700632 12217 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:34.706102 12296 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:15:34.665390 12240 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:34.704623 12198 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.689268 12156 raft_consensus.cc:2764] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:34.705708 12323 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:15:34.711834 11979 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:34.710469 12178 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.708709 12337 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:34.698951 12324 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:15:34.733454 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.713689 12217 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.712276 12326 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.700855 11856 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:34.712535 12100 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:34.724522 12332 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:34.704020 12105 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.732251 10247 raft_consensus.cc:606] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.698971 12095 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:15:34.742522 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:34.741366 11979 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.736794 12075 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.730887 12198 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.726868 12142 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.747721 12217 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.731089 12298 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.736418 12344 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:34.745283 12251 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.759302 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.732016 12099 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:34.757481 12103 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:34.752018 10247 raft_consensus.cc:614] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:34.756611 11979 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.776242 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.779558 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.740275 12325 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:15:34.781414 10397 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 2: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:34.744835 12171 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:15:34.781965 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:34.738739 12240 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.778043 10993 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:34.785511 10395 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:34.786698 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.787071 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.787907 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.788517 10394 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:34.789781 12100 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.790714 12337 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.784133 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:34.745654 12178 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.795379 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.806732 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.798923 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.801698 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.830300 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.798121 12095 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:34.836275 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 102876us
I20260709 13:15:34.837175 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:34.758953 12075 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.839052 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.839920 10323 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:34.843358 10321 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:34.784016 12298 raft_consensus.cc:697] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:34.845973 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:34.843371 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.848515 10322 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:34.813620 12237 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:34.797240 11996 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:34.797557 12320 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:34.804505 12334 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:34.804524 12177 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.844383 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.846907 10324 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:34.871806 10317 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:34.781562 12251 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.797262 12321 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.843420 11856 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.883150 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:34.885120 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54952.3us
I20260709 13:15:34.885771 10321 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:34.863252 12298 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.863904 12178 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.813771 12163 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:15:34.864379 11996 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:34.866201 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.792712 12199 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:15:34.870631 12074 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.855904 12237 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.847393 12142 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.842013 12332 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.872956 10322 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:34.849630 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:34.919184 10316 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.846894 12103 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:34.867722 12162 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:34.883150 12355 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:34.919081 12350 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:34.838969 12330 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:15:34.895938 12325 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:34.924813 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.918581 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:34.897671 12353 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.882934 12177 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.936427 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.961551 12356 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:34.941742 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 104679us
I20260709 13:15:34.896904 12308 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:15:34.944231 12163 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.967442 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48981.6us
I20260709 13:15:34.970887 12334 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:34.966946 12047 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:34.972011 12047 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.974182 12047 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.975576 12103 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.975813 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.976924 10394 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:34.977245 11979 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.910537 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.912523 12237 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:34.979081 12343 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:15:34.981050 10317 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
W20260709 13:15:34.982322 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3884854779998932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:15:34.942842 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:34.940464 12332 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:34.945035 12344 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:15:34.983498 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.974982 12356 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:34.935236 12355 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:34.986395 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:34.923504 12142 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.913383 12074 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:34.985641 12240 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:34.988140 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:34.992017 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:35.006206 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:35.080613 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 88706.2us
I20260709 13:15:35.070048 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:34.983109 10390 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:35.082396 10396 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:35.006332 10999 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:34.962584 12325 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.089277 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:35.004813 10997 consensus_meta.cc:287] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.002s
I20260709 13:15:35.092489 12330 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:35.093166 12330 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:35.094288 12217 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.094216 12330 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.094852 12357 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:35.095281 12357 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:35.095580 10391 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:34.966599 12353 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.096557 10246 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:34.953873 12350 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:34.993404 12334 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:34.988719 12163 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.003631 12075 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.004113 12321 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:34.999277 12320 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:15:35.005646 12355 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.129674 10995 raft_consensus.cc:2368] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4.
I20260709 13:15:35.097922 10316 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:35.100032 12353 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:35.099609 10997 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:35.006028 12332 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.095530 12198 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.155187 12142 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:35.170202 12362 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:35.170614 12074 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:35.170909 12362 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.171924 12198 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:35.184911 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.156385 12099 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:35.189230 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:35.005065 12356 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.188165 12198 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.161971 12162 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:15:35.126601 12344 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.197192 12099 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:35.478399 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 164243us
W20260709 13:15:35.458122 12365 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:15:35.482434 10996 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:35.297847 12367 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:15:35.302881 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:35.487414 10241 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.488796 12163 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.466027 12217 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.494124 12099 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:35.221570 12198 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.442576 12237 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.496423 12198 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:35.298626 12100 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:35.403476 12325 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.225550 12362 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:35.304219 11996 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:35.501471 10319 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:35.457592 12350 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.289075 12142 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:35.511727 12368 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:15:35.275812 12357 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.496423 12237 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.548026 10241 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
W20260709 13:15:35.549088 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 69885.6us
W20260709 13:15:35.602823 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:35.568779 12326 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.815s	user 0.016s	sys 0.000s
I20260709 13:15:35.243069 12334 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.564911 12105 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:35.563971 11979 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:35.596081 10993 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:35.602926 11996 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:35.623378 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:35.526301 12142 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.645995 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:35.611776 12105 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:35.649639 12237 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:35.607036 12326 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.659240 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:35.660925 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:35.657562 12376 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:35.761188 12373 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:15:35.761968 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.763556 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 350) took 1024 ms. Trace:
I20260709 13:15:35.765590 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:35.766191 10241 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:35.764087 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:35.769511 10242 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:35.764068 10391 rpcz_store.cc:276] 0709 13:15:34.739117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.739273 (+   156us) service_pool.cc:224] Handling call
0709 13:15:34.739624 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.096011 (+356387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.763299 (+667288us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540021b454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:35.763498 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818083200}
W20260709 13:15:35.760138 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 101588us
I20260709 13:15:35.770522 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:35.770862 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:35.776177 10364 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:35.770512 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:35.792958 10241 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:35.796017 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:35.803907 10243 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:35.796222 10399 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:35.796260 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:35.656463 11996 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.759284 10997 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.769513 12333 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.812336 12099 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:35.808123 12154 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:35.813174 12154 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.813301 12099 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:35.813581 12154 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.813788 12099 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:35.814721 12099 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.812361 12333 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.817013 10243 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:35.817920 12333 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.819118 12099 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:35.820926 10244 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:35.825094 10241 raft_consensus.cc:3055] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:35.828162 10241 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:35.758355 12237 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.838629 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:35.831151 12320 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.843649 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:35.834367 12142 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:35.829377 10241 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.842514 12217 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:35.848765 10241 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:35.854308 10241 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:35.868422 10391 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:35.830448 12105 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:35.846623 12162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.019s	sys 0.044s
I20260709 13:15:35.872270 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:35.874627 12105 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.875095 11996 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:35.875721 12162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.019s	sys 0.044s
I20260709 13:15:35.876797 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:35.870714 12217 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:35.885162 12298 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:35.885648 12217 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.884351 12154 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:35.900712 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:35.912505 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:35.913133 10391 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:35.880714 12333 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.906975 12350 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:35.903689 12325 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:35.927552 12386 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:35.920369 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:35.928249 12386 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:35.928678 10321 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:35.899004 12198 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:35.929177 12386 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:35.929739 12198 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:35.930814 10394 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:35.930703 12198 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:35.931748 12391 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:15:35.849349 12320 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:35.934173 12388 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:15:35.900687 11996 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:35.929044 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:35.938445 10396 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:35.945655 10213 leader_election.cc:400] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4.
I20260709 13:15:35.945999 10213 leader_election.cc:403] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:35.954593 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:35.955315 10321 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:35.956099 12320 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:35.960326 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:35.960956 10247 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:35.966651 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:35.967338 10397 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:35.921381 12375 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:35.978816 10392 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:35.981594 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:35.984632 10396 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:35.959286 12326 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.995162 10997 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:15:35.969082 12329 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.001019 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:35.946691 12350 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:36.002552 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:35.973809 12344 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4.
I20260709 13:15:36.003885 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.005399 10249 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:36.009756 10247 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:35.938817 12333 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.019712 10391 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
W20260709 13:15:36.021341 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.001593 12177 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:36.039410 10364 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:36.029872 11001 raft_consensus.cc:2410] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:36.040652 12177 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:36.041167 12177 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:36.002858 12356 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:36.042165 12177 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.030547 12074 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:36.042351 12356 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.028836 12329 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.043545 12074 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.042582 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.031886 10249 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:36.045768 10241 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:35.945165 11996 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.045219 12329 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:35.983753 12324 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:36.045050 12356 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:35.973308 12039 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:15:36.056622 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:36.094538 10242 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:35.973699 12375 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:36.094189 12364 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.894s	user 0.004s	sys 0.001s
I20260709 13:15:36.094339 10249 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.050201 12066 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.053635 12324 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.051489 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:35.877059 12362 consensus_queue.cc:1175] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73825599c2644b898cebaafbccd86e99" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:36.117729 11996 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.117057 12358 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:36.122067 10249 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:36.137296 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.120954 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 332) took 1375 ms. Trace:
I20260709 13:15:36.152209 12358 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:36.156203 12358 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.119380 12333 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.155436 10250 rpcz_store.cc:276] 0709 13:15:34.745780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.745903 (+   123us) service_pool.cc:224] Handling call
0709 13:15:34.746221 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.896210 (+149989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.896239 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.901352 (+  5113us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.084893 (+183541us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:35.084931 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.980206 (+895275us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:36.003509 (+ 23303us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540006dbd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:36.003567 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.120754 (+117187us) raft_consensus.cc:1685] finished
0709 13:15:36.120773 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.120898 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36992,"raft.queue_time_us":52498,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":21143,"spinlock_wait_cycles":291534976,"thread_start_us":148837,"threads_started":1,"wal-append.queue_time_us":247365}
I20260709 13:15:36.157232 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:36.147131 11979 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.158084 12142 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:36.119357 12375 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.122434 12074 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.158828 12142 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:36.140606 12316 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.126652 12066 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.159628 12316 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:36.114435 12401 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:15:36.159993 12142 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.161837 12066 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:36.158176 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.126808 12324 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.163566 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.164705 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.168809 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.177198 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:36.178045 10391 raft_consensus.cc:606] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.178478 10391 raft_consensus.cc:614] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:36.186988 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 221224us
I20260709 13:15:36.203508 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.208802 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.146596 12326 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.215108 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.217239 10391 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:36.217403 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.218338 10320 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:36.219308 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.224578 12334 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.225312 12334 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.195375 12066 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:36.195832 12074 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:36.161855 12316 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:36.227123 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.227856 10394 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:36.234717 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 64353.2us
I20260709 13:15:36.229696 10325 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:36.205320 12362 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.236359 12362 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.239164 12362 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.158149 11979 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.242884 10290 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:36.272722 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.275309 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:36.276939 11001 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:36.286084 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:36.273793 12367 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:36.288856 10398 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:36.295831 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.294590 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:36.299872 10290 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.300913 10395 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:36.226815 12326 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.286849 12375 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:36.303952 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.307494 10398 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:36.284895 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.284453 12358 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.306097 10391 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:36.299101 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.310994 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.311698 12369 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.312206 12369 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:36.312639 12369 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.312777 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.314909 12358 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.251902 12039 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:15:36.316987 12039 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.317276 12358 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.319108 10243 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:36.319507 10243 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:36.320218 10243 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.321452 10243 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.290117 11996 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.319132 10999 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:36.292847 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.327623 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.343217 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.327178 10394 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:36.341099 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.297608 12240 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.304983 12344 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:36.350099 10394 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:36.297847 12047 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:36.342630 10395 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:36.363107 10398 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:36.358805 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:36.309926 12375 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.322564 11996 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.369544 10249 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:36.373188 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1278) took 1603 ms. Trace:
I20260709 13:15:36.373569 10399 rpcz_store.cc:276] 0709 13:15:34.770816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.770948 (+   132us) service_pool.cc:224] Handling call
0709 13:15:34.785998 (+ 15050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.806289 (+1020291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.372988 (+566699us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b540010b654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:36.373132 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281349888}
I20260709 13:15:36.377283 12412 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:36.377934 12412 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:36.378273 11979 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:36.360657 12344 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.379228 12344 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.378898 12412 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:36.380342 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.383280 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.383937 10244 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:36.382411 12402 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.390906 12402 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.355456 12316 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:36.393221 12402 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:36.368201 12350 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:36.367121 10390 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:36.369689 12177 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:36.372325 12375 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.435151 10244 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:36.408408 12142 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:36.448537 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 43907.2us
I20260709 13:15:36.453485 12142 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.450696 12240 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:36.455482 12371 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:36.456115 12371 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:36.451243 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.404287 12358 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:36.457252 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 268) took 1649 ms (client timeout 1753 ms). Trace:
I20260709 13:15:36.457175 12358 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:36.457759 10318 rpcz_store.cc:269] 0709 13:15:34.808965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.830168 (+ 21203us) service_pool.cc:224] Handling call
0709 13:15:36.408742 (+1578574us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:36.457189 (+ 48447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5043584}
I20260709 13:15:36.434442 12356 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.477641 12358 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.478076 12356 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.479148 12324 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.479594 12039 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:36.435611 11856 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.446012 12325 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:36.489665 12406 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:15:36.491082 11996 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:36.492844 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.494366 12298 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.539696 10318 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:36.476003 12334 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:36.540169 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.542315 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.546453 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:36.550860 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 251034us
I20260709 13:15:36.552085 12105 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.564177 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 604) took 1579 ms. Trace:
I20260709 13:15:36.572988 10993 rpcz_store.cc:276] 0709 13:15:34.984248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.987023 (+  2775us) service_pool.cc:224] Handling call
0709 13:15:34.987358 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.613387 (+626029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.563586 (+950199us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540028f0d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:36.564041 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337693440}
I20260709 13:15:36.560137 12358 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.574757 12358 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.551786 10290 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.568302 12355 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.576617 12331 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:36.579094 12358 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.576143 12105 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:36.582973 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.485510 12039 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:36.587445 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 44122.6us
W20260709 13:15:36.592610 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 138929us
I20260709 13:15:36.593711 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.589325 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.601008 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.604197 10318 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:36.602723 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.605589 10999 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:36.540833 12344 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.542866 12326 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:36.549607 12381 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.610126 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:36.611922 12105 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.612636 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:36.631664 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:36.583523 12251 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.620409 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.515723 11856 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.634960 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.636163 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 264) took 1830 ms. Trace:
I20260709 13:15:36.606666 12356 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.541934 12325 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:36.647848 12415 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:15:36.648497 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.649138 12325 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.649719 12325 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.636703 10319 rpcz_store.cc:276] 0709 13:15:34.806268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.806418 (+   150us) service_pool.cc:224] Handling call
0709 13:15:36.635886 (+1829468us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54002bd754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:36.636079 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586322176}
I20260709 13:15:36.639168 10318 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:36.650674 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.650882 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.582897 12298 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.651139 10323 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:15:36.650008 12418 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:36.651551 10323 pending_rounds.cc:85] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 4
I20260709 13:15:36.651448 10321 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:36.651957 10323 pending_rounds.cc:107] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:15:36.652273 10323 raft_consensus.cc:2889] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:36.653976 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:36.628098 11979 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:36.654594 10321 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.654897 12356 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.639039 12316 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:36.644908 12411 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:36.665030 12325 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.666297 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.667166 12344 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.635118 12417 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:36.667575 12298 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.668119 12412 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:36.600255 12039 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.639493 12326 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:36.686597 10246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1205) took 1774 ms (client timeout 2207 ms). Trace:
W20260709 13:15:36.687371 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.688649 12316 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:36.689204 12356 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:36.687707 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 129910us
I20260709 13:15:36.584017 12371 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:36.688889 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52824.4us
W20260709 13:15:36.690430 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 103156us
I20260709 13:15:36.692221 10318 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:36.693902 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:36.696517 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:36.697043 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.697965 11856 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.807919 12308 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.808444 12308 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.762406 12417 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.809561 12417 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.810597 12308 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:36.810762 12390 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.916s	user 0.005s	sys 0.008s
I20260709 13:15:36.811771 12417 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.736397 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 521) took 1109 ms. Trace:
I20260709 13:15:36.808954 12316 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.814390 10323 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:36.702611 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 71025us
I20260709 13:15:36.668802 12324 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.638862 12217 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:15:36.636777 12381 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.653496 12251 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:15:36.824613 12251 consensus_queue.cc:1243] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:36.825136 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:36.708381 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:36.801232 10320 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:36.774295 10321 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:36.802335 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.767165 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:36.763619 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:36.804200 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.827858 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.828580 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.828995 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.830279 10321 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:36.831101 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.831489 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.831709 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:36.800717 10246 rpcz_store.cc:269] 0709 13:15:34.912469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.924507 (+ 12038us) service_pool.cc:224] Handling call
0709 13:15:36.686422 (+1761915us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540043dad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:36.686537 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327430528}
I20260709 13:15:36.832360 10321 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:15:36.833102 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.804853 11000 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:36.829361 10993 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.706902 12412 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.834268 12412 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.739485 12039 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.806595 12331 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.839184 12331 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.839670 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.806815 12418 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:36.806918 10317 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:36.807220 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.815601 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.805061 12362 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.853240 12362 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.854440 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.855108 10325 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:36.825204 12251 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:36.855643 12412 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.856361 10325 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:36.857636 10325 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:36.857858 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.832317 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:36.858484 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.858716 10249 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.860749 12371 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:36.862509 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.828522 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.815927 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.806059 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.869652 10318 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:36.840932 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:36.871661 10322 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:36.820819 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:36.850173 12331 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.850509 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 605) took 1865 ms. Trace:
I20260709 13:15:36.760262 12357 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.808656 12356 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.851435 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 342) took 1083 ms. Trace:
I20260709 13:15:36.857945 12412 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:36.873119 10323 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:36.840588 12418 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.900627 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.876837 10249 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:15:36.885260 10325 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:36.893790 10324 raft_consensus.cc:2368] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:36.739740 12325 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.851053 10317 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:36.998021 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.812626 10998 rpcz_store.cc:276] 0709 13:15:35.625488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.643786 (+ 18298us) service_pool.cc:224] Handling call
0709 13:15:36.500411 (+856625us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:36.500619 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.500899 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:36.581987 (+ 81088us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.687434 (+105447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.693312 (+  5878us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:36.695585 (+  2273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.705125 (+  9540us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.735138 (+ 30013us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113168,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":15871,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6202,"spinlock_wait_cycles":27516544,"thread_start_us":149161,"threads_started":2,"wal-append.queue_time_us":111594}
I20260709 13:15:36.893213 10996 rpcz_store.cc:276] 0709 13:15:34.984589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.984892 (+   303us) service_pool.cc:224] Handling call
0709 13:15:34.999297 (+ 14405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.485309 (+486012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.850247 (+1364938us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54006cf7d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:36.850449 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110699264}
I20260709 13:15:36.757534 12237 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.895185 10248 rpcz_store.cc:276] 0709 13:15:35.767625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.800228 (+ 32603us) service_pool.cc:224] Handling call
0709 13:15:35.800669 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.836587 (+ 35918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.836638 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.836693 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:35.836749 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.851202 (+1014453us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54002eca54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:36.851249 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.851368 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82040960}
I20260709 13:15:36.896636 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.003439 10250 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:36.898942 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 78161.3us
I20260709 13:15:36.986090 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:36.855648 12251 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:37.005491 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.006183 10317 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:37.005847 12251 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.894244 12320 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.007205 12251 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.007081 12320 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.987435 12362 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:36.927824 12426 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.009285 12426 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.985610 12412 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:36.985535 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.012940 10318 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:37.013044 10250 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:36.986181 11001 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:36.991952 12418 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:36.992506 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:36.993090 10245 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:36.996591 10319 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:36.744123 12369 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:36.704943 12375 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:36.894145 10321 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:36.998706 10241 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:37.012154 12426 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.018873 10325 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:37.019879 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.027467 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.028126 10321 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:37.015197 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:37.032023 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:37.033226 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.034731 10246 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:37.015563 12333 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:37.047652 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.044128 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.049510 10316 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:37.052258 12142 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.045841 12198 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:15:37.054725 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.055379 10246 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:37.057122 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.062176 12198 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:37.067121 10321 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:37.065876 12198 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.068670 12198 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.070181 12320 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.071650 12154 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:37.074519 12237 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:37.075431 12237 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:37.075771 12237 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:37.044982 12426 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:37.079573 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.043500 12350 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.045739 12427 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.084934 12427 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.085335 12427 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.085573 12369 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.086911 10993 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:37.087872 12375 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.088550 12381 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.088891 10316 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.083679 10321 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:37.091159 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.091331 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.091884 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.093852 10396 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
W20260709 13:15:37.094419 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 270606us
I20260709 13:15:37.091988 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.095780 10397 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:37.092983 10391 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:37.096439 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:37.096136 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:37.097018 10396 raft_consensus.cc:606] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.076633 12316 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.097422 10396 raft_consensus.cc:614] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:37.099051 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.099593 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.100945 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.101647 10398 raft_consensus.cc:2410] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:37.101468 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:37.102128 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.104122 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.104683 10324 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.108078 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.110054 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.110868 11856 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.114459 12421 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:37.116393 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.117070 10319 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.109321 12426 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:37.109766 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.119400 12426 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.098019 12350 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.119146 12427 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.063191 12333 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.124846 11856 raft_consensus.cc:2764] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:37.105212 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.106758 12325 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:37.105831 12355 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:37.126049 10390 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:37.126843 12355 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.127264 12355 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.125975 11856 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:15:37.129947 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 608) took 2140 ms. Trace:
I20260709 13:15:37.103026 12251 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.127264 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:37.131441 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.124521 12350 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.090197 12320 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:15:37.130374 11000 rpcz_store.cc:276] 0709 13:15:34.989417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.989541 (+   124us) service_pool.cc:224] Handling call
0709 13:15:34.989813 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.833757 (+1843944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.129690 (+295933us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540034dd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:37.129864 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4173720832}
I20260709 13:15:37.146246 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.146986 12326 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.147727 12326 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.150333 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.076634 12237 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.152976 10396 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:37.154958 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.155571 10396 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:37.157088 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.158291 11856 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:37.159873 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.162590 11856 consensus_queue.cc:1243] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:37.163102 11856 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:37.163393 11856 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:37.164849 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.152424 12421 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:37.168728 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.142774 12356 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:15:37.156792 12350 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:37.163499 12251 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:37.170392 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.174140 11856 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.142342 12198 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.179713 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.180299 11856 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.167634 12237 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.185096 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.185339 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.167687 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.186010 10323 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 1.
I20260709 13:15:37.188267 10244 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:37.189401 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.172796 12421 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.191200 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.192082 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.197275 10393 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:37.198567 10213 leader_election.cc:400] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:37.198463 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.198972 10213 leader_election.cc:403] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:37.199651 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.200037 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:37.201226 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.202535 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.202782 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.203173 10323 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.203297 10320 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:37.177052 12350 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.206120 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.202536 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.206692 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:37.206118 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.208269 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:37.208841 10398 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.204936 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.207433 10318 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:37.211393 10317 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:37.177024 12325 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:15:37.216570 11856 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:37.219431 12405 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.789s	user 0.000s	sys 0.004s
I20260709 13:15:37.197207 12047 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:37.223145 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.197166 12421 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.228407 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:37.194789 12251 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:37.230456 10320 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.207118 12376 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:37.206976 12375 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.210140 12350 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.239895 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:37.240597 12039 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.209920 12095 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:37.206825 12425 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.244699 10398 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:37.215276 12326 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.222325 12198 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.222211 11856 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.228837 12381 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.269315 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.270519 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.271203 10250 raft_consensus.cc:2368] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
I20260709 13:15:37.271842 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.206923 12154 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:15:37.276140 10319 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:37.259720 10241 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:37.253099 11856 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.262099 10248 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:37.245215 12039 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:37.228865 12422 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:15:37.264357 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.264346 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.265295 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 1906) took 2177 ms. Trace:
I20260709 13:15:37.266805 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 480) took 1267 ms. Trace:
I20260709 13:15:37.267437 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.273811 10323 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:37.275840 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.243676 12375 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.299984 10249 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:37.255445 12374 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.260897 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:37.280398 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69623us
I20260709 13:15:37.300331 10290 leader_election.cc:400] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
I20260709 13:15:37.301359 10290 leader_election.cc:403] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:37.301682 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.293602 10320 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:37.283679 10245 rpcz_store.cc:276] 0709 13:15:35.088161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.089018 (+   857us) service_pool.cc:224] Handling call
0709 13:15:37.265136 (+2176118us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54000b95d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:37.265240 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4376097152}
I20260709 13:15:37.307628 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.302446 11002 rpcz_store.cc:276] 0709 13:15:35.999849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.000655 (+   806us) service_pool.cc:224] Handling call
0709 13:15:36.001020 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.119574 (+118554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.119601 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.119645 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:36.119680 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.266577 (+1146897us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400750154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:37.266617 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.266756 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272162944}
I20260709 13:15:37.310650 10241 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:37.312269 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.325610 10319 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:37.364512 11856 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.331661 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.283751 12039 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.370183 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.372025 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.378254 10324 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:37.306362 12374 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.384688  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:37.385335 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.284260 12316 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:37.321708 12353 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 13:15:37.394439 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 610) took 1156 ms (client timeout 1515 ms). Trace:
I20260709 13:15:37.395187 12434 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.356837 12308 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:15:37.301913 12375 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.309973 12425 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:37.316844 12381 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
I20260709 13:15:37.382393 11979 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:37.416539 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44591.2us
I20260709 13:15:37.404155 12376 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.423120 12376 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.404639 12374 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.432623 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.413182 12362 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.434968 12316 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.434787 12362 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.435551 12316 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.425915 12376 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:37.468163 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 155929us
I20260709 13:15:37.468870 11856 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.484680 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.438280 11979 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.410385 12355 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.485502 11979 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.413633 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.410141 12436 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:15:37.378899 12251 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.485647 11856 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:37.394913 10994 rpcz_store.cc:269] 0709 13:15:36.228259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.251244 (+ 22985us) service_pool.cc:224] Handling call
0709 13:15:37.267293 (+1016049us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:37.384639 (+117346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24071552}
I20260709 13:15:37.581637 11856 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.539150 12376 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.582299 11856 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.582440 12376 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.577086 12374 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.579747 12436 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.582731 12362 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.580336 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.592276 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:37.589547 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 170344us
I20260709 13:15:37.593748 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.595395 12441 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:37.596122 12441 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.596671 12441 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:37.598795 11856 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.599490 11856 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:37.600852 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.601043 11856 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.604425 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.606068 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:37.606600 10392 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:37.471608 12199 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.608963 11856 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.609316 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.618618 12177 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:37.619132 12177 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.619481 12177 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.620424 12434 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:37.603154 12436 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.623549 12376 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.624454 12355 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.555151 12425 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.625134 12355 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:37.625566 12355 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.625299 12425 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.625993 12355 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.628299 12425 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.629056 12199 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.631387 12199 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.633028 12333 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.637243 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:37.638617 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.638799 12333 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.639249 12333 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.639622 12333 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.640219 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:37.640671 10316 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.004s
I20260709 13:15:37.640823 12329 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:37.641707 12357 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.641520 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.642139 12371 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:37.657559 12329 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.660554 12333 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.662405 12393 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:37.662864 12329 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.626022 12316 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.663453 12374 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.638612 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.662861 12333 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.664551 12333 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.657634 12421 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.666594 12421 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.658325 12357 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.666947 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:37.667299 12357 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.604625 12154 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:37.674431 12154 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.674916 12154 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.679267 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:37.680723 12427 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:37.683198 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.683830 10249 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.702119 12154 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.702668 10994 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:37.708698 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.709803 12422 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:37.710412 12422 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:37.711509 12422 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.702978 12357 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.718099 12357 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.718895 12344 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:37.723418 12154 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:37.727278 10250 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:15:37.727844 10250 pending_rounds.cc:85] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:15:37.728156 10250 pending_rounds.cc:107] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:37.728466 10250 raft_consensus.cc:2889] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:37.730855 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.624480 12436 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.757727  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:37.745060 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.766196 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.769129 10250 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:37.793730 10145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 205) took 5255 ms. Trace:
I20260709 13:15:37.493162 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:37.519526 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:37.798805 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.799005 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:37.792665 10249 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:37.802429 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:37.804970 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.782181 10144 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.811234 10144 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.821271 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:37.822722 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:37.785933 12393 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.807078 12198 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.834492 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.801509 12357 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.816423 12325 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.832152 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.794435 10145 rpcz_store.cc:276] 0709 13:15:32.504196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.510893 (+  6697us) service_pool.cc:224] Handling call
0709 13:15:37.759601 (+5248708us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:33.239352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:33.266346 (+ 26994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:33.266405 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:15:33.266423 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:33.389590 (+123167us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:33.410528 (+ 20938us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:33.413442 (+  2914us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:15:33.601632 (+188190us) tablet.cc:701] Row locks acquired
0709 13:15:33.621693 (+ 20061us) write_op.cc:260] PREPARE: finished
0709 13:15:33.655374 (+ 33681us) write_op.cc:270] Start()
0709 13:15:33.672321 (+ 16947us) write_op.cc:276] Timestamp: P: 1783602933640668 usec, L: 0
0709 13:15:33.696195 (+ 23874us) op_driver.cc:348] REPLICATION: starting
0709 13:15:33.910530 (+214335us) log.cc:844] Serialized 1749 byte log entry
0709 13:15:34.663914 (+753384us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae3e28 00007f58c751e581 00007f58c751dd58 00007f58c75229f1 00007f58c75229a9 00007f58c7522939 00007f58c7522901 00007f58c7521b2d 000000000038f354 000000000038f199
0709 13:15:34.761611 (+ 97697us) op_driver.cc:464] REPLICATION: finished
0709 13:15:34.909047 (+147436us) write_op.cc:301] APPLY: starting
0709 13:15:34.922286 (+ 13239us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:34.931954 (+  9668us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:34.932005 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:34.935028 (+  3023us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:34.935263 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:15:34.935317 (+    54us) write_op.cc:312] APPLY: finished
0709 13:15:34.952849 (+ 17532us) log.cc:844] Serialized 41 byte log entry
0709 13:15:34.958692 (+  5843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:34.958809 (+   117us) write_op.cc:454] Released schema lock
0709 13:15:34.958857 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:34.959226 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:34.959253 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":119848,"apply.run_cpu_time_us":3516,"apply.run_wall_time_us":59200,"num_ops":4,"prepare.queue_time_us":250128,"prepare.run_cpu_time_us":38691,"prepare.run_wall_time_us":1440771,"raft.queue_time_us":41353,"raft.run_cpu_time_us":17285,"raft.run_wall_time_us":77138,"replication_time_us":1057471,"spinlock_wait_cycles":6894464,"thread_start_us":967882,"threads_started":4,"wal-append.queue_time_us":767871,"wal-append.run_cpu_time_us":6682,"wal-append.run_wall_time_us":1279265}]]}
I20260709 13:15:37.823951 10144 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:37.816154 12384 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:37.843763 10144 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.802196 12436 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.835904 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.848325 10323 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:37.816846 10316 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:37.853257 12371 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:37.853721 12371 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.841405 12198 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.854770 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.856091 12039 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.856571 12198 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:37.849159 12325 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.859656 10998 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:37.860342 12325 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.860855 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.861361 12177 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:37.861846 12237 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.000s
I20260709 13:15:37.830327 12327 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:37.816177 12376 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:37.830814 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.834020 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.867431 10319 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:37.844784 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.844936 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.845136 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:37.845359 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.869419 10320 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.869586 10247 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:37.849181 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.847527 10144 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:37.850440 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:37.812049 10390 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:37.824218 12344 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.873509 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:37.854072 12371 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.878726 10318 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:37.926892 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.890749 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.927737 10243 raft_consensus.cc:2368] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
I20260709 13:15:37.818163 12308 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:15:37.875232 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.928725 10319 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:37.929091 10290 leader_election.cc:400] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
W20260709 13:15:37.837971 12426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.005s	sys 0.009s
I20260709 13:15:37.911939 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:37.909698 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.929462 10290 leader_election.cc:403] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:37.930611 12442 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:15:37.931227 12333 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:37.862154 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.933319 12177 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:37.934533 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.824385 12370 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:15:37.877913 12039 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:37.843858 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.973652 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:37.948277 10247 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:37.841138 12393 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.824455 12383 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:15:37.954502 10320 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:37.931123 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.865787 12331 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:37.962648 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:37.942869 12438 log.cc:927] Time spent T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:15:37.904006 12327 consensus_queue.cc:1243] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:37.902928 12421 raft_consensus.cc:2764] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:37.982918 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.968743 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:37.866405 12376 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.966217 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.984064 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.999671 10247 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
W20260709 13:15:37.948383 12426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.005s	sys 0.009s
I20260709 13:15:37.943567 12344 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:37.949230 10396 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 1.
I20260709 13:15:38.025581 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.026005 12371 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.026829 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:37.977816 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:37.929867 12163 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:38.028813 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51132.8us
I20260709 13:15:38.028872 12163 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.029747 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:38.031361 12163 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:38.032155 12163 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:38.032698 12163 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:38.035833 12325 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:38.036579 12325 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:38.039842 10364 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:37.983506 10999 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:37.845841 12357 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.041631 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:37.991503 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:37.957368 12333 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:37.862977 12436 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:37.998026 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:38.028033 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.040143 12370 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:38.084627 10394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.033s	sys 0.082s
W20260709 13:15:38.167932 10394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.038s	sys 0.086s
I20260709 13:15:38.125330 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:38.041946 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.170595 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.152398 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.174796 10364 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:38.181300 10395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.005s	sys 0.022s
W20260709 13:15:38.181874 10395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.005s	sys 0.022s
I20260709 13:15:38.190410 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:37.982420 12374 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
W20260709 13:15:38.136963 12375 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.000s
I20260709 13:15:37.983850 12383 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:38.098347 10993 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:38.023180 12376 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:38.207484 10250 raft_consensus.cc:2410] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:38.033771 12163 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.037671 12325 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:38.093822 12411 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:38.022964 12251 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:37.984897 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.205245 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:38.205629 12371 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.100267 12393 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.172163 12333 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:38.140805 12331 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:38.097759 12344 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.171854 12370 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:38.095477 12039 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:38.197775 12426 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:38.214861 12350 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.960s	user 0.008s	sys 0.003s
I20260709 13:15:38.200546 12326 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:38.252343 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:37.988669 12441 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:38.125566 12095 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:38.216238 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:38.031395 12355 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:38.211205 12383 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:38.293913 12039 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.301421 12383 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.302868 12383 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:38.303305 12039 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:38.295806 12442 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.303951 12095 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.304816 12442 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.214262 12308 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.306425 12095 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:38.306658 12308 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:38.269279 10246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.038s	sys 0.103s
W20260709 13:15:38.310714 10246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.038s	sys 0.103s
I20260709 13:15:38.312242 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1225) took 1054 ms. Trace:
I20260709 13:15:38.206419 11979 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:38.291333 10398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.023s	sys 0.016s
I20260709 13:15:38.291473 10243 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:38.298055 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:38.266822 12411 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:38.215328 12375 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.291520 12426 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.267624 10390 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:38.265640 12251 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:38.254882 12422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.010s	sys 0.020s
W20260709 13:15:38.315644 10398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.024s	sys 0.016s
W20260709 13:15:38.316112 10362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.020s	sys 0.035s
I20260709 13:15:38.319442 10245 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:38.333547 12154 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.016s	sys 0.019s
W20260709 13:15:38.336169 10134 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ab33f0a79ddf4f5a8ba81b3b0e120529 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:38.337334 12353 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:38.339668 10320 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:38.340911 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:38.355706 10321 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:38.296202 12350 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:38.313019 10246 rpcz_store.cc:276] 0709 13:15:37.257868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.258441 (+   573us) service_pool.cc:224] Handling call
0709 13:15:37.258745 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.258946 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:37.259271 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.311209 (+1051938us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.311282 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:38.311340 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.312015 (+   675us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.312168 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5371,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":69731,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"thread_start_us":1051544,"threads_started":2,"wal-append.queue_time_us":835778}
I20260709 13:15:38.344573 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:38.309049 12308 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:38.368903 10243 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:38.370018 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.013s	sys 0.009s
W20260709 13:15:38.370483 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.014s	sys 0.009s
W20260709 13:15:38.349810 10362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.020s	sys 0.035s
W20260709 13:15:38.349882 10965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.029s
I20260709 13:15:38.349655 10397 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:38.375524 10965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.002s	sys 0.029s
I20260709 13:15:38.307909 12442 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:38.273882 12331 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:38.356184 12154 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.017s	sys 0.020s
W20260709 13:15:38.353816 10323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.010s
W20260709 13:15:38.424845 10323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.013s	sys 0.010s
W20260709 13:15:38.377091 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 556168us
W20260709 13:15:38.348224 12422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.011s	sys 0.020s
W20260709 13:15:38.372768 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 755635us
I20260709 13:15:38.402077 10246 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:38.342546 12426 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:38.348563 12370 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.408038 11979 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:38.408692 10996 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:15:38.409126 12444 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:38.402140 10247 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:38.429746 10242 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:38.355404 12433 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:38.439512 10248 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:38.385950 10997 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:38.432687 12427 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.449270 12308 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.449635 12039 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.464572 12039 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.466318 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:38.467306 12355 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.467820 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:38.468587 10320 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:38.471156 10318 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:38.473657 12350 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.767488 12463 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:38.526162 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 1829) took 1200 ms. Trace:
I20260709 13:15:38.934754 12434 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:38.459957 12441 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.979421 12434 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:38.460704 12446 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:38.981051 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.981880 12434 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:38.935186 12449 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:38.765436 12326 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:39.020836 12326 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:38.820237 10319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.006s	sys 0.014s
W20260709 13:15:39.021777 10319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.006s	sys 0.021s
W20260709 13:15:38.666110 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.483130 10243 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
W20260709 13:15:38.517792 12047 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.029s	sys 0.046s
W20260709 13:15:39.023249 12047 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.046s	sys 0.134s
I20260709 13:15:39.000300 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:38.499191 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 44704us
I20260709 13:15:38.978708 10398 rpcz_store.cc:276] 0709 13:15:37.325563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.325841 (+   278us) service_pool.cc:224] Handling call
0709 13:15:37.326286 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.367200 (+ 40914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.367245 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.381229 (+ 13984us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.705647 (+324418us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b1800369340. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:15:38.348944 (+643297us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.348986 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.349063 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.525816 (+176753us) raft_consensus.cc:1685] finished
0709 13:15:38.525839 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.526091 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1008,"raft.queue_time_us":41109,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":12074,"spinlock_wait_cycles":13105536,"thread_start_us":643091,"threads_started":1,"wal-append.queue_time_us":1037158}
I20260709 13:15:38.691397 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 1830) took 1365 ms. Trace:
I20260709 13:15:38.462122 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:39.026134 10397 rpcz_store.cc:276] 0709 13:15:37.325857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.326695 (+   838us) service_pool.cc:224] Handling call
0709 13:15:37.380466 (+ 53771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.375133 (+994667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.691002 (+315869us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400032854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:38.691312 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228148608}
I20260709 13:15:38.767838 12324 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:39.027189 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:38.511569 10244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.024s	sys 0.049s
I20260709 13:15:39.027590 12324 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:38.882405 12163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.012s	sys 0.017s
W20260709 13:15:38.551323 10325 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.016s	sys 0.017s
W20260709 13:15:39.028249 10244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.065s	sys 0.114s
W20260709 13:15:39.028450 12163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.012s	sys 0.020s
I20260709 13:15:38.984392 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1245) took 1023 ms. Trace:
I20260709 13:15:38.529498 12411 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:38.989588 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:38.988636 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.713285 10320 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:38.823161  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:39.029690 10249 rpcz_store.cc:276] 0709 13:15:37.961409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.962210 (+   801us) service_pool.cc:224] Handling call
0709 13:15:37.965974 (+  3764us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:37.966465 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.966495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:37.971103 (+  4608us) log.cc:844] Serialized 52 byte log entry
0709 13:15:38.376526 (+405423us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.376572 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.376640 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.984197 (+607557us) raft_consensus.cc:1685] finished
0709 13:15:38.984216 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.984338 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":667,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":13957,"thread_start_us":405013,"threads_started":1,"wal-append.queue_time_us":1011347}
I20260709 13:15:38.458949 12357 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:39.032178 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:38.988610 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.033437 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.990527 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:38.990926 12436 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:38.569090 10967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.001s	sys 0.017s
W20260709 13:15:39.034684 10967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.003s	sys 0.035s
W20260709 13:15:39.035014 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 1.1999e+06us
I20260709 13:15:39.026010 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:38.977972 12463 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:39.036450 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:38.528193 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1293) took 1101 ms. Trace:
I20260709 13:15:39.037611 10394 rpcz_store.cc:276] 0709 13:15:37.427304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.429615 (+  2311us) service_pool.cc:224] Handling call
0709 13:15:37.429935 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.430333 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:37.430361 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.430813 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.168743 (+737930us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.168809 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.169051 (+   242us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.527898 (+358847us) raft_consensus.cc:1685] finished
0709 13:15:38.527927 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.528122 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14493,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":20646,"thread_start_us":737441,"threads_started":1,"wal-append.queue_time_us":944457}
W20260709 13:15:38.982139 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 550192us
I20260709 13:15:39.039359 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:38.530859 12376 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.040244 12457 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.041487 12376 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:39.042412 11002 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:39.020452 12449 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:38.461323 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 1832) took 1131 ms. Trace:
I20260709 13:15:38.676550 12251 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:39.028489 10325 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.028s	sys 0.025s
I20260709 13:15:39.043685 10395 rpcz_store.cc:276] 0709 13:15:37.330292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.331487 (+  1195us) service_pool.cc:224] Handling call
0709 13:15:37.380970 (+ 49483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.404706 (+ 23736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.404755 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.410683 (+  5928us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.190270 (+779587us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:38.190309 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.190371 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.461110 (+270739us) raft_consensus.cc:1685] finished
0709 13:15:38.461134 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.461267 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23280,"raft.queue_time_us":24123,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2139,"thread_start_us":770487,"threads_started":1,"wal-append.queue_time_us":938813}
I20260709 13:15:39.037225 12461 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.044817 12457 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:38.992738 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.461694 12427 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.037629 12381 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:39.047034 10393 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
W20260709 13:15:38.964546 12333 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.000s
I20260709 13:15:39.046154 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:39.049750 10323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.024s	sys 0.025s
I20260709 13:15:39.051139 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:15:39.050539 10323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.024s	sys 0.025s
I20260709 13:15:39.054245 10399 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:38.738538 12353 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:39.046725 12426 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:15:38.772294 12237 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:38.463949 12370 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:38.529241 12375 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:38.764822 12433 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:39.089648 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 532) took 1288 ms. Trace:
I20260709 13:15:39.046725 12331 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.054603 12333 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:39.017635 12355 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.137441 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 1956) took 1361 ms. Trace:
I20260709 13:15:39.050535 12421 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:39.061867 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:39.146028 10290 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:39.086133 10245 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:39.088503 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1889) took 1257 ms. Trace:
I20260709 13:15:39.052382 12324 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.090022 11002 rpcz_store.cc:276] 0709 13:15:37.801076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.801272 (+   196us) service_pool.cc:224] Handling call
0709 13:15:39.089432 (+1288160us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54004f3654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:39.089590 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817259264}
I20260709 13:15:39.124704 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:39.091888 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 363) took 1090 ms. Trace:
I20260709 13:15:39.091073 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:39.151846 10321 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:38.463618 12308 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.151522 10246 rpcz_store.cc:276] 0709 13:15:38.001577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.427799 (+426222us) service_pool.cc:224] Handling call
0709 13:15:39.081955 (+654156us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800002a98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3e9c 00007f58c09c3a5b 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:39.082127 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.091409 (+  9282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.091471 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.091532 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:39.091586 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.091668 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.091819 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3784,"raft.queue_time_us":4627,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":22444,"spinlock_wait_cycles":7617792}
I20260709 13:15:39.163463 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:39.138016 10244 rpcz_store.cc:276] 0709 13:15:37.776650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.837557 (+ 60907us) service_pool.cc:224] Handling call
0709 13:15:37.837967 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.863028 (+ 25061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.863062 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.878612 (+ 15550us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.028710 (+1150098us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:39.028751 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.083154 (+ 54403us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b54002ec554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:39.083200 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.083244 (+    44us) raft_consensus.cc:1685] finished
0709 13:15:39.083256 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.137355 (+ 54099us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3249,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":60346,"spinlock_wait_cycles":56783104,"thread_start_us":1046978,"threads_started":1,"wal-append.queue_time_us":1049388}
I20260709 13:15:39.053205 12441 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:15:39.124825 12433 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:39.109714 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:39.053958 12468 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:39.143110 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.545s (SENT) [suppressed 5 similar messages]
I20260709 13:15:39.148216 10322 rpcz_store.cc:276] 0709 13:15:37.831137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.831260 (+   123us) service_pool.cc:224] Handling call
0709 13:15:37.831550 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.834730 (+  3180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.834772 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.841709 (+  6937us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.351063 (+509354us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:38.351103 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.351168 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.088310 (+737142us) raft_consensus.cc:1685] finished
0709 13:15:39.088329 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.088446 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2806,"raft.queue_time_us":3323,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6012,"thread_start_us":489934,"threads_started":1,"wal-append.queue_time_us":665962}
I20260709 13:15:39.172284 10250 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:39.102649 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:39.066371 12357 raft_consensus.cc:2764] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:15:39.054719 10316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.005s	sys 0.023s
I20260709 13:15:39.104390 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:39.089454 12251 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.195995 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:39.066672 12154 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:15:39.171787 10994 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:39.203442 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 163569us
I20260709 13:15:39.235108 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:39.077749 12353 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.062896 12376 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:15:39.147078 12331 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:39.218158 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 45801.6us
W20260709 13:15:39.231035 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 168330us
I20260709 13:15:39.063712 12374 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:15:39.145788 12456 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:39.244349 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 1966) took 1250 ms. Trace:
I20260709 13:15:39.090562 12426 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:39.209306 10316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.006s	sys 0.023s
I20260709 13:15:39.126076 12237 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:39.247466 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 185085us
I20260709 13:15:39.251618 10250 rpcz_store.cc:276] 0709 13:15:37.993621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.332399 (+338778us) service_pool.cc:224] Handling call
0709 13:15:38.332797 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.195385 (+862588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.243961 (+ 48576us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b540006f4d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:39.244255 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930204928}
I20260709 13:15:39.155911 12355 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:39.272045 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 217380us
I20260709 13:15:39.318663 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:39.232909 12039 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.315778 10249 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:39.253022 12163 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:39.249313 12357 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:39.233390 12251 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:39.374446 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 137925us
I20260709 13:15:39.211144 12468 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:39.350014 12457 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.379987 10390 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:39.359421 12163 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.414986 10242 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:39.373266 12411 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.270148 12331 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.368940 12324 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.432834 12457 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:39.442746 12474 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:15:39.415664 10399 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:39.359424 12326 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:39.472802 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 157574us
W20260709 13:15:39.481345 12482 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:39.488822 12251 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:39.489179 12473 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:15:39.490705 12326 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:39.491171 12472 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:15:39.373039 12357 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.274318 12456 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:39.522122 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.709600 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.493273 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1897) took 1657 ms. Trace:
I20260709 13:15:39.491429 12326 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.711000 12326 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.711858 12251 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:39.612709 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 479417us
W20260709 13:15:39.723487 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 244010us
W20260709 13:15:39.618566 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 475456us
W20260709 13:15:39.744359 10213 leader_election.cc:336] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.600s (SENT)
W20260709 13:15:39.621165 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 302757us
I20260709 13:15:39.712502 12251 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:39.710255 10323 rpcz_store.cc:276] 0709 13:15:37.835850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.849104 (+ 13254us) service_pool.cc:224] Handling call
0709 13:15:37.849432 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.425334 (+575902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.425362 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.425813 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.052629 (+626816us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:39.052669 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.052754 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.492990 (+440236us) raft_consensus.cc:1685] finished
0709 13:15:39.493018 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.493201 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851,"raft.queue_time_us":4007,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":1201075,"threads_started":2,"wal-append.queue_time_us":766781}
I20260709 13:15:39.429095 12163 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:39.490705 12471 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:15:39.432914 12350 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.755904 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:39.719256 12333 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:39.793044 12251 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:39.492165 12475 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:15:39.692607 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.677410 12308 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.471284 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 296) took 1024 ms. Trace:
I20260709 13:15:39.446033 12427 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.714293 12457 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:39.798264 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 479701us
I20260709 13:15:39.800341 10967 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:39.770288 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 498676us
W20260709 13:15:39.633289 12470 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.432s	user 0.006s	sys 0.003s
I20260709 13:15:39.489187 12331 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.806533 12426 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:39.868391 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 124079us
I20260709 13:15:39.868968 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:39.730671 12411 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.835322 12237 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.914505 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1900) took 1722 ms. Trace:
I20260709 13:15:39.724022 12480 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 13:15:39.915096 10319 rpcz_store.cc:276] 0709 13:15:38.192030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.192168 (+   138us) service_pool.cc:224] Handling call
0709 13:15:38.205439 (+ 13271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.205838 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.205872 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.214119 (+  8247us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.022192 (+808073us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:39.022267 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.022339 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.914271 (+891932us) raft_consensus.cc:1685] finished
0709 13:15:39.914291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.914443 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4274,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14141,"thread_start_us":770891,"threads_started":1,"wal-append.queue_time_us":926583}
W20260709 13:15:39.917341 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48443.6us
I20260709 13:15:39.886694 12047 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.886673 12436 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.922253 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:39.801748 12484 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:15:39.813259 12350 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.902599 12333 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.928562 12489 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.912336 12251 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.936616 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:39.876523 12486 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:15:39.920097 12355 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.943055 12489 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.921950 12491 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:39.946820 12477 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.567s	user 0.005s	sys 0.010s
W20260709 13:15:39.934381 10247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.012s
I20260709 13:15:39.949610 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:39.978790 12496 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:15:39.932528 12325 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:39.979316 10247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.001s	sys 0.012s
I20260709 13:15:39.917943 12411 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.988330 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 365) took 1926 ms. Trace:
I20260709 13:15:39.990831 12237 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:39.886364 10316 rpcz_store.cc:276] 0709 13:15:38.447219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.448693 (+  1474us) service_pool.cc:224] Handling call
0709 13:15:38.458914 (+ 10221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.528890 (+ 69976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.528947 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.529648 (+   701us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.322723 (+793075us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:39.350494 (+ 27771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.368957 (+ 18463us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.443818 (+ 74861us) raft_consensus.cc:1685] finished
0709 13:15:39.443850 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.444022 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47197,"raft.queue_time_us":71142,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":172,"thread_start_us":745805,"threads_started":1,"wal-append.queue_time_us":681028}
W20260709 13:15:39.991802 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68314.7us
I20260709 13:15:39.992410 12383 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:40.006855 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:39.992679 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 60734.2us
I20260709 13:15:39.947701 12436 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:39.994047 12478 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:39.994532 12325 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:39.994941 12421 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:39.978960 12426 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:39.996145 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1252) took 1010 ms. Trace:
I20260709 13:15:39.984393 12376 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.048476 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 1973) took 1055 ms. Trace:
I20260709 13:15:39.996819 12375 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:40.051558 12375 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.052062 12375 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:39.996955 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 486) took 2205 ms. Trace:
I20260709 13:15:39.997396 12489 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.998027 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1893) took 2165 ms. Trace:
I20260709 13:15:39.998360 12177 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:40.048458 10249 rpcz_store.cc:276] 0709 13:15:38.985252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.077069 (+ 91817us) service_pool.cc:224] Handling call
0709 13:15:39.995922 (+918853us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000ba9d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:39.996081 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376351616}
I20260709 13:15:40.054240 12177 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.053504 10994 rpcz_store.cc:276] 0709 13:15:37.791521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.801555 (+ 10034us) service_pool.cc:224] Handling call
0709 13:15:39.124449 (+1322894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.240971 (+116522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.996731 (+755760us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54004f3650. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:39.996883 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905318784}
W20260709 13:15:39.958844 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 159864us
I20260709 13:15:40.056945 12177 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:39.998921 12484 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:40.058017 12484 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:39.999151 12449 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:39.992296 12512 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:40.003604 11002 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:40.004871 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:39.981217 12491 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.012440 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.070253 10250 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
W20260709 13:15:40.070685 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 65919.3us
I20260709 13:15:40.071524 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.007063 12237 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:40.013388 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.073102 10290 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:40.014330 12505 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:40.016366 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:39.970157 12329 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:40.025643 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:40.080264 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 268575us
W20260709 13:15:40.080328 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 151609us
I20260709 13:15:40.026961 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.027262 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.027948 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:40.035006 10321 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:40.084275 10323 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:40.084591 10324 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:40.084288 10322 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:40.085449 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:40.086452 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:40.086865 12485 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:15:40.086771 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.088042 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 298) took 1634 ms. Trace:
I20260709 13:15:40.088428 10318 rpcz_store.cc:276] 0709 13:15:38.453558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.003183 (+549625us) service_pool.cc:224] Handling call
0709 13:15:39.057447 (+ 54264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.057800 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.057829 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.060355 (+  2526us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.251865 (+191510us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:39.251904 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.251977 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.087804 (+835827us) raft_consensus.cc:1685] finished
0709 13:15:40.087822 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.087977 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3985,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10087,"thread_start_us":106385,"threads_started":1,"wal-append.queue_time_us":643291}
I20260709 13:15:40.089190 12237 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.045540 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.075350 12489 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:39.938583 12333 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.053855 10325 rpcz_store.cc:276] 0709 13:15:37.832929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.833043 (+   114us) service_pool.cc:224] Handling call
0709 13:15:37.850143 (+ 17100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.044151 (+1194008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.044182 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.044689 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.370521 (+325832us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:39.370892 (+   371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.370998 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.997799 (+626801us) raft_consensus.cc:1685] finished
0709 13:15:39.997820 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.997965 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623,"raft.queue_time_us":3481,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":1705216,"thread_start_us":1517470,"threads_started":2,"wal-append.queue_time_us":685978}
I20260709 13:15:40.065147 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:39.992275 12468 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:39.952724 12251 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.059883 12421 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.078459 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:40.045377 12331 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.081744 10246 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:40.061781 12376 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:40.049894 10241 rpcz_store.cc:276] 0709 13:15:38.993263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.098408 (+105145us) service_pool.cc:224] Handling call
0709 13:15:39.098824 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.099130 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.099170 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.126936 (+ 27766us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.317092 (+190156us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:39.317220 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.317481 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.048261 (+730780us) raft_consensus.cc:1685] finished
0709 13:15:40.048290 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.048416 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124000,"threads_started":1,"wal-append.queue_time_us":569692}
I20260709 13:15:40.091338 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.085469 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:40.090167 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:40.087203 10322 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:40.003669 10247 rpcz_store.cc:276] 0709 13:15:38.065216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.442791 (+377575us) service_pool.cc:224] Handling call
0709 13:15:39.078518 (+635727us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b5800002a98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:39.078775 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.079029 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:39.161632 (+ 82603us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.987974 (+826342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.988027 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.988073 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.988148 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.988261 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66589,"prepare.queue_time_us":91957,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":336524,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":71613,"spinlock_wait_cycles":17392512,"thread_start_us":807794,"threads_started":2,"wal-append.queue_time_us":812000}
I20260709 13:15:40.105225 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:40.106192 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.006705 12507 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:15:40.015239 12493 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:15:40.015545 12488 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:15:40.122821 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.111038 10324 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:40.079772 12047 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.091339 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.102413 12237 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.069635 12426 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.127045 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.099742 12486 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.046274 12436 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:40.119388 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 93838.2us
I20260709 13:15:40.115948 12357 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:40.148783 10965 connection.cc:256] RPC call timeout handler was delayed by -1.1178598960000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 13:15:40.090694 12381 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:40.135908 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53740us
I20260709 13:15:40.154583 10248 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:40.136034 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:40.137578 10324 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:40.156494 10324 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:40.157410 11002 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:40.157774 10324 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:40.138358 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:40.138731 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:40.122844 12376 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.143355 10250 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:40.158776 10243 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:40.159107 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.159894 10249 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:40.153379 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.161314 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.124680 12374 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.161995 10245 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:40.122149 12329 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:40.059068 12484 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.115535 12495 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.047627 12478 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.161906 10999 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:40.167706 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.119921 12468 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:15:40.124946 12494 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:40.183991 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.138129 12489 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.192709 10247 raft_consensus.cc:2410] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:40.119864 12331 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.160969 12381 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.147210 12457 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.205999 10395 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:40.214756 10243 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:40.167023 12456 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.086138 12512 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.169245 12427 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:15:40.216032 12463 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.099066 12505 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.161253 12486 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.233435 12505 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.234422 10318 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.202620 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:40.234531 12329 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.211637 12381 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:40.233486 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.197453 12449 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:40.204546 12494 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.202880 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.242373 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.172225 12374 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:40.234645 12370 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.110s	user 0.010s	sys 0.002s
I20260709 13:15:40.242694 10245 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:40.223156 12350 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.308699 12449 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:40.321596 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 161279us
W20260709 13:15:40.322335 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 189685us
I20260709 13:15:40.240780 12513 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:40.332783 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.331751 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:40.292325 12494 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.343344 12527 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:40.292758 12486 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:40.326395 12163 consensus_meta.cc:287] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 13:15:40.350212 12527 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:40.397810 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 66035us
I20260709 13:15:40.357851 12325 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.355111 12505 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.368065 12411 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.413149 12251 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.408439 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:40.367630 12486 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.344980 12513 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.358853 12163 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.405540 12333 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.456815 10318 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:40.427438 12491 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.445485 12251 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.431366 12308 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:15:40.496053 12517 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:15:40.498560 12478 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:40.500598 12512 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.503650 12513 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.492400 12251 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:40.447682 12468 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:40.424638 12505 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.470394 12331 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.580305 12512 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:40.581113 12512 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.581938 12331 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:40.582511 12331 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.497063 12527 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:40.534677 12433 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.325s	user 0.014s	sys 0.000s
I20260709 13:15:40.528188 12308 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.588152 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.552016 12251 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:40.662670 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 74620.5us
I20260709 13:15:40.664255 12529 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:40.640342 12518 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:15:40.665601 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:40.667636 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:40.614312 12525 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:40.614764 12533 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:40.669253 12516 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:40.646329 12375 consensus_meta.cc:287] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.594s	user 0.014s	sys 0.001s
W20260709 13:15:40.681511 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.645123 12154 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:40.698246 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:40.701333 12533 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.625442 12513 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:15:40.677278 12480 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:40.681089 12421 consensus_meta.cc:287] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.006s
I20260709 13:15:40.704874 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.716176 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.702416 12518 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:40.625833 12433 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.719314 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.723994 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.725921 10247 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:40.717128 12434 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.696208 12436 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.671649 12456 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:40.700088 12478 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.735185 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.747593 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.749516 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.752377 10393 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:40.753786 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:40.761134 10394 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:40.754778 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.733920 12154 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:15:40.764286 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:40.762071 12434 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:40.767427 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:40.767853 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.790568 12533 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.756494 12353 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.794512 12449 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.717852 12480 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:40.780854 10364 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:40.768270 12350 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:40.708611 12525 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.723347 12518 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:40.788343 12511 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.788736 12501 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:40.789211 12497 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:15:40.700665 12529 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.720584 12375 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.729408 12421 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.797284 12461 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:40.798249 12478 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:15:40.800942 12381 consensus_meta.cc:287] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.000s
I20260709 13:15:40.720791 12516 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.764983 12331 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.802435 12350 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:40.799279 12533 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:40.828992 10246 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:40.860953 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 80171.6us
I20260709 13:15:40.844300 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.846652 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.846972 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.852089 10396 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:40.866358 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:40.852648 10242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1251) took 1861 ms (client timeout 2243 ms). Trace:
I20260709 13:15:40.855855 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:40.869163 10394 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.845856 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.843998 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.812196 12525 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.833073 12497 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:40.872166 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.818612 12511 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.840924 12533 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.833570 12496 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.854494 10247 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:40.864507 10999 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:15:40.867648 10242 rpcz_store.cc:269] 0709 13:15:38.984981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.061595 (+ 76614us) service_pool.cc:224] Handling call
0709 13:15:40.846070 (+1784475us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002eca54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:40.846210 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617145728}
I20260709 13:15:40.877761 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:40.878525 10242 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.829975 12461 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:40.844904 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:40.829157 12376 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.638s	user 0.004s	sys 0.008s
W20260709 13:15:40.885488 10244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.018s	sys 0.022s
I20260709 13:15:40.887440 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:40.896113 10244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.018s	sys 0.022s
I20260709 13:15:40.816118 12163 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.820881 12529 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.816696 12039 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:40.823549 12433 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:40.834808 12374 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.829501 12512 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.840847 12426 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:40.895021 10316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.026s	sys 0.060s
I20260709 13:15:40.830387 12436 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:40.883827 12533 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.928478 12536 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:40.929039 12536 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:40.813838 12326 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.906735 10390 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:40.883669 12461 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.812747 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.848687 12527 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:40.810930 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.904819 10998 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:40.831749 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:40.873509 12434 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:40.809796 12468 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:15:40.831947 12421 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.822409 12375 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.810181 12308 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:40.913164 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:40.945152 10243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.005s	sys 0.036s
W20260709 13:15:40.945762 10243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.006s	sys 0.036s
I20260709 13:15:40.885105 12497 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:40.899142 12441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.029s
W20260709 13:15:40.899070 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.032s	sys 0.047s
W20260709 13:15:40.979720 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.033s	sys 0.052s
W20260709 13:15:40.980106 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 641536us
I20260709 13:15:40.981221 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.873567 12496 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:40.927491 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.813594 12518 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.912014 12039 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:40.927734 12436 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.928145 12542 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:40.928053 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:40.928426 12511 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.879959 12516 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:40.833083 12381 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.939617 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:40.811188 12480 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:40.920864 10316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.026s	sys 0.061s
I20260709 13:15:40.945942 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:40.961153 12434 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:40.948051 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.023142 10398 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:40.937525 10994 raft_consensus.cc:2368] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:40.860357 12494 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.898609 12251 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.978164 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.048609 10391 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.840236 12350 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:40.984663 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:40.906198 12376 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.993353 10396 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:40.979622 12441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.000s	sys 0.030s
I20260709 13:15:40.962147 12461 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.919551 10394 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
W20260709 13:15:41.021320 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.026774 12497 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:40.992657 12163 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.018954 12542 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.046809 12434 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.051975 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1908) took 1026 ms. Trace:
I20260709 13:15:41.136402 12542 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.058468 10241 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:41.057757 12480 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:41.139431 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 154829us
I20260709 13:15:41.057112 12543 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:41.142997 12518 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.087185 12491 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:41.150962 10246 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:41.139078 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.155809 10398 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.158593 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.159512 10395 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:41.160903 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.161743 12540 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.161754 12177 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:41.115368 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.163326 10394 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:41.159024 12515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.041s	sys 0.061s
W20260709 13:15:41.164041 12515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.041s	sys 0.061s
I20260709 13:15:41.164206 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:41.123183 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.937534 12536 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.162112 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.163793 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.172277 10399 raft_consensus.cc:2368] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:41.173334 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.166154 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.166443 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.174741 10396 raft_consensus.cc:2368] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
I20260709 13:15:41.174872 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.056704 12496 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.175786 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.121848 10391 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:41.178213 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.077335 10242 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:41.144703 12543 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:41.156764 12497 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.182876 10999 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:41.183218 10967 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:41.182114 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:41.187207 10248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.024s	sys 0.034s
W20260709 13:15:41.191391 10248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.024s	sys 0.034s
I20260709 13:15:41.192117 10390 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:41.192206 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 370) took 1038 ms. Trace:
I20260709 13:15:41.195042 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.196511 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.199041 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.199940 10397 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:41.197829 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.192785 10248 rpcz_store.cc:276] 0709 13:15:40.153850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.155709 (+  1859us) service_pool.cc:224] Handling call
0709 13:15:40.156040 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.156292 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:40.307615 (+151323us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.191855 (+884240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.191913 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:41.191965 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.192028 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.192149 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3228,"prepare.queue_time_us":185976,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":98654,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":28566,"thread_start_us":1002933,"threads_started":3,"wal-append.queue_time_us":238849}
I20260709 13:15:41.063232 12039 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.203989 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.206799 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:41.207785 10249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.010s	sys 0.056s
I20260709 13:15:41.208351 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.208709 10249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.010s	sys 0.056s
I20260709 13:15:41.209100 10999 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:41.211880 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.212302 10398 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:41.213948 10390 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:41.212950 10999 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
W20260709 13:15:41.215206 10288 connection.cc:256] RPC call timeout handler was delayed by -1.8033191330000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 13:15:41.216665 10999 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.159654 12491 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.220324 10322 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:41.221990 10999 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:41.220902 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.222761 10321 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.191975 12426 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.187402 12543 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.201680 12375 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:41.214362 12353 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.232190 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.198503 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.235016 10322 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:41.219611 12333 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:41.218447 12237 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:41.221095 12163 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.239221 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.236327 10324 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:41.220563 12039 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.241631 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.244089 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.253330 10320 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:41.255528 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.246146 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:41.195170 11979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.005s	sys 0.028s
I20260709 13:15:41.249090 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.267695 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.268581 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.269502 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.270026 10391 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:41.275266 10321 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:41.276646 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.282100 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.283823 10391 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:41.258075 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:41.260399 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.240594 12494 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:41.263178 11979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.006s	sys 0.028s
I20260709 13:15:41.288270 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.291747 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:41.244865 12381 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.287700 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.295428 11000 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:41.295682 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.251255 12375 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:41.299475 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.233398 12426 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.262687 12308 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:41.325642 10398 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:41.248528 12502 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.010s	sys 0.055s
I20260709 13:15:41.296236 10288 leader_election.cc:400] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 2 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3.
I20260709 13:15:41.294193 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.254999 12237 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.327028 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.297076 12481 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.328912 12374 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.331629 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:41.290355 12325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.014s
I20260709 13:15:41.336126 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:41.325181 10213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.020s	sys 0.020s
I20260709 13:15:41.336405 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:41.135686 10316 rpcz_store.cc:276] 0709 13:15:40.025836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.031508 (+  5672us) service_pool.cc:224] Handling call
0709 13:15:40.031982 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.032264 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:40.121603 (+ 89339us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.022001 (+900398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.028687 (+  6686us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:41.047085 (+ 18398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.051733 (+  4648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.051907 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107170,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":66709,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":955736,"threads_started":3,"wal-append.queue_time_us":288065}
I20260709 13:15:41.328047 12375 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.300957 12456 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.332773 12376 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.356472 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.391438 12325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.014s	sys 0.022s
I20260709 13:15:41.390628 10391 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:41.272495 12163 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:41.369879 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:41.409585 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.300570 12483 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:41.333496 12502 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.010s	sys 0.056s
W20260709 13:15:41.358922 12547 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.124s	user 0.000s	sys 0.002s
W20260709 13:15:41.394181 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59341.8us
I20260709 13:15:41.333397 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.329970 12494 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:41.397392 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.390127 12381 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.356045 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.398384 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 62062.8us
I20260709 13:15:41.298269 12514 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:41.400364 10965 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.018s
I20260709 13:15:41.402499 12456 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:41.403290 12554 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:15:41.391539 10213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.025s	sys 0.025s
W20260709 13:15:41.413625 10965 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.014s	sys 0.018s
I20260709 13:15:41.414146 10398 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:41.414772 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:41.417177 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 562908us
I20260709 13:15:41.340909 12308 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.419701 10398 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:41.421800 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:41.434578 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.419024 12553 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:15:41.438616 11000 raft_consensus.cc:2410] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:41.439857 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.406042 12552 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:41.390383 12481 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.412861 12483 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:41.422761 12544 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:41.427912 11979 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:41.419224 12525 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:41.468384 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:41.461921 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.470671 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.478404 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 377) took 1109 ms. Trace:
I20260709 13:15:41.479529 10245 rpcz_store.cc:276] 0709 13:15:40.368838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.609830 (+240992us) service_pool.cc:224] Handling call
0709 13:15:40.639861 (+ 30031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.640108 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.640139 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.640647 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.065480 (+424833us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:41.065530 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.065626 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.478156 (+412530us) raft_consensus.cc:1685] finished
0709 13:15:41.478178 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.478346 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":424419,"threads_started":1,"wal-append.queue_time_us":622738}
I20260709 13:15:41.481312 10398 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:41.471765 12331 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:41.484818 12331 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.484968 12237 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.485322 12331 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:41.486102 12527 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 13:15:41.471827 10997 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:41.490541 10392 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:41.493024 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.494267 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.474133 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:41.495401 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.420938 12381 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.422291 12494 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.461771 12483 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.463037 12540 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:41.484752 12561 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:15:41.507827 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.478448 11979 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:41.509665 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.482421 12525 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:41.464128 12503 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:41.515230 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 93489.1us
I20260709 13:15:41.515398 12555 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:41.516085 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 76143.3us
I20260709 13:15:41.519907 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 372) took 1347 ms. Trace:
I20260709 13:15:41.426472 12514 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.522961 10249 rpcz_store.cc:276] 0709 13:15:40.172768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.183246 (+ 10478us) service_pool.cc:224] Handling call
0709 13:15:40.189156 (+  5910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.189488 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.189525 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.199967 (+ 10442us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.209075 (+1009108us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:41.209115 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.209185 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.519561 (+310376us) raft_consensus.cc:1685] finished
0709 13:15:41.519594 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.519795 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":967045,"threads_started":1,"wal-append.queue_time_us":1198575}
I20260709 13:15:41.505815 12510 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:41.525875 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:41.529433 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.529271 10213 leader_election.cc:400] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:41.533452 10213 leader_election.cc:403] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:41.525029 12555 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.526180 12503 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:41.558195 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.561048 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:41.557701 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.561295 12548 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:41.566982 12163 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:41.569451 12536 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.573634 12456 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:41.573902 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 627) took 1567 ms. Trace:
I20260709 13:15:41.574498 10996 rpcz_store.cc:276] 0709 13:15:40.006415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.006572 (+   157us) service_pool.cc:224] Handling call
0709 13:15:41.573616 (+1567044us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54004f42d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:41.573815 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049186176}
I20260709 13:15:41.575919 12456 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.576161 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.577184 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.578366 10997 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 2: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:41.530208 12376 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:41.579514 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.579468 12376 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.580363 12436 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.581220 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.582939 12558 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:41.584066 12496 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.530002 12325 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:41.585120 12325 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:41.585477 12325 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:41.586329 12325 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.587479 12325 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.562151 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 375) took 1343 ms. Trace:
I20260709 13:15:41.562649 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.577786 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.565475 12468 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:15:41.539525 12544 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:41.598973 12544 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.599432 12544 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:41.599623 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.600390 11000 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:41.601092 12426 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:41.603137 12308 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:41.603859 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.605160 12481 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.607640 11979 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.609143 11979 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:41.611240 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48668.9us
I20260709 13:15:41.612056 12514 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.612915 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.599745 12381 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.614190 12350 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.615005 12501 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:41.615404 12501 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:41.616278 12501 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.618808 12494 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.619902 12548 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.620301 12505 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:41.620745 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.620949 12548 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:41.621639 12548 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:41.619951 10249 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:15:41.623927 10290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.025s	sys 0.069s
W20260709 13:15:41.624269 10290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.025s	sys 0.069s
W20260709 13:15:41.624856 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.617472 12501 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.627465 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.628145 10397 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:41.629117 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.565343 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.632099 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:41.638792 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.601322 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.642634 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.643437 10250 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:41.644071 10397 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:41.644611 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:41.649731 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.652623 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.653297 10246 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:41.654685 12331 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:41.657634 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.647428 10322 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:41.664196 10250 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:41.593878 10243 rpcz_store.cc:276] 0709 13:15:40.218572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.219980 (+  1408us) service_pool.cc:224] Handling call
0709 13:15:40.298832 (+ 78852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.953095 (+654263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.953140 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.953734 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.208771 (+255037us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:41.208810 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.208915 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:41.539388 (+330473us) raft_consensus.cc:1685] finished
0709 13:15:41.539417 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.562088 (+ 22671us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104668,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6418,"thread_start_us":908324,"threads_started":2,"wal-append.queue_time_us":383015}
I20260709 13:15:41.665448 10246 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:41.674633 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.679760 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.683159 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.683887 10249 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
W20260709 13:15:41.686965 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.656632 12374 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:41.686877 12353 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.691174 12433 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.705490 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:41.684314 12550 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:41.706777 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.707947 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.683696 12436 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:41.711051 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.709724 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.718408 10246 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:41.719357 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.720652 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.726837 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.696164 12331 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:41.730069 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.671521 12543 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.714879 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:41.700423 12376 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.735611 10246 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:41.732412 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 171446us
I20260709 13:15:41.741003 10399 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:41.741884 12331 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:41.742444 12331 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.735972 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.746706 10318 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:41.746946 10243 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:41.710785 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:41.725970 12566 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.233s	user 0.001s	sys 0.003s
W20260709 13:15:41.748488 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.748483 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.748484 10250 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:41.753296 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.731858 12468 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:41.759853 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.745180 12331 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:41.793726 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 276877us
I20260709 13:15:41.731859 12353 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:15:41.729599 12550 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:15:41.800392 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.763202 12350 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:41.808358 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.794858 12039 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.001s
I20260709 13:15:41.805606 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:41.813900 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.809878 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.765679 12376 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.820142 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:41.822455 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.827585 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.828192 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.828955 10396 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:41.828842 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.829510 10391 raft_consensus.cc:2376] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:15:41.796557 12555 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.834672 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:41.816056 10997 raft_consensus.cc:2410] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:41.815665 12308 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:41.842020 12308 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.842461 12308 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:41.842749 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.838342 12550 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:41.830531 12552 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.829752 12489 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:41.847841 12536 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:41.829356 12436 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:41.850579 12436 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:41.851455 12436 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.818718 12353 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:41.852586 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.853132 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:41.853876 10243 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:41.830814 12237 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:41.854182 12480 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:41.854751 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 1991) took 1125 ms. Trace:
I20260709 13:15:41.855145 10244 rpcz_store.cc:276] 0709 13:15:40.729579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.935875 (+206296us) service_pool.cc:224] Handling call
0709 13:15:40.936207 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.131959 (+195752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:41.132003 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.132057 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:41.132085 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.854532 (+722447us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540043dfd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:41.854575 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.854695 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449593600}
I20260709 13:15:41.831732 12514 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:41.856434 12333 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:41.856921 12333 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.839540 12376 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.858453 12481 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:41.858613 12559 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.518s	user 0.001s	sys 0.002s
I20260709 13:15:41.858909 12481 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:41.859352 12481 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.847340 12550 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:41.853001 12353 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.811843 12468 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:41.859845 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.804805 12484 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:41.874652 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.756868 12548 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.804754 12331 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:15:41.868893 12436 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.871869 12550 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:41.879513 12518 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.730s	user 0.012s	sys 0.001s
I20260709 13:15:41.877367 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.877679 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 227119us
I20260709 13:15:41.872385 12468 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:41.893226 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.873584 12555 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:41.893319 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.913800 10321 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:41.909157 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:41.914577 10396 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.915400 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.916047 10393 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:41.917155 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.920465 10393 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:41.917210 10320 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:41.888806 12503 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:41.925349 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.926532 10393 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:41.929011 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.903272 10399 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:41.936393 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:41.895407 10999 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:41.904362 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.904925 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.938586 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.939265 10323 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.881067 10997 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 1.
I20260709 13:15:41.909152 12461 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:41.910941 11002 raft_consensus.cc:2410] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:41.943905 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.944715 10396 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:41.878149 12515 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:41.927212 12468 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.914054 12376 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.879173 12484 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.929668 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.910215 12374 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:41.897127 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:41.877156 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:41.933154 12353 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:41.934420 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.935181 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.966101 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.967207 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.938639 10318 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.908681 10391 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:41.967934 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:41.903781 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51296.4us
I20260709 13:15:41.922817 12555 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.947230 10325 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:41.942271 12331 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:41.947350 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:41.947645 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:41.982578 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:41.982690 12039 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:41.983669 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:41.983793 12039 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:41.983898 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.984560 12039 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.985106 12039 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.985371 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:41.986358 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.986971 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.987609 10997 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:41.988517 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:41.956753 10320 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:41.959764 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 82694.5us
W20260709 13:15:41.964772 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 67747.4us
I20260709 13:15:41.992025 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:41.971107 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 380) took 1322 ms. Trace:
I20260709 13:15:41.972741 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.969223 10323 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:41.955196 12543 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:41.975878 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:41.977715 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.979136 10290 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:41.991744 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.944617 10317 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:42.003804 10320 raft_consensus.cc:2410] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:42.004532 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.004720 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:41.973975 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.004086 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:42.005463 10391 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:41.991593 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:41.992632 10241 rpcz_store.cc:276] 0709 13:15:40.648808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.657063 (+  8255us) service_pool.cc:224] Handling call
0709 13:15:40.857891 (+200828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.137695 (+279804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.696669 (+558974us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54002eca54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:41.970856 (+274187us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002eca50. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:41.971031 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901031552}
I20260709 13:15:41.993273 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:41.989003 10997 raft_consensus.cc:1813] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Handling vote request from an unknown peer cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.008459 10997 raft_consensus.cc:2368] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5.
I20260709 13:15:42.008594 12484 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.009205 12376 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:42.009642 12376 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.009824 10997 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:42.011068 12576 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.011535 12576 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:42.011924 12576 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:42.001113 12579 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:15:41.952026 12461 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.007411 12509 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.001834 12237 raft_consensus.cc:2764] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:41.964449 12325 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:41.981053 12468 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:41.972016 12478 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.010097 12376 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.018522 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:41.958091 12483 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:41.963953 12374 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.017683 12163 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.020336 12543 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.022955 12509 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:42.031057 12509 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.018086 12375 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:15:42.003814 12331 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:41.994305 12555 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.035357 12483 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.036962 12461 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.038887 12331 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.039767 12251 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.040699 12552 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:42.027650 12456 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:42.041653 12456 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.041944 12456 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.043071 12525 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.043602 12374 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.044099 12525 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.044425 12308 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.032083 12543 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:42.047160 12555 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.047201 12543 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.058789 12491 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:42.060891 12573 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:15:42.062590 12550 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.063197 12544 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.065490 12544 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.080216 12550 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:42.110453 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 118824us
I20260709 13:15:42.113056 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:42.115224 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:42.015959 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:42.120441 10213 leader_election.cc:400] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:42.013779 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.121778 10290 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.123761 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:42.120716 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 104687us
I20260709 13:15:42.121685 10320 raft_consensus.cc:2376] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4. Re-sending same reply.
I20260709 13:15:42.125156 10316 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:42.018519 10318 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:42.125952 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:42.127002 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.128165 10316 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
W20260709 13:15:42.124353 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 106032us
I20260709 13:15:41.993326 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:42.130575 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.131312 10319 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:42.131402 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.133663 10319 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:42.014051 10323 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:42.007696 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:42.135533 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.123783 10321 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:42.145332 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.145984 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.149847 10288 leader_election.cc:400] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5.
I20260709 13:15:42.150462 10288 leader_election.cc:403] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.200405 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.155576 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.202109 10325 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:42.178468 12308 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.171504 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:42.179301 12325 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.205178 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.205541 12325 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:42.206156 12325 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.209234 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.161271 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.179862 12331 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:42.162878 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.205552 10324 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:42.154220 10319 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:42.193921 10242 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:42.226016 10393 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.157517 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.173190 12163 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:42.229099 12163 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.229650 12163 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.231319 10996 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:15:42.231556 12591 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:15:42.193609 12381 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.186538 12511 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:15:42.232847 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:42.232713 12381 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.231319 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:42.173720 12237 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.154711 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:42.164065 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.160491 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.156752 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.171777 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.178069 12251 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.195744 10316 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:42.136773 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.181407 12489 raft_consensus.cc:3055] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:42.258534 12489 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:42.259359 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.260540 12489 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.262657 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.256512 10395 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:42.264374 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1329) took 1052 ms. Trace:
I20260709 13:15:42.231415 12481 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.264956 10395 rpcz_store.cc:276] 0709 13:15:41.211967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.226894 (+ 14927us) service_pool.cc:224] Handling call
0709 13:15:42.163546 (+936652us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:42.264251 (+100705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26981248}
I20260709 13:15:42.261189 12501 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.255334 10322 raft_consensus.cc:2376] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4. Re-sending same reply.
I20260709 13:15:42.266922 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.261332 11000 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:42.267546 12481 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.274554 10999 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.184562 12541 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:15:42.180886 12461 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.182348 12496 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:42.189181 12374 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.282280 12308 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.283169 12331 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:42.283690 10393 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:42.284608 10394 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:42.284722 12331 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.287914 10322 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:42.308736 12237 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:42.301445 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 149116us
I20260709 13:15:42.310155 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:42.290377 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:42.311272 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 174894us
I20260709 13:15:42.294989 10399 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:42.309564 12237 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.326896 10391 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:42.313927 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:42.277434 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:42.337993 12541 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.341467 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.342878 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 545) took 1200 ms. Trace:
I20260709 13:15:42.343223 12308 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:42.343954 12308 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.251052 12251 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:42.348157 12251 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.348258 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:42.350847 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 147093us
I20260709 13:15:42.351881 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.353590 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.355517 12461 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.355993 12511 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.356530 12511 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.356273 12456 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.356917 12511 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.278643 12496 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.361285 12496 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.361356 12381 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.362690 12329 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.370829 10999 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:42.386181 10319 raft_consensus.cc:2376] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4. Re-sending same reply.
I20260709 13:15:42.302569 12576 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.370599 12329 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:42.396085 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:42.385591 12308 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:42.402429 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:42.402617 12333 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.010s
W20260709 13:15:42.405040 11002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 636) took 1561 ms (client timeout 1916 ms). Trace:
I20260709 13:15:42.402813 12575 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.415937 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.418192 12575 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.421348 10242 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:42.409488 11002 rpcz_store.cc:269] 0709 13:15:40.843623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.843743 (+   120us) service_pool.cc:224] Handling call
0709 13:15:42.404536 (+1560793us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540028f0d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:42.404822 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390926592}
W20260709 13:15:42.422605 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69121.5us
I20260709 13:15:42.424389 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.425269 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.426111 11002 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:42.427944 10998 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:15:42.428390 10998 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 5
I20260709 13:15:42.428658 10998 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:42.429003 10998 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.431249 12481 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.343246 10993 rpcz_store.cc:276] 0709 13:15:41.142091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.144438 (+  2347us) service_pool.cc:224] Handling call
0709 13:15:42.341021 (+1196583us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:42.342792 (+  1771us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16942336}
I20260709 13:15:42.429486 12325 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.455209 12237 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.400151 12456 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.456483 12333 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.458045 10996 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:15:42.458468 10996 pending_rounds.cc:85] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 4
I20260709 13:15:42.458704 10996 pending_rounds.cc:107] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:15:42.458974 10996 raft_consensus.cc:2889] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.459061 12333 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:42.459985 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 75725.5us
I20260709 13:15:42.462423 12381 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.435393 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:42.477836 12575 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.433907 12039 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.472443 10390 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:42.467608 12325 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.488148 12525 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.488430 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.489192 10317 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
W20260709 13:15:42.489817 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.490396 12503 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.491103 12503 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.493628 12503 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.493476 12163 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.495031 10316 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:42.519631 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:42.520368 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.520677 12541 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:42.495379 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 185424us
I20260709 13:15:42.522464 12329 raft_consensus.cc:3055] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:42.522289 12511 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.522914 12329 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:42.524338 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:42.524142 12329 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.524940 12511 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:42.526007 12329 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.497087 12544 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:15:42.498064 12489 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.498900 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.500051 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1860) took 1276 ms. Trace:
I20260709 13:15:42.488198 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.530565 10390 rpcz_store.cc:276] 0709 13:15:41.206142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.221498 (+ 15356us) service_pool.cc:224] Handling call
0709 13:15:42.157037 (+935539us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:42.482776 (+325739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12978944}
I20260709 13:15:42.531363 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.486132 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.506362 10320 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:42.455260 12576 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.506269 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:42.507172 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 89610.3us
I20260709 13:15:42.507580 10317 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:42.509063 12251 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.490444 12039 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:42.513505 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.515072 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:42.544468 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.544653 10242 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:42.518882 12575 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.545689 12575 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:42.546986 12575 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.547422 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.489234 12550 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:42.531728 12325 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:42.534969 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.548776 12550 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:42.549479 12550 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.549959 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.550195 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:42.551664 10324 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:42.553212 12544 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.548874 12325 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:42.554804 12325 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.556134 10144 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 281) took 9912 ms. Trace:
W20260709 13:15:42.558313 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.535844 12374 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5.
W20260709 13:15:42.558269 12509 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.007s
I20260709 13:15:42.536995 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.537220 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:42.560117 10317 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:42.538626 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 63225.4us
I20260709 13:15:42.539111 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.539217 12576 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.540385 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.541517 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:42.536322 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.521787 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.570894 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.548663 12511 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:42.576092 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:42.578214 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:42.589723 12543 consensus_meta.cc:287] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.003s
I20260709 13:15:42.590463 12543 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.591698 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:42.593556 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.594444 10399 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:42.572816 12374 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:15:42.595485 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.574589 12461 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.596392 10398 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:42.598744 10242 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:42.606426 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.608914 10247 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:42.608635 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.584501 12251 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.613574 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:42.618425 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.620642 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.621330 12434 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.622467 12501 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:42.624194 12501 raft_consensus.cc:2764] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:42.612699 12511 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.626814 12511 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.627219 12163 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.629379 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.556506 10144 rpcz_store.cc:276] 0709 13:15:32.643518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.643727 (+   209us) service_pool.cc:224] Handling call
0709 13:15:42.555886 (+9912159us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:38.989476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:38.990048 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:38.990099 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:15:38.990117 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:39.071570 (+ 81453us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:39.071654 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:39.071682 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:39.072244 (+   562us) tablet.cc:701] Row locks acquired
0709 13:15:39.072262 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:15:39.072429 (+   167us) write_op.cc:270] Start()
0709 13:15:39.072601 (+   172us) write_op.cc:276] Timestamp: P: 1783602939072379 usec, L: 0
0709 13:15:39.072629 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:15:39.073328 (+   699us) log.cc:844] Serialized 2084 byte log entry
0709 13:15:40.122017 (+1048689us) op_driver.cc:464] REPLICATION: finished
0709 13:15:41.535014 (+1412997us) write_op.cc:301] APPLY: starting
0709 13:15:41.543971 (+  8957us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:41.590257 (+ 46286us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:41.590416 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:41.677995 (+ 87579us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:41.718145 (+ 40150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:15:41.727449 (+  9304us) write_op.cc:312] APPLY: finished
0709 13:15:41.756591 (+ 29142us) log.cc:844] Serialized 47 byte log entry
0709 13:15:41.957587 (+200996us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:41.962029 (+  4442us) write_op.cc:454] Released schema lock
0709 13:15:41.974378 (+ 12349us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:42.001366 (+ 26988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:42.001399 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1398130,"apply.run_cpu_time_us":46898,"apply.run_wall_time_us":472202,"num_ops":5,"prepare.queue_time_us":1033382,"prepare.run_cpu_time_us":25102,"prepare.run_wall_time_us":218398,"raft.queue_time_us":586960,"raft.run_cpu_time_us":79803,"raft.run_wall_time_us":1344317,"replication_time_us":1030694,"thread_start_us":2352628,"threads_started":5,"wal-append.queue_time_us":499341,"wal-append.run_cpu_time_us":19522,"wal-append.run_wall_time_us":1438636}]]}
I20260709 13:15:42.630221 10392 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:42.597666 12461 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:42.630623 12461 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.636339 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.638792 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.637766 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:42.643988 10317 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:42.571909 12509 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.651330 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:42.652232 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.657222 10244 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:42.666702 10391 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:42.667171 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:42.667511 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.667984 10242 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.668280 10243 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:42.670728 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.671541 10246 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:42.675700 12525 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:42.677070 12543 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.694697 12325 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.697317 12325 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:42.697664 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 121410us
I20260709 13:15:42.694805 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.700224 10241 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:42.701079 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:42.701200 10242 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:42.701704 10241 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.702422 12576 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:42.702847 10390 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:42.703164 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.704030 10397 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:42.704806 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.705662 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.706374 10242 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:42.707449 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:42.706948 10146 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.707454 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.711520 10242 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:42.713678 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.715086 12433 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:42.715687 12433 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:42.715791 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:42.716796 12433 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.708205 10243 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.717890 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.720101 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.724764 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:42.741874 12600 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:15:42.742378 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.744135 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:42.745501 12376 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.715s	user 0.004s	sys 0.015s
I20260709 13:15:42.746218 12376 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.747574 12572 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.748368 12572 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.749275 12376 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:42.750455 12456 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:42.752522 11001 raft_consensus.cc:2368] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:15:42.752652 12507 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:42.754083 12518 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:42.755999 12481 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:42.757809 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:42.718510 12536 raft_consensus.cc:2764] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:42.757833 12494 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:42.741937 10246 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:15:42.765666 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47886.6us
I20260709 13:15:42.766192 12511 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:42.771229 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.772308 10241 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:42.772830 10243 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:42.709782 10146 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: config changed from index 4 to 5, term changed from 2 to 5, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195), VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:42.758119 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:42.737275 12576 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:42.767753 12509 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.801981 10244 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:42.805488 10243 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.781900 12329 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:42.821981 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:42.719775 10134 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ab33f0a79ddf4f5a8ba81b3b0e120529 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:42.827472 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:42.828176 11001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 501) took 1470 ms (client timeout 1581 ms). Trace:
W20260709 13:15:42.828898 11001 rpcz_store.cc:269] 0709 13:15:41.357420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.402017 (+ 44597us) service_pool.cc:224] Handling call
0709 13:15:42.171294 (+769277us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:42.827831 (+656537us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400251554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:42.828056 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1132809984}
I20260709 13:15:42.832264 12501 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:42.832834 12501 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:42.835870 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 77813.4us
I20260709 13:15:42.840652 10398 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.814875 12329 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:42.845194 10134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 125652us
I20260709 13:15:42.822852 12511 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.837682 12375 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:42.847375 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.825039 10146 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 4 to 6, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:42.838275 12456 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:42.854048 12511 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.866024 12456 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:42.867529 12456 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.868466 12511 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.857385 12525 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:42.857723 12461 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.871658 12525 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:42.872422 12434 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.873112 12461 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.872658 12525 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.871132 12511 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:42.858824 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.876225 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.876339 12550 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.877697 10249 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:42.879590 12325 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.880421 12325 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:42.880980 12325 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:42.881183 12434 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:42.881681 12434 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:42.864305 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.850760 12375 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:42.833958 12501 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.870283 12536 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:42.815198 12518 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.877748 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.887741 10146 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 4 to 5, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 5 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:42.890791 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 215509us
I20260709 13:15:42.892299 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:42.881007 12550 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:42.900136 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:42.913079 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:42.922685 12509 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.923231 12509 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:42.923616 12509 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.925007 12375 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.927165 12375 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.887182 12434 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:42.934497 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.937465 12507 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.895519 12503 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.938148 12507 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.944717 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.893356 12494 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:15:42.881217 12576 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:42.882102 12325 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.947373 10146 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 3, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:42.955165 10146 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 3 to 5, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:42.967166 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.969375 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:42.970615 12503 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:42.970903 12572 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:42.971189 12503 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:42.972234 12503 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:42.968199 10996 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
W20260709 13:15:42.976608 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 325349us
I20260709 13:15:42.949033 12501 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.982419 10146 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 4 to 5, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 5 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:42.983222 10398 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
W20260709 13:15:42.974309 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 145654us
I20260709 13:15:42.993274 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:42.995682 12039 raft_consensus.cc:2764] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:42.999099 12518 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:42.999329 12507 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.001068 12610 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:42.994330 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:43.004007 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:43.005220 12489 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.005302 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:43.006507 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:43.008109 12329 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.009232 12329 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.009397 12463 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:43.009840 12463 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.010214 12463 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:42.967916 12376 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:43.033764 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64473.3us
W20260709 13:15:43.057698 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.044656 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 214703us
I20260709 13:15:43.013144  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:43.068508 10249 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:43.074681 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:43.075806 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.077159 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:42.967278 12536 consensus_queue.cc:1059] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:15:43.090442 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.069036 12610 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:43.092322 12610 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.093298 12536 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.093743 12536 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:43.094854 12536 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.095714 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:43.095993 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:43.096462 10994 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.096900 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:43.098392 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:43.090487 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:43.096174 12536 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:43.102644 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.025558 12376 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:43.115289 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 97448.1us
I20260709 13:15:43.069691 12543 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.126653 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:43.122349 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:43.125237 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:43.104184 12575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.017s
I20260709 13:15:43.135032 11001 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:43.117065 10146 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 4, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:43.140334 10391 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.157234 10317 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.130544 12576 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.163302 10397 raft_consensus.cc:2368] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6.
W20260709 13:15:43.179705 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49284.9us
I20260709 13:15:43.182987 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:43.187695 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.187268 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.186738 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:43.197281 10393 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.161715 10146 catalog_manager.cc:5697] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:43.199666 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.156239 12494 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:43.167362 10396 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:43.128297 12572 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:43.205534 10146 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:43.156139 12251 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:43.207744 10319 raft_consensus.cc:2368] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4.
I20260709 13:15:43.209113 10965 leader_election.cc:400] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6.
I20260709 13:15:43.211612 10965 leader_election.cc:403] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.162593 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:43.187600 12615 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:43.212839 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.214412 10323 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:43.180536 12505 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.135907 12518 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:15:43.213316 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 175543us
I20260709 13:15:43.252238 10146 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:15:43.255409 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.258495 10319 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:43.200223 12375 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:15:43.181918 12609 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:15:43.179620 12483 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.194s
I20260709 13:15:43.179888 12480 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.113s
W20260709 13:15:43.272548 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 191166us
I20260709 13:15:43.256318 12494 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:43.284148 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:43.286357 10393 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:43.256222 12576 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6.
I20260709 13:15:43.276360 10146 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:43.344197 12634 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.345193 10996 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:43.344998 12634 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.348225 12628 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.348958 12628 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.349261 12494 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.351235 12620 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:43.353668 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:43.271067 12251 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:43.363123 12622 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:15:43.364138 12251 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:43.364704 12610 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:43.269681 12615 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.335041 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:43.366856 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.367725 10391 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:43.330677 12609 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.393772 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:43.277143 12505 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.364728 12251 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:43.414261 12525 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:43.368564 12610 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:43.424320 12610 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:43.425426 12509 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.001s
I20260709 13:15:43.426201 12610 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.427014 12481 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:43.427414 12481 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:43.428362 12481 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.429239 12251 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:43.410460 12461 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:43.431754 12461 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.429585 12481 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.431106 12505 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:43.392542 12463 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.453599 10994 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:15:43.454598 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:43.455408 12461 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:43.455848 12543 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:43.456602 12503 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.445690 12251 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.410343 12637 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:43.458357 12496 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:43.481045 12463 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.484843 12496 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.487142 12496 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.425904 12509 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.503468 12503 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.505715 12637 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:43.507134 12628 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.506831 12637 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:43.512773 12607 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.487s	user 0.000s	sys 0.004s
I20260709 13:15:43.512601 10250 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:43.514454 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 46435.6us
W20260709 13:15:43.518810 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.412961 12609 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.522874 12643 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:43.523397 12643 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:43.523818 12643 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:43.524379 12609 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:43.509203 12615 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:43.527531 10993 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:43.554371 10392 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:43.576221 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 292225us
I20260709 13:15:43.566260 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.626756 10391 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:43.627292 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:43.628198 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 172030us
I20260709 13:15:43.632200 10318 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.634672 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:43.636737 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 109652us
I20260709 13:15:43.640915 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:43.630901 12434 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.644459 10320 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.640234 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:43.648207 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.550262 12543 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.648471 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:43.649365 10241 raft_consensus.cc:2410] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:43.649677 10324 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:43.648509 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 578) took 1040 ms. Trace:
I20260709 13:15:43.650519 12543 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.651296 10316 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:43.650799 10999 rpcz_store.cc:276] 0709 13:15:42.608512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.608657 (+   145us) service_pool.cc:224] Handling call
0709 13:15:42.618631 (+  9974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.619083 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.619111 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.619652 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:15:42.820740 (+201088us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:42.820800 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.820905 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.511907 (+691002us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:43.643995 (+132088us) raft_consensus.cc:1685] finished
0709 13:15:43.644016 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.648445 (+  4429us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12330,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":56845056,"thread_start_us":194364,"threads_started":1,"wal-append.queue_time_us":328725}
I20260709 13:15:43.654110 10391 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:15:43.656198 12626 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 13:15:43.660382 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.662856 12503 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.663529 12509 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:43.665632 12634 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:43.665508 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:43.649583 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:43.692759 12374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.008s
I20260709 13:15:43.696182 10249 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:43.696592 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:43.697149 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52313.4us
I20260709 13:15:43.700410 10320 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:15:43.687201 12501 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.002s
W20260709 13:15:43.717787 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.683610 12456 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.642930 12649 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:43.699460 12374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.009s
I20260709 13:15:43.724524 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:43.755167 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:43.755371 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:43.773799 10396 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.759434 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:43.774571 10246 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.746999 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.749373 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.777110 10390 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:43.770462 10399 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:43.696029 12634 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.782171 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 63698.6us
I20260709 13:15:43.789888 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.791615 12374 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:43.792284 12374 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.794499 12374 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.794579 12483 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.795356 12483 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.798849 12483 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.748953 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.805812 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:43.806970 10999 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:43.717818 12572 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.812767 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.815665 10321 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.818974 10362 leader_election.cc:400] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:15:43.819377 10362 leader_election.cc:403] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.753567 12617 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:15:43.823920 12617 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:15:43.741775 12456 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:15:43.825790 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.734647 12251 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.750051 10993 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.825809 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:43.812587 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:43.735450 12331 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:43.836403 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.834683 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.720472 12650 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:15:43.835345 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:43.830211 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.842746 10322 raft_consensus.cc:2368] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:43.843391 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.844856 10243 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:43.847239 10320 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:43.841878 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:43.853832 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.739935 12649 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:43.752929 12376 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.866101 10396 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:43.866938 10994 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:43.848100 12374 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:15:43.873162 12610 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:43.873651 12610 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:43.877312 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.878643 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:43.879542 10318 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:43.838167 12503 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:43.811156 12634 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.838186 12483 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:43.863924 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.844481 12325 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:43.855734 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:43.880259 10320 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:43.882077 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.884356 12649 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:43.886837 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.885113 12643 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:43.890154 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.866024 12376 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:43.850751 12331 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:43.900068 12483 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.901263 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.897614 10322 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:43.891397 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:43.887669 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:43.905498 10390 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:43.862784 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.906854 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:43.907989 12575 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:43.908380 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:43.908911 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53252.8us
I20260709 13:15:43.902084 12634 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:43.909961 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:44.021425 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.131990 10290 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:44.132450 10398 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.133004 10393 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:15:44.133773 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 242467us
W20260709 13:15:44.058997 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64238.6us
I20260709 13:15:43.943804 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:43.944149 10391 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:44.136243 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:44.090389 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.137517 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:43.907557 10321 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:43.890919 12503 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.164400 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.156188 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:44.161036 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:43.922647 12654 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.158s	user 0.003s	sys 0.000s
I20260709 13:15:44.175660 10398 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:44.141549 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:44.216027 10324 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:43.925384 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:44.216840 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.141340 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:43.895267 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 171845us
I20260709 13:15:43.895591 10246 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:43.902400 12650 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.194403 10316 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:44.262693 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:44.217275 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:44.237787 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 81690.6us
W20260709 13:15:44.262312 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69603.5us
I20260709 13:15:43.924752 12633 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:44.276234 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:44.261885 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:44.293612 10324 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:44.251592 10398 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:44.237540 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:44.288573 10317 raft_consensus.cc:2376] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:15:44.238291 12575 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.218513 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:44.258855 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 94552us
I20260709 13:15:44.236568 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 338) took 1116 ms. Trace:
W20260709 13:15:44.261170 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.261885 10395 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:43.983355 12433 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.165362 12655 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:15:44.298192 10321 rpcz_store.cc:276] 0709 13:15:43.078611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.084124 (+  5513us) service_pool.cc:224] Handling call
0709 13:15:43.812603 (+728479us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:44.194738 (+382135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592640}
W20260709 13:15:43.991504 12644 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.507s	user 0.000s	sys 0.003s
W20260709 13:15:44.172317 12661 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 13:15:44.170971 12641 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.686s	user 0.003s	sys 0.000s
I20260709 13:15:44.300951 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.174347 12163 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:15:44.302011 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.162041 12251 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.302635 12642 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:44.303598 10322 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:44.288746 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:44.160667 12634 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.337219 12634 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:44.337801 12634 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:44.306536 12660 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.397s	user 0.002s	sys 0.018s
I20260709 13:15:44.343212 12576 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:44.344041 12576 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:44.101521 12628 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.243s
I20260709 13:15:43.982864 12662 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:44.347383 12662 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:43.992959 12645 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.510s	user 0.000s	sys 0.002s
I20260709 13:15:44.315141 12543 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.351716 12543 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.352841 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1986) took 1096 ms. Trace:
I20260709 13:15:44.345521 12628 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.354558 12628 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.353250 10323 rpcz_store.cc:276] 0709 13:15:43.256366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.265042 (+  8676us) service_pool.cc:224] Handling call
0709 13:15:43.270995 (+  5953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.271285 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.271317 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.325007 (+ 53690us) log.cc:844] Serialized 26 byte log entry
0709 13:15:43.395274 (+ 70267us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:43.445261 (+ 49987us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.463684 (+ 18423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.463763 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.992119 (+528356us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:44.352479 (+360360us) raft_consensus.cc:1685] finished
0709 13:15:44.352592 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.352740 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18168,"prepare.queue_time_us":24767,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":18467,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":22805,"spinlock_wait_cycles":13628672,"thread_start_us":46595,"threads_started":1,"wal-append.queue_time_us":133983}
I20260709 13:15:44.357568 12628 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.005960 12624 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.379s
I20260709 13:15:44.288609 12650 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.216822 12503 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:44.297475 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:44.195652 12489 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:15:44.308538 10996 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:44.313129 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.314016 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:44.314581 10362 leader_election.cc:400] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4.
I20260709 13:15:44.167061 12609 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.315634 10396 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:44.139489 12649 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.316617 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:44.159494 12612 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.315182 11002 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:44.319533 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:44.159257 12541 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:44.159297 12331 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.158130 12507 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.134291 12643 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.325256 10320 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:44.326325 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:44.392819 12609 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.196230 12496 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:15:44.328461 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.322849 12575 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.330094 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:44.237884 12525 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.275038 12039 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.335727 12251 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:44.336421 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 47753.5us
I20260709 13:15:44.362696 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:43.915519 12325 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:44.295944 12633 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:44.332078 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:44.374709 10395 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:44.194626 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.412047 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 339) took 1332 ms. Trace:
I20260709 13:15:44.377991 10399 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:44.135833 12483 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.384474 10394 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:44.385985 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:44.387123 10324 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:44.387115 10362 leader_election.cc:403] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.420775 12616 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:44.420893 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 113104us
I20260709 13:15:44.422605 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:44.389824 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 73487.6us
I20260709 13:15:43.927464 12610 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.335757 12163 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:44.354092 12543 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:44.391960 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75454.7us
I20260709 13:15:44.345491 12576 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.404114 12662 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:44.430814 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 132347us
I20260709 13:15:44.415531 10325 rpcz_store.cc:276] 0709 13:15:43.079152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.079319 (+   167us) service_pool.cc:224] Handling call
0709 13:15:43.127627 (+ 48308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.332439 (+204812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.332487 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.344382 (+ 11895us) log.cc:844] Serialized 26 byte log entry
0709 13:15:43.409479 (+ 65097us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:43.410177 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.410269 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.990713 (+580444us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:44.406225 (+415512us) raft_consensus.cc:1685] finished
0709 13:15:44.406263 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.411975 (+  5712us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212622,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"spinlock_wait_cycles":9820544,"thread_start_us":231901,"threads_started":2,"wal-append.queue_time_us":139289}
I20260709 13:15:44.431664 10290 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:44.387952 12628 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:44.315256 12433 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.386787 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:44.388475 12375 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.385187 10997 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:44.410205 10317 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:44.382928 12434 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:15:44.394071 12624 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:44.395539 12544 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.393172 12237 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:44.404135 12507 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.453166 12575 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.425627 12163 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:44.433526 12643 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:15:44.397136 12541 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.436635 12331 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.382690 12642 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:44.433056 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:44.438637 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.414023 10998 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:44.418443 12637 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:44.396317 12612 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.446905 12624 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:15:44.445200 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.414149 12481 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:15:44.417614 12329 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:15:44.435220 12628 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:44.468799 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:44.430956 12251 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.456278 12237 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.449137 12525 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:44.424145 10398 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:44.447109 12662 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:44.463215 12331 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.460851 12434 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:44.468288 12039 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.485536 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.476217 12575 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.467638 12637 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:44.455173 12375 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.453745 12507 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:44.492813 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 82807.4us
I20260709 13:15:44.487941 12237 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.486047 12643 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:44.511473 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:44.514544 12643 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:44.515542 12643 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.516892 12643 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.489108 12649 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:44.518499 12649 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:44.518996 12649 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.521232 12237 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.526659 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:44.527206 12649 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.491281 12668 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.495924 12331 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.496608 12434 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:44.496258 12039 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:44.552385 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 67004.7us
I20260709 13:15:44.553452 12374 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:44.559846 12668 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.561964 12650 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.563709 12541 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:44.570339 12666 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:15:44.571444 12525 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.575063 12609 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:44.574663 12624 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.545646 12628 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:44.579636 12665 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:15:44.605242 10290 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.599341 12642 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.611789 12331 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.619777 12634 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.628086 12616 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4.
I20260709 13:15:44.488438 12325 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.593786 12039 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.599710 12496 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.630136 12251 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.493214 12163 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.672605 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.672837 12163 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.673281 10246 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
W20260709 13:15:44.643380 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 116842us
W20260709 13:15:44.675537 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.514s (SENT) [suppressed 41 similar messages]
I20260709 13:15:44.647810 12637 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.677155 10364 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:44.667033 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.679111 10242 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:44.641149 12544 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:44.671620 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.636260 12525 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.671779 12612 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.652734 12374 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.688234 10248 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:15:44.681720 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 259163us
W20260709 13:15:44.693001 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.681430 12628 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.684994 12251 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:44.680753 12679 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:44.686103 12616 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:44.739674 12671 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:15:44.739882 12668 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:44.676328 12575 consensus_queue.cc:1175] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" responder_term: 9 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:44.740567 12609 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.742055 12650 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:44.694090 12637 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.683429 12496 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:44.739768 12376 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.002s
I20260709 13:15:44.749145 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:44.750595 12677 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.746985 12489 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:44.669284 12434 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.732611 12675 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.815392 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 66325.9us
W20260709 13:15:44.827929 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 152408us
I20260709 13:15:44.830570 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.830332 12677 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.761612 12616 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.810626 12544 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.810242 12251 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:44.839041 12675 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:44.861209 12331 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:44.843953 10213 leader_election.cc:336] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.792s (SENT)
I20260709 13:15:44.862562 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:44.862859 12376 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.863075 12434 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.863435 12376 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.864498 12496 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.865253 12668 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.865506 12376 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.828529 12374 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:44.866216 12374 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:44.764245 12679 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.873387 12634 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.874147 12679 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.874701 12251 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.824846 12483 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.878839 10998 raft_consensus.cc:2410] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:44.880796 12483 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.868371 12374 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.824708 12650 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.831290 12507 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.889459 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.877261 12039 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.840040 12616 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:44.899317 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:44.816205 12609 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.900050 10317 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:44.910485 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1937) took 1082 ms. Trace:
I20260709 13:15:44.862926 12331 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.914662 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 267705us
I20260709 13:15:44.915668 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.900849 12039 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.839159 12612 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:44.914055 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 181849us
I20260709 13:15:44.929204 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:44.892551 12483 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.924808 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:44.935883 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:44.937043 11002 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.937163 11000 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.910884 10319 rpcz_store.cc:276] 0709 13:15:43.828433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.832435 (+  4002us) service_pool.cc:224] Handling call
0709 13:15:43.836279 (+  3844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.159545 (+323266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:44.159904 (+   359us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.373471 (+213567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.373641 (+   170us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:44.373718 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.910198 (+536480us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000cc454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:44.910280 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.910424 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":619,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":5691,"spinlock_wait_cycles":749016704,"thread_start_us":213012,"threads_started":1,"wal-append.queue_time_us":300869}
I20260709 13:15:44.941627 12571 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:44.942706 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.945132 12456 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:44.945307 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:44.946094 12541 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.947359 12541 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:44.948760 12541 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:44.949636 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.945701 12456 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.952276 12456 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.953027 12571 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.953533 12375 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.959833 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:44.959259 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:44.961133 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:44.961676 10999 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.930523 12617 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.965293 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.889545 12544 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:44.967031 12674 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:15:44.900979 12507 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.975549 12609 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.958421 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:44.900741 12503 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.990042 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.986655 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.956744 12612 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.035458 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:44.991583 11002 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:44.924787 12331 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:44.976531 12677 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:44.959578 12483 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.036186 10250 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:45.099027 11000 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:45.045039 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:45.237603 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.120333 12669 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:45.221764 12544 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:44.979369 12675 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:45.730738 12675 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:45.136685 12633 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.731483 12675 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.334844 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1368) took 1017 ms. Trace:
I20260709 13:15:45.713922 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:45.045799 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.274187 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.734325 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.067627 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:45.180858 10999 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:45.730020 12544 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.301801 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 276347us
I20260709 13:15:45.064416 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:45.732781 10393 rpcz_store.cc:276] 0709 13:15:44.317803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.325810 (+  8007us) service_pool.cc:224] Handling call
0709 13:15:44.379955 (+ 54145us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:44.380548 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.380589 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:44.385328 (+  4739us) log.cc:844] Serialized 52 byte log entry
0709 13:15:44.641627 (+256299us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:44.668568 (+ 26941us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.692340 (+ 23772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.692424 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.334577 (+642153us) raft_consensus.cc:1685] finished
0709 13:15:45.334596 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.334766 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23484,"prepare.queue_time_us":34802,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":29009,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5194,"spinlock_wait_cycles":3222784,"thread_start_us":215631,"threads_started":1,"wal-append.queue_time_us":285795}
W20260709 13:15:45.739950 10213 leader_election.cc:336] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.772s (SENT)
I20260709 13:15:45.742741 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:45.744783 10390 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 2: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:15:45.222337 12651 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:15:45.753536 12612 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:45.729250 12669 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:45.756043 12675 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.727833 12609 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.732674 12678 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.760033 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 824539us
I20260709 13:15:45.135563 12503 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.439374 12684 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:45.302659 12662 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.302758 12686 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:45.764461 10999 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:45.766189 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:45.024879 12617 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:45.767309 10398 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:45.765792 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:45.203840 12374 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.771549 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:45.774151 11002 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:45.747788 12543 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:45.777611 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:45.769199 12616 consensus_meta.cc:287] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.851s	user 0.012s	sys 0.000s
I20260709 13:15:45.780408 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:45.781265 11000 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:45.746110 12544 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.766312 12678 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.782557 12616 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:45.771788 12662 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.783489 12686 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.791880 12686 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:45.792332 12331 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.793008 12331 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.793463 12331 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:45.793819 12237 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:45.765679 12609 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.784009 12669 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:45.788859 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:45.799054 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:45.769516 12684 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.800949 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:45.801792 10392 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:45.794211 12686 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:45.804765 10395 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:45.788204 12543 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.804818 12374 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.807463 12706 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.811926 12706 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.814092 12649 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:45.803444 12705 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.814814 12706 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.815099 12705 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.817824 12705 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.803659 12699 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.818867 12699 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.820649 12684 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:45.821058 12699 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.821933 10398 raft_consensus.cc:2410] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:45.825114 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:45.826100 10392 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:45.830873 12678 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:45.831504 12680 log.cc:927] Time spent T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.923s	user 0.019s	sys 0.034s
I20260709 13:15:45.831691 12662 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:45.833985 12433 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.837282 12617 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:45.837790 10996 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:45.846704 12483 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.847371 12609 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.848748 12616 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:45.848811 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 591) took 1618 ms. Trace:
I20260709 13:15:45.846943 12494 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:45.850020 12494 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:45.849799 12544 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.849643 11001 rpcz_store.cc:276] 0709 13:15:44.230557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.230728 (+   171us) service_pool.cc:224] Handling call
0709 13:15:44.275369 (+ 44641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.479363 (+203994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.479394 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.479436 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:44.479474 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.848527 (+1369053us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54006fb8d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:45.848577 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.848729 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468634880}
I20260709 13:15:45.853617 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:45.854650 10392 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
W20260709 13:15:45.857191 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.860651 12331 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:45.861627 12677 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.863778 12677 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.869400 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:45.885141 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.891422 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.892262 10324 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:45.893354 10323 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:45.897059 10321 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:45.897403 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.898056 10323 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:45.898378 10316 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:45.898988 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.900820 10392 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:45.899721 10323 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:45.903167 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.903672 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.906769 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:45.910356 10320 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:45.855806 12543 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:45.921645 10323 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:45.935632 10316 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:45.876240 12331 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.958339 12331 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:45.959522 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:45.961237 12331 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:45.962435 12662 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:45.963105 12662 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:45.880048 12325 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:45.982676 10324 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:46.022861 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:45.990741 10362 connection.cc:256] RPC call timeout handler was delayed by -1.4458699169999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:15:46.060025 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 186174us
I20260709 13:15:46.072685 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.096674 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:46.101305 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 78548us
I20260709 13:15:46.102643 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.121999 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:46.124246 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:46.126080 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.077953 12376 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.130971 10245 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:46.144703 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.145265 10322 raft_consensus.cc:2410] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:46.145676 10393 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.142696 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:46.126605 12543 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.146920 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:46.146857 12543 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.147534 10242 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:46.125581 12503 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.148450 12503 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.148988 12543 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.126183 12643 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:46.151919 12503 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.142778 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.154137 10250 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:46.156682 10392 raft_consensus.cc:2376] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2. Re-sending same reply.
I20260709 13:15:46.160902 10242 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:46.105518 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 600) took 1203 ms. Trace:
I20260709 13:15:46.163491 10997 rpcz_store.cc:276] 0709 13:15:44.893571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.896848 (+  3277us) service_pool.cc:224] Handling call
0709 13:15:44.983402 (+ 86554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.066134 (+ 82732us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:45.621357 (+555223us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.918064 (+296707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.999991 (+ 81927us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:46.019277 (+ 19286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.063445 (+ 44168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.096438 (+ 32993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35825,"prepare.queue_time_us":114965,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":115,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":71900,"thread_start_us":512017,"threads_started":2,"wal-append.queue_time_us":161747}
I20260709 13:15:46.165477 12572 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.130995 12678 raft_consensus.cc:2764] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:46.166365 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:46.166538 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 105282us
I20260709 13:15:46.168926 10392 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:46.169665 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:46.161194 12617 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.161721 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 660) took 1201 ms. Trace:
I20260709 13:15:46.167994 12712 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:46.188532 12712 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.188992 12712 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.161520 12483 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.022825 12494 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.190191 12494 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.167589 12503 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:46.168008 12481 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:46.170868 12572 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.187237 12496 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:46.189926 12483 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.183375 12677 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.230093 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:46.215226 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.155642 12325 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:15:46.194756 12612 consensus_queue.cc:1175] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73825599c2644b898cebaafbccd86e99" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:15:46.236261 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.287752 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:46.176793 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.176059 10393 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:46.171963 12662 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:46.291810 12325 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:46.293180 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.294843 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:46.301224 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.296178 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:46.296245 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:46.295619 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.302743 11000 raft_consensus.cc:2410] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:46.297312 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.214347 10364 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:46.298146 11001 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:46.290913 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:46.307919 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.194661 12503 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.311642 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.312234 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.312661 12572 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.283881 12496 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:46.312937 10242 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:46.313290 12503 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.232894 12376 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.313890 12496 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:46.314844 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.181325 10998 rpcz_store.cc:276] 0709 13:15:44.959022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.098936 (+139914us) service_pool.cc:224] Handling call
0709 13:15:45.099396 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.099730 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:45.733081 (+633351us) log.cc:844] Serialized 14 byte log entry
0709 13:15:46.096573 (+363492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:46.122952 (+ 26379us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:46.126404 (+  3452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.145442 (+ 19038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.160596 (+ 15154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69445,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":310,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":112,"thread_start_us":485948,"threads_started":2,"wal-append.queue_time_us":557013}
I20260709 13:15:46.315192 12496 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.316017 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.316879 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.317780 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.218648 12717 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:46.218858 12707 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.318894 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.324819 10243 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:46.318933 10399 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:46.317999 11002 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:15:46.320250 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 106042us
I20260709 13:15:46.321362 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.206645 12509 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.327486 12719 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:46.327824 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.336068 11000 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:46.329166 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.316110 12678 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.329600 12507 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.329857 12624 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:46.316257 12543 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:46.332798 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.315860 12610 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:46.301517 12325 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:46.332309 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:46.334002 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 164394us
I20260709 13:15:46.215369 12722 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.215066 12702 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:15:46.343559 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.309202 12705 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:46.195956 12617 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.351845 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:46.339473 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:46.355605 12483 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.356208 12039 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:46.352764 12686 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:46.363112 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.378093 10243 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:46.364053 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.339318 12710 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:46.366608 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.367650 12325 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.383209 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.352550 12722 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:46.383884 10242 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:46.351684 12719 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:46.340560 12678 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.194353 12718 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
W20260709 13:15:46.375304 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.387272 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.381593 12686 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.378717 10241 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:46.376451 12705 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.379952 12710 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:46.382339 12503 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:46.395686 10243 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:46.380415 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.379951 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.381906 12617 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:46.382287 12039 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:46.397394 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45620.5us
I20260709 13:15:46.397737 10246 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:46.376915 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.389374 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.398923 10242 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:46.398211 12039 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.347537 12509 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.351302 12543 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.396998 10248 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:46.401590 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.398433 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:46.406713 10399 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:46.408941 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:46.336958 12717 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.386010 12722 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.389148 12678 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.415257 10241 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:46.418267 12543 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.420707 12686 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:46.376070 12712 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.339881 12707 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.399952 12503 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:46.426895 12503 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:46.426486 12686 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.408054 12677 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:46.435151 12686 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.435873 12677 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:46.436388 12677 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:46.436864 12677 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:46.437269 12509 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.409273 12325 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:46.448361 12707 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:46.439652 12669 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.454638 12669 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.463888 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.464610 10394 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:46.459679 12507 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:46.472349 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:46.464644 10397 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:46.478197 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.477991 12507 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.479529 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.502620 10394 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:46.438725 12710 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:46.440761 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 139663us
I20260709 13:15:46.444708 12719 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.475907 12433 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.510886 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.494547 12723 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.513125 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:46.494980 12616 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.499788 12717 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:46.535418 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.502357 12507 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:46.515928 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 159598us
W20260709 13:15:46.517421 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.542271 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.518929 12525 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:46.513473 12633 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:46.545847 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 137006us
I20260709 13:15:46.547036 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:46.512609 12237 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.542989 10394 raft_consensus.cc:2376] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:15:46.514199 12723 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.550289 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:46.553272 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:46.554304 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:46.555442 12723 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.575357 12543 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.575958 12543 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.579002 12702 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:46.579995 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.580624 10247 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:46.581460 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.582837 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:46.585754 12650 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.578022 12543 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.590075 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:46.590354 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:46.590794 10320 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:15:46.592077 12712 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:46.515057 12433 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.590823 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:46.555335 12705 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:46.597894 10397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1892) took 2695 ms (client timeout 1823 ms). Trace:
I20260709 13:15:46.598472 12433 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:46.598398 10397 rpcz_store.cc:269] 0709 13:15:43.902117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.903022 (+   905us) service_pool.cc:224] Handling call
0709 13:15:46.597698 (+2694676us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54002ddf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:46.597793 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5291235200}
I20260709 13:15:46.599290 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.600051 12705 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:46.600592 12705 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.602684 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.602458 12678 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.603600 12705 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.544274 12616 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.572587 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.581638 12503 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.605161 10247 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:46.624015 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.624384 10399 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:46.623625 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:46.607409 12722 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.590947 10321 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:46.619643 10397 raft_consensus.cc:2376] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4. Re-sending same reply.
I20260709 13:15:46.600061 10394 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:46.620723 12624 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:46.605630 12669 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.624645 10247 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:46.720345 12677 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:46.555523 12237 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.699671 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.975940 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.703697 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.981441 10244 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:46.981904 12624 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:46.982656 12624 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.982710 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:46.986332 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.986984 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:46.628613 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.988176 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.735975 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:46.988917 10249 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:46.989758 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.991129 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.992303 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:46.700385 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.996559 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:46.974085 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.996789 12711 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:46.920004 12434 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.728188 12576 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:46.997900 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.998272 12576 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:46.999233 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:46.999480 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 242972us
I20260709 13:15:46.999287 12576 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:46.972677 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.695322 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.000694 10247 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:47.001322 10994 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:15:47.001809 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 601) took 2104 ms (client timeout 2070 ms). Trace:
W20260709 13:15:47.002225 10994 rpcz_store.cc:269] 0709 13:15:44.897551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.912692 (+ 15141us) service_pool.cc:224] Handling call
0709 13:15:46.695060 (+1782368us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:47.001703 (+306643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4786048}
I20260709 13:15:46.974102 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.549556 12717 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:47.004026 12717 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.005450 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.006392 10246 raft_consensus.cc:2410] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:47.006680 12717 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.547763 12610 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:47.006877 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:46.976851 12237 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.919024 12609 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.008188 12609 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.009748 12434 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.010947 10392 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:46.735118 12679 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:47.012633 12609 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:46.989828 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:47.014405 12434 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:47.014689 10249 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.702507 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:46.979121 12677 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.977897 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:46.993928 12543 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:47.018043 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.018364 12543 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.018922 10241 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:47.020192 10241 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:47.020510 12543 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.020916 12719 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:47.021268 10241 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:46.608747 12718 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.994374 12722 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:46.622280 12686 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:47.007602 12576 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.022121 10399 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:46.996789 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:47.024121 10394 raft_consensus.cc:2410] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:47.024899 10246 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:47.025269 10246 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:47.008592 10397 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:47.027626 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:47.028698 12609 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.987039 10393 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.013101 12679 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.029170 12609 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.031140 12679 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:47.031776 12679 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.032100 12679 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.032445 12679 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.033077 12609 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:47.038651 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:47.039865 10994 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:47.042030 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.043294 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.044102 10398 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:47.044258 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:47.044581 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.045212 12609 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:47.045591 12609 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.046012 12609 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.046578 10998 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:47.048040 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 431) took 1311 ms. Trace:
I20260709 13:15:47.048422 10395 rpcz_store.cc:276] 0709 13:15:45.736644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.736802 (+   158us) service_pool.cc:224] Handling call
0709 13:15:45.746897 (+ 10095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.805435 (+ 58538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.047798 (+1242363us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b54000f32d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:47.047954 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130613120}
I20260709 13:15:47.049090 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.049795 11001 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:15:47.051702 12731 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:46.627326 12376 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:46.992509 10244 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:47.003290 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:47.057627 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 509706us
I20260709 13:15:47.031101 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.058079 10391 raft_consensus.cc:1813] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Handling vote request from an unknown peer cb71def93f904f619a1527aa48a32294
W20260709 13:15:47.055959 10996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 663) took 1342 ms (client timeout 1541 ms). Trace:
I20260709 13:15:47.058547 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.053577 12731 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:46.781466 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.062074 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:46.552572 12525 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:47.067305 10391 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:47.066201 12718 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.067488 12713 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:47.067994 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:47.059338 12678 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:47.068904 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:47.069032 12731 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:47.069432 12617 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:47.069980 12616 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:47.071656 10993 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:47.111804 10322 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:47.103322 10364 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:47.113384 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2061) took 1097 ms. Trace:
I20260709 13:15:47.114459 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:47.057452 12376 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.072911 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:47.074373 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.075273 10399 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:47.075886 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:47.077258 10249 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:47.121425 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.122212 10321 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:47.122368 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:47.124094 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.125470 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:47.058774 10996 rpcz_store.cc:269] 0709 13:15:45.713316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.713543 (+   227us) service_pool.cc:224] Handling call
0709 13:15:47.055771 (+1342228us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b540034dd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:47.055894 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163273600}
I20260709 13:15:47.113783 10250 rpcz_store.cc:276] 0709 13:15:46.002168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.002332 (+   164us) service_pool.cc:224] Handling call
0709 13:15:47.099746 (+1097414us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b540009d654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:47.099865 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71212416}
I20260709 13:15:47.081959 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:47.120684 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.084620 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.086366 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.127703 11001 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:47.111821 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:47.086524 12503 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.130545 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:47.130977 12718 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.131362 10322 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:47.132881 12376 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.120194 10316 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:47.120661 12675 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:47.134673 12675 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.135100 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.049096 12624 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.136200 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.137424 12624 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.130869 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.087064 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.138902 10996 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:47.139236 11000 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:47.099781 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:47.100350 10245 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:47.102018 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:47.142656 10397 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:47.102375 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.141202 10249 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:47.103545 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.147473 10241 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:47.147539 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.104765 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 1990) took 1222 ms. Trace:
I20260709 13:15:47.113262 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.148945 10247 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:47.116637 10967 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:47.095602 10393 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:47.148712 10319 rpcz_store.cc:276] 0709 13:15:45.882089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.882286 (+   197us) service_pool.cc:224] Handling call
0709 13:15:46.296034 (+413748us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:47.104600 (+808566us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b540021e3d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:47.104706 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983192320}
I20260709 13:15:47.149829 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1378) took 1177 ms. Trace:
W20260709 13:15:47.079619 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48597.6us
I20260709 13:15:47.151028 10323 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:47.129850 12737 raft_consensus.cc:2764] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:15:47.143625 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.144150 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.102648 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:47.160247 10248 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.160938 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:47.135306 10244 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:47.147816 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:47.025977 10246 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.162535 10246 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:47.162827 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59581.7us
I20260709 13:15:47.163125 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 1991) took 1280 ms. Trace:
I20260709 13:15:47.148945 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.163597 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:47.163805 10243 raft_consensus.cc:1813] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Handling vote request from an unknown peer cb71def93f904f619a1527aa48a32294
W20260709 13:15:47.164261 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50600.9us
I20260709 13:15:47.164710 10243 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:47.150220 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2001) took 1264 ms. Trace:
I20260709 13:15:47.165253 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:47.163520 10325 rpcz_store.cc:276] 0709 13:15:45.882483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.882623 (+   140us) service_pool.cc:224] Handling call
0709 13:15:46.729304 (+846681us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:47.112940 (+383636us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3e9c 00007f58c09c3a5b 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:47.113113 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.113273 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.113298 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:47.162830 (+ 49532us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:47.162889 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.162964 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.163072 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205188352}
I20260709 13:15:47.164141 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:47.151678 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1957) took 1179 ms. Trace:
I20260709 13:15:47.171475 10323 rpcz_store.cc:276] 0709 13:15:45.972722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.040661 (+1067939us) service_pool.cc:224] Handling call
0709 13:15:47.150647 (+109986us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:47.150832 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.151448 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.151625 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74966784}
I20260709 13:15:47.101459 12507 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.183176 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.120507 12722 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:47.159154 12723 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.000s
W20260709 13:15:47.155627 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 50860.8us
I20260709 13:15:47.135023 12675 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.189390 10247 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:47.156380 12612 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:47.156967 10245 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:47.134940 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.191274 10316 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:47.165318 10318 rpcz_store.cc:276] 0709 13:15:45.886203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.102076 (+215873us) service_pool.cc:224] Handling call
0709 13:15:46.984881 (+882805us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:47.117457 (+132576us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3e9c 00007f58c09c3a5b 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:15:47.117633 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.117807 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.117832 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:47.149953 (+ 32121us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:47.150008 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.150065 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.150168 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224969984}
I20260709 13:15:47.191771 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.150199 10393 rpcz_store.cc:276] 0709 13:15:45.972295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.986031 (+1013736us) service_pool.cc:224] Handling call
0709 13:15:47.149773 (+163742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:47.170135 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.193089 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:47.183965 10241 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:47.185642 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.188257 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.194422 10321 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:47.146219 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:47.196761 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.197501 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.198698 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:47.188326 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 76563.2us
I20260709 13:15:47.199512 10321 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:47.167137 12705 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:47.198150 10317 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:47.204160 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.205590 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:47.200062 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.195073 12612 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:47.206933 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.207702 10325 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:47.208599 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:47.209518 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.204592 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.200701 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.101643 12237 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:15:47.118899 12575 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:15:47.207929 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:47.183128 12507 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.208628 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:47.257863 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:47.167351 12494 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.019s	sys 0.047s
I20260709 13:15:47.191154 12617 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:47.186729 12713 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:15:47.211292 10317 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.158399 12677 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:15:47.158210 12717 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:15:47.303280 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:47.306768 10316 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:47.264477 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 60002.8us
I20260709 13:15:47.211834 12616 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.223536 10245 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:47.184192 12543 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:47.257345 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.187692 12624 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:47.182797 12707 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:47.211313 10321 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:47.350772 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.211490 12612 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:47.351482 10241 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:47.220609 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:47.291957 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 134543us
I20260709 13:15:47.309126 10322 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 3: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:47.307554 10246 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:15:47.211773 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.311800 10319 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:47.323148 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:47.257651 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 55577.9us
I20260709 13:15:47.327283 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.327855 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.202522 12705 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.341298 10317 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:47.206962 12496 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:47.257022 12686 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.308367 12507 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.314755 10998 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:15:47.308457 12494 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.019s	sys 0.047s
I20260709 13:15:47.267525 12722 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:47.342919 10325 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:47.320964 12617 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:47.358768 10146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 308) took 12702 ms (client timeout 15000 ms). Trace:
I20260709 13:15:47.455201 10243 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:47.291563 12711 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:47.289608 12525 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 13:15:47.451742 10318 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:47.453325 10246 pending_rounds.cc:85] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:15:47.270614 12700 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 13:15:47.212183 12610 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.242s
I20260709 13:15:47.197064 12723 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.459358 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:47.338615 12616 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:47.463335 10145 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 4 to 6, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 6 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.476145 10246 pending_rounds.cc:107] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:15:47.455451 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:47.461330 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 138304us
I20260709 13:15:47.487023 10246 raft_consensus.cc:2889] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:47.487957 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.487938 10145 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 3, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.489233 10288 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.350421 12707 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:47.493355 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 285502us
I20260709 13:15:47.490095 10145 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:15:47.462962 12741 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:15:47.454311 12705 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:47.454839 10146 rpcz_store.cc:269] 0709 13:15:34.656154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.661276 (+  5122us) service_pool.cc:224] Handling call
0709 13:15:47.358672 (+12697396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:43.887409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:43.888118 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:43.888172 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:15:43.888190 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:43.900488 (+ 12298us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:43.900570 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:43.900599 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:15:43.901804 (+  1205us) tablet.cc:701] Row locks acquired
0709 13:15:43.901852 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:15:43.902025 (+   173us) write_op.cc:270] Start()
0709 13:15:43.902187 (+   162us) write_op.cc:276] Timestamp: P: 1783602943901959 usec, L: 0
0709 13:15:43.902210 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:43.990146 (+ 87936us) log.cc:844] Serialized 4853 byte log entry
0709 13:15:44.887583 (+897437us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae3e28 00007f58c751e581 00007f58c751dd58 00007f58c75229f1 00007f58c75229a9 00007f58c7522939 00007f58c7522901 00007f58c7521b2d 000000000038f354 000000000038f199
0709 13:15:45.729050 (+841467us) op_driver.cc:464] REPLICATION: finished
0709 13:15:46.161036 (+431986us) write_op.cc:301] APPLY: starting
0709 13:15:46.171543 (+ 10507us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:46.215655 (+ 44112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:46.215717 (+    62us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:46.217680 (+  1963us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:46.218131 (+   451us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:15:46.218204 (+    73us) write_op.cc:312] APPLY: finished
0709 13:15:46.356944 (+138740us) log.cc:844] Serialized 89 byte log entry
0709 13:15:46.536787 (+179843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:46.546536 (+  9749us) write_op.cc:454] Released schema lock
0709 13:15:46.610513 (+ 63977us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:46.762746 (+152233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:46.762776 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15721,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":366888,"apply.run_cpu_time_us":33653,"apply.run_wall_time_us":533973,"num_ops":12,"prepare.queue_time_us":280854,"prepare.run_cpu_time_us":70618,"prepare.run_wall_time_us":1022776,"raft.queue_time_us":883639,"raft.run_cpu_time_us":3453,"raft.run_wall_time_us":128358,"replication_time_us":1826652,"spinlock_wait_cycles":7973120,"thread_start_us":799757,"threads_started":5,"wal-append.queue_time_us":643669,"wal-append.run_cpu_time_us":14737,"wal-append.run_wall_time_us":1686988}]]}
I20260709 13:15:47.503532 10145 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 4, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:47.475971 12617 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.460327 12544 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.463156 12575 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.507632 10145 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.510814 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.512450 12039 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:47.513480 12039 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.460593 12719 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.523991 10145 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.487818 12616 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.462421 12376 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:47.505198 12707 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.463670 12576 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:15:47.347332 12633 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.352391 12434 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:47.531271 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 341230us
I20260709 13:15:47.544378 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:47.510798 12722 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.533031 12677 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.510114 12686 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:47.525852 10145 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 5, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.547683 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 435) took 1786 ms. Trace:
W20260709 13:15:47.529897 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 309381us
I20260709 13:15:47.557644 12039 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:47.573599 10145 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.572916 10390 rpcz_store.cc:276] 0709 13:15:45.761285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.761521 (+   236us) service_pool.cc:224] Handling call
0709 13:15:45.761812 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:46.072497 (+310685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.072545 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.001456 (+928911us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b2c00108708. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c23e1a11 00007f58c23f1372 00007f58c3b23a01 00007f58c3ae843a 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2
0709 13:15:47.001853 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.100474 (+ 98621us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:47.100540 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.100634 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:47.541348 (+440714us) raft_consensus.cc:1685] finished
0709 13:15:47.541378 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:47.547591 (+  6213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3325,"raft.queue_time_us":36774,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":2465,"spinlock_wait_cycles":63874432,"thread_start_us":400868,"threads_started":2,"wal-append.queue_time_us":155989}
I20260709 13:15:47.523458 12544 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:47.587635 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.529898 12719 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.534822 12713 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:15:47.577873 10145 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 3 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.566802 12722 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.577466 12686 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.571441 12677 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.612619 10145 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 5, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.609525 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 150687us
I20260709 13:15:47.541188 12633 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:47.626742 10213 connection.cc:256] RPC call timeout handler was delayed by -1.6111720240000977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:15:47.627592 10213 leader_election.cc:336] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.568s (SENT)
I20260709 13:15:47.627753 10248 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:47.628095 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:47.610944 12543 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:47.629526 10322 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
W20260709 13:15:47.633774 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.665481 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 43913.2us
I20260709 13:15:47.666837 12717 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:47.667578 12717 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:47.667923 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.621721 12677 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:47.753608 12609 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.707s	user 0.006s	sys 0.002s
I20260709 13:15:47.980873 12609 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:47.887905 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.971910 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 469278us
I20260709 13:15:47.697016 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:47.982079 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 437794us
I20260709 13:15:47.747566 10316 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:15:47.979676 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 490470us
W20260709 13:15:47.984534 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 287573us
I20260709 13:15:47.986557 10364 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:47.667840 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5292720240001927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:15:47.987145 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5292720240001927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:15:47.987589 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4095720239999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:15:47.987895 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4059316270002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:15:47.988174 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4059316270002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:15:47.974555 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 478978us
I20260709 13:15:47.988854 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.729734 10323 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:47.669548 12039 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:47.975787 10290 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:47.989732 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:48.028219 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 52525.6us
I20260709 13:15:48.029517 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:48.028362 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:15:47.695163 12746 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:15:48.033344 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47827.5us
I20260709 13:15:48.031507 12758 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.703570 12633 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.811800 12737 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:47.832360 12755 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.788203 12700 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:47.777272 12723 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.033138 12760 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:47.825690 12675 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.000s
W20260709 13:15:47.727945 12679 consensus_meta.cc:287] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.001s
W20260709 13:15:47.747167 12752 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:15:47.699065 12748 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:15:47.758152 12731 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.000s
I20260709 13:15:47.707603 12719 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.698698 12544 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:47.778542 12481 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:47.839808 12624 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:48.028724 12751 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:47.696154 12610 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:48.078527 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.812896 12616 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.668111 12717 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.085072 12755 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.698462 12713 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.344s
I20260709 13:15:48.084007 12700 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:47.864624 12705 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.033154 12525 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:48.086589 12750 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:48.035476 12759 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:48.033154 12757 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:48.096127 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2862720240000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 13:15:48.032881 12686 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.986557 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:48.084538 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 1971) took 1046 ms. Trace:
I20260709 13:15:47.888599 12434 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:48.038304 12039 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:48.121239 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 134763us
I20260709 13:15:48.047148 10967 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:48.120679 12610 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:48.121410 10323 rpcz_store.cc:276] 0709 13:15:47.037787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.302924 (+265137us) service_pool.cc:224] Handling call
0709 13:15:48.084444 (+781520us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:48.121011 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 89590.2us
I20260709 13:15:47.946856 12617 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:47.689160 12543 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:48.121140 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 132368us
W20260709 13:15:48.133001 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.118928 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2154844030001186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:15:48.119460 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1396) took 1054 ms. Trace:
W20260709 13:15:48.135519 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1848844030000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260709 13:15:48.135936 10213 connection.cc:256] RPC call timeout handler was delayed by -1.16688440300004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:15:48.136446 10213 connection.cc:256] RPC call timeout handler was delayed by -1.166572024000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:15:48.136878 10213 connection.cc:256] RPC call timeout handler was delayed by -1.166572024000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 13:15:48.137153 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1330398160000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:15:48.137421 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1330398160000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:15:48.137684 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0921844030001466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:15:48.119999 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 85428.3us
I20260709 13:15:48.138901 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.127686 10290 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:47.954445 12507 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.871302 12707 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:47.855217 12722 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.128789 12039 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.140800 10320 raft_consensus.cc:2368] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:15:48.142016 10390 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:48.160048 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:47.806993 12612 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.120870 12759 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.151321 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.154785 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.119141 12525 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.135603 10391 rpcz_store.cc:276] 0709 13:15:47.064627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.079216 (+ 14589us) service_pool.cc:224] Handling call
0709 13:15:47.101153 (+ 21937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.101548 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.101576 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.118619 (+ 17043us) log.cc:844] Serialized 26 byte log entry
0709 13:15:47.356037 (+237418us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:47.357562 (+  1525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.357972 (+   410us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.119241 (+761269us) raft_consensus.cc:1685] finished
0709 13:15:48.119264 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.119401 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57048,"raft.queue_time_us":110,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":19160,"thread_start_us":204659,"threads_started":1,"wal-append.queue_time_us":396051}
I20260709 13:15:48.120826 12750 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.150514 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.196686 10398 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:48.160989 10242 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 2.
I20260709 13:15:48.198663 11002 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:48.195847 12525 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.198204 12750 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.097078 12675 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.207034 10394 raft_consensus.cc:2368] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7.
I20260709 13:15:48.208500 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1393) took 1144 ms. Trace:
I20260709 13:15:48.173465 12759 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.208897 10394 rpcz_store.cc:276] 0709 13:15:47.063946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.064048 (+   102us) service_pool.cc:224] Handling call
0709 13:15:48.208275 (+1144227us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001347d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:48.208434 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449150336}
I20260709 13:15:48.114123 12679 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.167367 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:48.216872 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49557.8us
I20260709 13:15:48.170683 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 1972) took 1132 ms. Trace:
W20260709 13:15:48.166450 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 119378us
W20260709 13:15:48.172698 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 45093.3us
I20260709 13:15:48.171233 10317 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:48.178939 10244 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:48.218993 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:48.126791 12719 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:48.183307 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.191879 12723 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.192394 12756 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.194489 12507 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.212950 10243 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:48.218954 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:15:48.171350 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 137276us
I20260709 13:15:48.220155 10245 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.190744 12763 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:48.234548 12763 consensus_queue.cc:1243] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:48.158026 12758 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:48.236500 12758 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.239423 12758 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.218217 10320 rpcz_store.cc:276] 0709 13:15:47.038038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.149486 (+111448us) service_pool.cc:224] Handling call
0709 13:15:48.170468 (+1020982us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54002bd754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:48.170625 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212729600}
I20260709 13:15:48.217797 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:48.244618 12764 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:48.245210 12764 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.245671 12764 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:48.120668 12731 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.252530 12731 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.122140 12624 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.255266 12624 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.228929 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 1975) took 1123 ms. Trace:
I20260709 13:15:48.255964 10317 rpcz_store.cc:276] 0709 13:15:47.105251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.472197 (+366946us) service_pool.cc:224] Handling call
0709 13:15:48.171060 (+698863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.218936 (+ 47876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.228704 (+  9768us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54002bd750. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:48.228864 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606271232}
I20260709 13:15:48.275805 12376 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:48.276382 12376 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:48.276867 12376 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:48.278795 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59913.2us
I20260709 13:15:48.288045 10967 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:48.305295 12763 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:48.306059 12763 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:48.306941 12763 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.314972 10967 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:48.195922 12766 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:48.360143 12617 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:48.226763 12494 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:48.362524 12494 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.363106 12494 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.145519 12768 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:15:48.322888 12616 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:48.323786 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 104850us
I20260709 13:15:48.334117 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:48.375000 10290 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:48.324363 12039 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:48.096441 12737 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.390712 12774 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:48.391158 12774 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:48.392105 12737 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.332176 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:48.392032 12774 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.393230 10323 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.395376 12507 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:48.395869 12507 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.396245 12507 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.332504 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:48.398942 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 260718us
I20260709 13:15:48.333612 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:48.399646 10318 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.333884 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:48.338446 12679 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.338933 10324 pending_rounds.cc:85] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 4
I20260709 13:15:48.401504 10324 pending_rounds.cc:107] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:15:48.401824 10324 raft_consensus.cc:2889] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:48.339078 12624 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:48.339789 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:48.220798 12609 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:48.340752 12756 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:48.211972 12612 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.346572 12481 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:48.348666 12677 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.351130 12707 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.353005 12755 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.368942 12757 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:48.398514 12770 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:48.212661 12610 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.389977 12777 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.332176 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet 7df30c54c90e4fcfaeb14736ccbcec7c with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34158
I20260709 13:15:48.400504 10325 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.365371 12750 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.432235 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.432924 10244 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.402081 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:48.318022 12723 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.393949 12774 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.404295 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.405247 10323 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:48.437812 10248 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:15:48.389998 12717 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.438753 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.368253 12751 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:48.354020 10245 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:48.440047 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:48.401850 12719 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:48.441537 12481 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.441601 12719 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.442268 12719 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.442137 12481 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.442515 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:48.445022 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:48.419729 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.446509 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:48.447751 10996 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:48.420711 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:48.421435 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.426041 12755 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:48.449743 10392 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.451033 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.426448 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:48.453624 10391 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:48.434782 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.436587 10318 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:15:48.444352 12481 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.420305 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.451602 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:48.470100 10398 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.401309 10317 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:48.412890 12713 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.457428 12039 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:48.461099 10394 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:48.460706 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.449729 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:48.416072 12757 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.478771 10244 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:15:48.479877 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49980.4us
I20260709 13:15:48.483610 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.222604 12700 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.408320 12624 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.414726 12633 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:15:48.481071 12717 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:48.502614 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:48.494436 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44801.2us
I20260709 13:15:48.460861 12737 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:48.495352 10398 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:48.496155 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:48.496608 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 78909.7us
I20260709 13:15:48.496977 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:48.451355 12770 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.485899 12773 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.480868 12731 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:48.480508 12772 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:48.504405 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:48.436098 12679 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.508986 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:48.495759 12705 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.486423 12757 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.493580 12434 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:48.509640 10288 leader_election.cc:400] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7.
I20260709 13:15:48.532848 10288 leader_election.cc:403] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.500908 12758 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:48.499703 12753 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:15:48.526731 10364 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.497849 12481 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:48.520188 10391 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:48.436331 12777 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.535188 12675 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:48.488623 12713 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.565013 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.565886 10244 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.518738 12756 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.518594 10995 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:48.490124 12617 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:48.526155 12737 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:48.516331 12686 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.516381 12773 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:48.500065 12764 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.532585 12775 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:48.563361 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46398.8us
I20260709 13:15:48.532730 12434 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.530683 12788 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:48.557559 12609 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:15:48.557821 12722 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.622501 10395 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:48.597759 12758 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.596738 10244 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:48.582086 12790 tablet_replica.cc:333] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:15:48.539558 12376 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:48.635275 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 320387us
I20260709 13:15:48.636600 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:48.574429 12675 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:48.573668 12525 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.540161 12679 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:48.634656 12741 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:48.630541 12775 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.634688 12434 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.634840 12783 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:48.673187 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.681532 12576 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:48.681749 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 184830us
I20260709 13:15:48.570940 12751 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.689782 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.690987 10325 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:48.659355 12677 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.654997 12507 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.680627 12775 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.691340 12777 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:48.725471 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 69631.5us
I20260709 13:15:48.697922 12750 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.703029 12722 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:48.716622 12783 raft_consensus.cc:2764] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 13:15:48.731716 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 80032us
I20260709 13:15:48.742678 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:48.738947 10999 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:48.738551 10392 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:48.716856 12633 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.751543 12722 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.767350 12633 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.768793 12770 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.702390 12773 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.769595 12633 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:48.769526 12759 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
I20260709 13:15:48.770931 12759 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.740077 12624 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.683995 12737 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.719930 12576 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:48.722994 12723 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.735526 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:48.770335 12764 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:48.771225 12713 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:48.744447 12786 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:15:48.796727 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 288596us
W20260709 13:15:48.745306 12779 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:15:48.785693 10967 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:48.785744 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50308us
W20260709 13:15:48.792793 12801 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:15:48.730760 12677 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:48.770160 12773 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.796983 12795 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:48.797195 12624 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.769543 12722 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.721536 12717 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:48.798493 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:48.959242 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.907539 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.912622 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:48.985847 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 187624us
I20260709 13:15:48.912124 10398 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:15:48.931622 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 529569us
I20260709 13:15:48.959265 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:48.911299 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:48.849838 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 64248.4us
W20260709 13:15:48.908154 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 107247us
I20260709 13:15:48.910811 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.960429 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:48.990921 11000 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:48.901314 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:48.801810 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.992659 10395 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:48.802106 10393 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:48.994836 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:48.995572 10242 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
W20260709 13:15:48.995893 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.994691 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.960032 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:48.996515 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:48.913089 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:48.794970 12481 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:49.000859 10399 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:48.988667 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:48.987675 10397 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:15:48.991403 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.004165 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:49.004861 10996 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.009305 10999 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:49.308995 10213 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.020s	sys 0.018s
W20260709 13:15:49.550380 10213 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.026s	sys 0.027s
I20260709 13:15:49.016301 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:49.550915 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 823406us
I20260709 13:15:49.552769 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.321736 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:49.553546 10213 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.548s (SENT)
I20260709 13:15:49.058306 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:49.366124 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.797174 12766 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:48.812902 12796 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:15:49.554790 10213 leader_election.cc:336] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.651s (SENT)
I20260709 13:15:49.026043 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.560881 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.027009 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:15:49.561667 10213 leader_election.cc:336] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.715s (SENT)
I20260709 13:15:49.561513 10398 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.807027 12525 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:49.292158 10996 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:15:49.555464 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 497271us
I20260709 13:15:49.606320 10398 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:15:49.103363 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:49.636667 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:49.637020 10241 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:49.637295 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:49.023665 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:48.878340 12494 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.003s
I20260709 13:15:49.323536 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.846516 12759 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.863353 12612 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:48.904471 12788 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:49.174710 12794 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:48.890195 12760 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:48.802619 12376 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:49.173005 12806 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:49.561851 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 534887us
I20260709 13:15:49.562129 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:48.905546 12675 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:48.799724 12803 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.848245 12758 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7.
I20260709 13:15:48.898923 12765 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:49.729027 12765 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:49.258407 12756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.021s
I20260709 13:15:48.907653 12781 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.964663 12764 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.906111 12686 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.844694 12775 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.890319 12679 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:48.837116 12237 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:48.881109 12700 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.551633 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:48.849534 12507 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:49.012882 12755 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:49.705163 12794 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.750962 12755 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.751410 12755 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.753484 12794 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:48.958815 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:49.553915 10249 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.637892 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:49.638266 10247 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.638386 10398 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:49.763015 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.764174 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:49.092990 12731 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:49.764905 12731 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.765290 12731 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.767356 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 628) took 1631 ms. Trace:
I20260709 13:15:49.767778 10998 rpcz_store.cc:276] 0709 13:15:48.135534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.160175 (+ 24641us) service_pool.cc:224] Handling call
0709 13:15:48.367304 (+207129us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:48.516731 (+149427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.518935 (+  2204us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:48.557484 (+ 38549us) log.cc:844] Serialized 52 byte log entry
0709 13:15:49.103214 (+545730us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.119902 (+ 16688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.766915 (+647013us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001b8354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:49.766974 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.767028 (+    54us) raft_consensus.cc:1685] finished
0709 13:15:49.767043 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.767289 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":882,"raft.run_cpu_time_us":1108,"raft.run_wall_time_us":22863,"spinlock_wait_cycles":269585280,"thread_start_us":346938,"threads_started":1,"wal-append.queue_time_us":297798}
I20260709 13:15:48.958329 12772 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:49.578349 10994 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:48.892302 12610 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.533694 12677 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:48.914829 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:49.772215 10391 raft_consensus.cc:606] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
W20260709 13:15:49.737130 12756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.004s	sys 0.034s
I20260709 13:15:48.905215 12609 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:49.140540 12481 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:49.170325 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:48.892341 12757 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:49.665067 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:49.694482 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:49.674034 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:48.809118 12763 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.659240 10395 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:49.730259 12765 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:49.706729 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.034s
W20260709 13:15:49.797436 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.009s	sys 0.034s
W20260709 13:15:49.708834 10965 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.948s (SENT) [suppressed 21 similar messages]
W20260709 13:15:49.701057 12737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.073s	sys 0.048s
I20260709 13:15:49.562822 12810 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:49.091346 12705 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.652s
I20260709 13:15:49.012965 12624 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:48.840605 12719 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.173250 12808 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.612s
I20260709 13:15:49.815053 12808 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:49.815585 12808 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:49.818667 11002 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:49.642397 12544 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:49.800949 12737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.073s	sys 0.048s
I20260709 13:15:49.724046 12806 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:48.847714 12576 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.699249 12760 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:49.726366 12799 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.019s
I20260709 13:15:49.727985 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.731918 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:49.732443 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 170779us
W20260709 13:15:49.842060 10213 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.939s (SENT)
I20260709 13:15:49.842540 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:49.579001 12795 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:49.312227 12717 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.735189 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:49.703012 12525 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.846127 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:49.715902 12811 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:49.746295 12788 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:49.740098 12237 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:49.810352 12775 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:49.794210 12481 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:48.907884 12616 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:49.716568 12612 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:49.898715 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56675.9us
W20260709 13:15:49.899516 10213 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.970s (SENT)
I20260709 13:15:49.788805 10249 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:15:48.844694 12434 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.791438 10245 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:49.792893 10323 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.900223 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:49.772866 12758 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:49.795398 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:49.903673 10395 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:49.906414 10317 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.770282 12764 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.912587 12764 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:49.790107 10247 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:49.805173 10390 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:49.784731 12609 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:49.915096 12609 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:49.916775 12609 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:49.808578 12773 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.000s
I20260709 13:15:49.808848 12763 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:49.771601 12686 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.921310 12686 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:49.722856 12675 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.743618 12781 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.823773 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 632) took 1409 ms. Trace:
I20260709 13:15:49.838918 10325 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:49.820942 12765 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.819710 12719 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:49.734794 10362 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.023s	sys 0.065s
I20260709 13:15:49.744717 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:49.922188 10398 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:49.935336 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1924) took 1025 ms. Trace:
I20260709 13:15:49.935895 10399 rpcz_store.cc:276] 0709 13:15:48.910037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.092203 (+182166us) service_pool.cc:224] Handling call
0709 13:15:49.744505 (+652302us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:49.935253 (+190748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15873408}
I20260709 13:15:49.848043 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:15:49.849054 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.791432 12677 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.938458 10241 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:49.938609 10390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1409) took 1518 ms (client timeout 1628 ms). Trace:
W20260709 13:15:49.939088 10390 rpcz_store.cc:269] 0709 13:15:48.420522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.421252 (+   730us) service_pool.cc:224] Handling call
0709 13:15:49.938443 (+1517191us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002dda54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:49.938558 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116301056}
I20260709 13:15:49.940542 12677 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:49.941172 10242 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:49.823638 10967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.016s	sys 0.020s
W20260709 13:15:49.942404 10967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.016s	sys 0.023s
I20260709 13:15:49.944026 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:49.944254 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:49.944669 10998 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:49.823812 10244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.021s	sys 0.015s
W20260709 13:15:49.945887 10244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.023s	sys 0.015s
I20260709 13:15:49.946545 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:49.946828 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:49.947659 10994 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:49.947978 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:49.934633 10362 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.023s	sys 0.065s
I20260709 13:15:49.650875 12494 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:49.949450 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 960702us
I20260709 13:15:49.950687 10248 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:49.899927 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:49.945700 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:49.952497 11000 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.772761 10391 raft_consensus.cc:614] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:49.838331 12756 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:49.953955 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:49.954622 10249 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.952172 10396 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:49.844219 12795 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.958091 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:49.950971 10362 leader_election.cc:336] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.786s (SENT)
W20260709 13:15:49.959272 10362 leader_election.cc:336] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.786s (SENT)
I20260709 13:15:49.947986 10242 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:49.928398 11002 rpcz_store.cc:276] 0709 13:15:48.413942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.414079 (+   137us) service_pool.cc:224] Handling call
0709 13:15:48.434765 (+ 20686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.819137 (+1384372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.823523 (+  4386us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540028f0d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:49.823710 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3182180096}
I20260709 13:15:49.852869 12737 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:49.836567 12544 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.960796 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40532 (request call id 29) took 1047 ms. Trace:
I20260709 13:15:49.962610 10391 rpcz_store.cc:276] 0709 13:15:48.906453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.914644 (+  8191us) service_pool.cc:224] Handling call
0709 13:15:49.953641 (+1038997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.963796 10245 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:49.959612 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:49.954105 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:49.964774 10243 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
I20260709 13:15:49.971587 10999 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:49.948740 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:49.928170 12781 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:49.960615 12795 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.971206 12794 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.031921 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:49.846201 12772 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:49.891903 12525 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.026417 10993 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:50.076838 12612 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.083668 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:50.084354 10242 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:50.085889 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.087936 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:50.006769 12811 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:49.985991 12719 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:50.010479 12790 raft_consensus.cc:2243] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:49.980343 12775 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:50.113137 12810 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:50.113449 12705 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.980648 12756 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.076269 12794 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:50.119349 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 219849us
W20260709 13:15:50.122973 10213 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.064s (SENT)
W20260709 13:15:50.123922 10213 leader_election.cc:336] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.076s (SENT)
I20260709 13:15:50.124508 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:50.127338 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.127866 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.128382 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.129801 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 1.10615e+06us
I20260709 13:15:50.131228 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.132443 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:50.119976 10241 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:49.970834 12616 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.122108 10392 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:50.083325 12781 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:50.074647 12751 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:50.119745 10394 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:50.135174 10391 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:50.135815 10247 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:50.136420 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:50.142735 10249 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:50.010929 12237 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:50.106710 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 397886us
I20260709 13:15:50.171137 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.132932 10317 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:50.134171 12750 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:50.174029 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 214763us
W20260709 13:15:50.133530 12814 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:15:50.185695 11000 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:15:50.164671 10213 leader_election.cc:336] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.098s (SENT)
I20260709 13:15:50.140874 10323 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:15:50.152644 12794 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:50.177054 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 89582.1us
I20260709 13:15:49.986135 12760 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.027060 12806 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.148412 12821 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.108336 12811 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.115396 12719 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.199736 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:50.188166 12376 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:50.217175 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 637) took 1125 ms. Trace:
W20260709 13:15:50.204334 10213 leader_election.cc:336] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.103s (SENT)
I20260709 13:15:50.170214 12624 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:50.201996 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:50.180409 12790 raft_consensus.cc:2272] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:50.209059 10362 connection.cc:256] RPC call timeout handler was delayed by -1.147649877999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
W20260709 13:15:50.248142 10362 connection.cc:256] RPC call timeout handler was delayed by -1.1471326239998234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:15:50.200371 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:50.221277 10390 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 3: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:50.123203 12705 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.222862 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:50.259404 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 55113.2us
W20260709 13:15:50.260094 10213 leader_election.cc:336] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.121s (SENT)
I20260709 13:15:50.260527 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:50.190599 12826 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:50.220170 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:50.251063 12835 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:50.262547 12624 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.262698 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:50.206147 12237 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:50.224488 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 192641us
I20260709 13:15:50.180008 12825 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:50.187376 12823 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:50.234648 10391 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:50.250062 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49774.4us
W20260709 13:15:50.274799 10392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1923) took 1365 ms (client timeout 1632 ms). Trace:
I20260709 13:15:50.223320 11001 rpcz_store.cc:276] 0709 13:15:49.091748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.119084 (+ 27336us) service_pool.cc:224] Handling call
0709 13:15:49.140316 (+ 21232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.140597 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:49.838692 (+698095us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.216807 (+378115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.216874 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:50.216919 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.216988 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.217114 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":829861,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2820,"raft.queue_time_us":25597,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":18551,"thread_start_us":651169,"threads_started":3,"wal-append.queue_time_us":371404}
I20260709 13:15:50.211218 12758 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:50.223965 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 91590us
I20260709 13:15:50.208617 12828 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:50.207196 12763 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.164323 12751 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.187011 12818 consensus_queue.cc:1059] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:50.178785 12781 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.280436 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:50.194181 12750 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:50.262080 12826 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:50.275413 10392 rpcz_store.cc:269] 0709 13:15:48.909736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.991042 (+ 81306us) service_pool.cc:224] Handling call
0709 13:15:50.274560 (+1283518us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540045b854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:50.274717 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176509312}
I20260709 13:15:50.272758 12757 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:50.266075 12376 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:50.317808 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 181455us
I20260709 13:15:50.319118 12790 ts_tablet_manager.cc:1916] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:50.293097 12758 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:50.268747 12821 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.320318 12821 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.267012 12494 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:50.322296 12781 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.294018 12828 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:50.271637 12759 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:50.281548 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:50.271970 12713 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:50.296945 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:50.328248 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 46806.3us
I20260709 13:15:50.279925 12823 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.264490 12775 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:50.261178 12794 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:50.330392 10967 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:50.338739 10213 connection.cc:256] RPC call timeout handler was delayed by -1.28226959299991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:15:50.339872 10213 connection.cc:256] RPC call timeout handler was delayed by -1.28226959299991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:15:50.341493 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2759695929998998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:15:50.342505 10213 connection.cc:256] RPC call timeout handler was delayed by -1.168869592999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:15:50.344449 10213 connection.cc:256] RPC call timeout handler was delayed by -1.168869592999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:15:50.345350 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 65052.2us
I20260709 13:15:50.300180 12760 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.296293 12434 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.350615 10290 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:50.345429 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0842695930000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:15:50.353178 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0842695930000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:15:50.353713 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0662695930000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:15:50.354171 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0662695930000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:15:50.354660 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0437695929999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:15:50.355039 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0437695929999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
I20260709 13:15:50.327836 12759 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.290536 12624 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:15:50.334764 12737 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:50.289554 12763 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:50.375692 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 44605us
I20260709 13:15:50.379930 10397 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:50.356673 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.335294 12823 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.336704 12544 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.334825 12844 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:50.353134 12731 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.002s
I20260709 13:15:50.319253 12376 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.382030 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:50.352820 12713 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:50.370709 12775 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:15:50.413350 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.387646 12808 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.379395 12737 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.353288 12841 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:50.494303 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.774905 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 90364.2us
I20260709 13:15:50.931082 12860 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.399951 12836 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:50.555114 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.676599 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:50.672034 12847 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:15:50.789348 12675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.017s	sys 0.005s
I20260709 13:15:50.676333 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:50.934772 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.606858 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1410) took 1599 ms. Trace:
I20260709 13:15:50.546000 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1929) took 1582 ms. Trace:
I20260709 13:15:50.680951 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:50.855374 10145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 313) took 8244 ms. Trace:
W20260709 13:15:50.526993 10998 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260709 13:15:50.412420 12821 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:50.800657 12616 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:50.926247 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 512971us
I20260709 13:15:50.950672 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.951751 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.688017 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:50.738087 12751 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.646716 12766 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:50.707335 12823 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:50.728188 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.639686 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.409565 12795 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:50.387630 12803 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.000s
I20260709 13:15:50.385960 12811 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:50.474391 12731 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:50.397789 12610 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.013s
I20260709 13:15:50.399703 12481 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:50.578267 12755 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.004s
I20260709 13:15:50.959517 12821 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:50.736899 10394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1925) took 1826 ms (client timeout 1872 ms). Trace:
W20260709 13:15:50.725981 12837 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
W20260709 13:15:50.672798 12845 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:15:50.384086 12772 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:50.468237 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 137956us
I20260709 13:15:50.383864 12838 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:50.967536 12624 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:50.963276 12494 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:50.978885 10394 rpcz_store.cc:269] 0709 13:15:48.938739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.103356 (+164617us) service_pool.cc:224] Handling call
0709 13:15:49.727751 (+624395us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:50.736697 (+1008946us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b5400430654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:50.736827 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226045184}
I20260709 13:15:50.935740 10397 rpcz_store.cc:276] 0709 13:15:48.963576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.841569 (+877993us) service_pool.cc:224] Handling call
0709 13:15:50.545780 (+704211us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54003b92d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:50.545936 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205341952}
I20260709 13:15:50.644026 12818 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.395817 12719 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.474859 12677 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:50.528373 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 208079us
I20260709 13:15:50.719259 12717 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:50.997023 12717 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:50.518682 12525 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.997992 12717 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.999217 12717 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:51.002542 10997 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.003000 12677 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.003486 12677 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.004801 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 543) took 1060 ms. Trace:
I20260709 13:15:51.005239 10997 rpcz_store.cc:276] 0709 13:15:49.944151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.948410 (+  4259us) service_pool.cc:224] Handling call
0709 13:15:51.004552 (+1056142us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400469454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:51.004733 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212692224}
I20260709 13:15:50.679754 10994 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:50.730607 12784 raft_consensus.cc:3055] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:50.603644 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 668) took 2159 ms. Trace:
I20260709 13:15:50.744517 12775 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.667356 12576 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:50.686942 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 378) took 1043 ms. Trace:
I20260709 13:15:50.407106 12844 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.394423 12756 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.384912 12705 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:50.596247 12758 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:50.800110 12763 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:50.758131 12835 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:50.379237 12759 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:50.935398 10395 rpcz_store.cc:276] 0709 13:15:49.007369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.905799 (+898430us) service_pool.cc:224] Handling call
0709 13:15:49.906125 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.969584 (+ 63459us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:50.148733 (+179149us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.606392 (+457659us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b18002a62e0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287
0709 13:15:50.606499 (+   107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.606552 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:50.606600 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.606670 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.606795 (+   125us) inbound_call.cc:177] Queueing success response
0709 13:15:50.725209 (+118414us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
Metrics: {"mutex_wait_us":14620,"prepare.queue_time_us":219275,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":20282,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":27500,"spinlock_wait_cycles":62962944,"thread_start_us":280517,"threads_started":3,"wal-append.queue_time_us":205591}
I20260709 13:15:50.985755 12818 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:50.934556 12675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.030s	sys 0.012s
I20260709 13:15:50.929829 12737 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:50.709308 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 459788us
W20260709 13:15:51.025847 10362 leader_election.cc:336] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.917s (SENT)
I20260709 13:15:51.026325 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:50.955833 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:15:51.027369 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 71617.9us
I20260709 13:15:51.028278 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.029402 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:50.943939 10145 rpcz_store.cc:276] 0709 13:15:42.622496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.623336 (+   840us) service_pool.cc:224] Handling call
0709 13:15:50.855273 (+8231937us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.342043 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.342920 (+   877us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.342978 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:15:48.343007 (+    29us) tablet.cc:662] Decoding operations
0709 13:15:48.344436 (+  1429us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.344518 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.344543 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:15:48.354956 (+ 10413us) tablet.cc:701] Row locks acquired
0709 13:15:48.354988 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:15:48.355213 (+   225us) write_op.cc:270] Start()
0709 13:15:48.355365 (+   152us) write_op.cc:276] Timestamp: P: 1783602948355146 usec, L: 0
0709 13:15:48.355396 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.412498 (+ 57102us) log.cc:844] Serialized 4014 byte log entry
0709 13:15:48.773063 (+360565us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.843974 (+1070911us) write_op.cc:301] APPLY: starting
0709 13:15:49.851039 (+  7065us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:50.002790 (+151751us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:50.033047 (+ 30257us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:50.114620 (+ 81573us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:50.172284 (+ 57664us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:15:50.179220 (+  6936us) write_op.cc:312] APPLY: finished
0709 13:15:50.260589 (+ 81369us) log.cc:844] Serialized 77 byte log entry
0709 13:15:50.474217 (+213628us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.528020 (+ 53803us) write_op.cc:454] Released schema lock
0709 13:15:50.543252 (+ 15232us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.570741 (+ 27489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.571468 (+   727us) write_op.cc:454] Released schema lock
0709 13:15:50.672161 (+100693us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
Metrics: {"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":1049616,"apply.run_cpu_time_us":33837,"apply.run_wall_time_us":725699,"num_ops":10,"prepare.queue_time_us":652338,"prepare.run_cpu_time_us":26787,"prepare.run_wall_time_us":239319,"raft.queue_time_us":132432,"raft.run_cpu_time_us":24950,"raft.run_wall_time_us":1082755,"replication_time_us":417481,"spinlock_wait_cycles":31486336,"thread_start_us":1801231,"threads_started":5,"wal-append.queue_time_us":298334,"wal-append.run_cpu_time_us":19193,"wal-append.run_wall_time_us":1104431}]]}
I20260709 13:15:50.964610 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:50.947348 12836 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:50.965308 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:51.032459 10249 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:50.965946 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:50.946776 10998 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:50.954734 12860 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:51.036931 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 541) took 1093 ms. Trace:
W20260709 13:15:50.609261 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 257440us
I20260709 13:15:51.037356 10998 rpcz_store.cc:276] 0709 13:15:49.943601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.943737 (+   136us) service_pool.cc:224] Handling call
0709 13:15:51.036861 (+1093124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.037701 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:51.038136 10290 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.038429 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.039171 12756 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.039747 12836 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.040827 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.019958 12844 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:50.413151 12826 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.042526 12838 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:50.398054 12750 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.042702 12758 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.953655 12808 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:50.935354 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.044840 12705 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:51.045980 12705 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:51.046437 12705 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:50.970465 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:50.519255 12713 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.047791 10241 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.047273 12705 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.048527 12705 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.977937 10393 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:15:50.517861 12609 consensus_meta.cc:287] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.601s	user 0.019s	sys 0.011s
I20260709 13:15:50.983213 12624 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.050537 12700 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.050704 12835 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.051056 12700 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.051774 12624 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:50.987181 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.052515 11001 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:51.013191 12784 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:51.061450 10392 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:50.387355 12828 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:50.988971 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:50.967360 12803 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.995194 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:50.990090 12494 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:50.996225 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.068589 10995 raft_consensus.cc:2376] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
I20260709 13:15:51.069818 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:50.993323 12481 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:51.032294 12763 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.015956 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:51.072155 12763 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.072573 12826 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.073077 10246 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:51.073909 11002 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.018139 12576 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:51.022089 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:51.077783 10996 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:15:51.031147 10288 connection.cc:256] RPC call timeout handler was delayed by -1.1501409659999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:15:51.033473 10245 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.080093 12763 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:50.988018 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.056149 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.096465 10395 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:51.057641 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.097976 10394 raft_consensus.cc:2410] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:51.061581 10393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1920) took 2152 ms (client timeout 1951 ms). Trace:
I20260709 13:15:51.062638 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:51.101120 10393 rpcz_store.cc:269] 0709 13:15:48.908807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.025720 (+116913us) service_pool.cc:224] Handling call
0709 13:15:51.061391 (+2035671us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003babd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:51.061510 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237612288}
I20260709 13:15:51.102010 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:50.960059 12766 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.065177 12700 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:51.066571 12731 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:51.067996 12494 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:50.978467 12755 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.019085 10317 rpcz_store.cc:276] 0709 13:15:49.643058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.664719 (+ 21661us) service_pool.cc:224] Handling call
0709 13:15:50.686691 (+1021972us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400209c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:50.686854 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261464960}
I20260709 13:15:51.038524 12772 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:51.034852 10362 leader_election.cc:336] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.959s (SENT)
I20260709 13:15:51.138368 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:15:51.139609 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 104772us
W20260709 13:15:51.083103 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.089661 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:51.061044 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.104573 10245 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:51.106047 12784 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.113590 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:51.115247 10396 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:51.062458 12860 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.164697 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.020520 12775 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.063041 12751 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:51.120608 10242 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:51.124747 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.181043 10316 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:51.126319 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.016127 10993 rpcz_store.cc:276] 0709 13:15:48.444254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.447473 (+  3219us) service_pool.cc:224] Handling call
0709 13:15:48.447776 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.077265 (+1629489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.585388 (+508123us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400660154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:50.603542 (+ 18154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3522792320}
I20260709 13:15:51.116094 12851 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.146363 12838 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.129639 12766 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:51.130452 11000 raft_consensus.cc:2410] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:51.039180 10998 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:51.133879 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:51.136943 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.143440 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.199743 10323 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.161275 12772 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:51.150059 12713 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.150327 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.203795 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.150668 12841 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:51.151062 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.205073 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.151919 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.205717 10323 raft_consensus.cc:2376] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6. Re-sending same reply.
I20260709 13:15:51.206529 10325 raft_consensus.cc:2410] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:51.206676 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.153585 12810 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.154215 12846 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.179553 12723 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:51.159145 12795 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:51.162591 10362 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.172s (SENT)
W20260709 13:15:51.210146 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47573.8us
W20260709 13:15:51.210772 10362 leader_election.cc:336] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.208s (SENT)
I20260709 13:15:51.211136 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:51.163323 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.212545 10394 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:51.061218 12811 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:51.166800 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.167668 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:51.169544 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 80029.3us
I20260709 13:15:51.213986 10320 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:51.214076 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:51.170867 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.171836 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.184453 10319 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:51.186802 10967 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.207218 10323 raft_consensus.cc:2376] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4. Re-sending same reply.
W20260709 13:15:51.191522 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 107372us
I20260709 13:15:51.194931 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.128449 10994 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:51.253191 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.255472 10316 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:51.144485 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.221330 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.153928 12759 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.199285 12784 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.255545 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.261353 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.261926 10318 raft_consensus.cc:2368] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7.
W20260709 13:15:51.263319 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 76615.9us
I20260709 13:15:51.264555 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.257328 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.257954 10397 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:51.259894 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.267131 10319 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:15:51.269057 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 47811.4us
I20260709 13:15:51.269783 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.219231 12609 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.273412 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.203996 12772 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.285866 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.293264 10395 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:51.219571 12803 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.295418 10397 raft_consensus.cc:2368] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:51.220192 12823 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.252097 12811 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:51.253086 12755 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:51.298949 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.299638 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.335852 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.385133 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.486471 10318 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:51.486661 10319 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:15:51.386862 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:51.280252 12700 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.220042 12846 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.290899 12525 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:51.393230 12790 ts_tablet_manager.cc:1929] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:15:51.220564 12810 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.186554 12576 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.395143 12818 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:51.397598 12759 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.271221 12723 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.409549 12844 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.409968 10320 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:51.410668 12756 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.413442 12737 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.417413 12772 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.421133 12751 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.423032 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.425266 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.426378 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:51.427080 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.428311 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.428668 12808 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.291107 12494 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:15:51.381734 12544 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:15:51.446230 10244 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:51.449321 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:51.534430 10392 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:51.450353 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:51.535074 10243 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.453392 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:51.433308 10146 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:51.460795 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:51.536437 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.261234 12838 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:51.470498 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:51.472997 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:51.476246 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.455961 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:51.554648 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 98785.3us
I20260709 13:15:51.482019 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:51.556110 10246 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
W20260709 13:15:51.529512 12869 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:15:51.483906 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.559607 11000 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:51.482019 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.560590 10398 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:51.490713 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.491364 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.492569 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.494184 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.495064 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:51.495514 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 196646us
I20260709 13:15:51.563781 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.563835 10325 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:51.496315 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.497387 10396 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
W20260709 13:15:51.497738 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.565616 10396 pending_rounds.cc:85] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 6
I20260709 13:15:51.496553 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:51.565881 10396 pending_rounds.cc:107] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:51.501850 10248 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:51.566145 10396 raft_consensus.cc:2889] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.503994 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:51.505514 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 205063us
I20260709 13:15:51.495461 12700 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.493194 12823 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:51.515599 10316 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.568194 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:51.494815 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.500644 12766 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.520203 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.524340 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.526978 11001 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.522895 11002 raft_consensus.cc:2376] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
W20260709 13:15:51.577438 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 53161.8us
I20260709 13:15:51.530285 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.513494 12790 log.cc:1199] T 7df30c54c90e4fcfaeb14736ccbcec7c P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/7df30c54c90e4fcfaeb14736ccbcec7c
I20260709 13:15:51.581523 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:51.583994 10213 leader_election.cc:400] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:51.584338 10213 leader_election.cc:403] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.536752 10146 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.585623 10321 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:51.511483 12525 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:51.553848 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.591117 10392 raft_consensus.cc:2410] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:51.483748 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:51.591640 10394 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.524963 12576 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.595968 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.596415 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.596619 10318 raft_consensus.cc:2376] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5. Re-sending same reply.
I20260709 13:15:51.551553 12773 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.604411 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:51.609526 10399 raft_consensus.cc:2376] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:15:51.571146 12788 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:51.566165 10247 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:51.568193 10997 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.529179 12751 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.592463 12610 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.554875 12624 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:15:51.573045 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.576035 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.629890 10324 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:51.630771 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.631174 12846 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.631367 10324 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
W20260709 13:15:51.632186 12873 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:15:51.632310 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.578685 10398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:51.633387 10398 raft_consensus.cc:606] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:51.633788 10398 raft_consensus.cc:614] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:51.578150 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:51.580452 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:51.581074 10323 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.634570 11002 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:51.585841 10146 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.589725 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:51.635351 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:51.635696 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 46064.7us
I20260709 13:15:51.539678 10249 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:51.593359 10316 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:15:51.594794 11001 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:51.635972 10146 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:51.500108 12836 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:51.564604 10243 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:51.637669 10146 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.591348 12775 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:51.579033 12700 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.621037 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.651317 10318 raft_consensus.cc:2410] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:51.593231 10995 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.590795 12750 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:51.568399 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:51.654909 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 78233.8us
I20260709 13:15:51.551429 12717 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:15:51.538504 12808 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.623657 10394 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:51.622623 10998 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.624882 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:51.626664 12874 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:15:51.634625 10390 raft_consensus.cc:2376] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3. Re-sending same reply.
I20260709 13:15:51.636734 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:51.582098 10391 raft_consensus.cc:2376] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5. Re-sending same reply.
W20260709 13:15:51.684206 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 47548.9us
I20260709 13:15:51.531737 12821 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:15:51.597647 12544 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:51.641770 10146 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.656808 12775 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.693110 10146 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.597417 12828 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:51.658950 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.697402 10323 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:51.659237 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75382.2us
I20260709 13:15:51.699980 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.558815 12838 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.582549 12823 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.769100 12823 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.769747 10397 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:15:51.771695 12838 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.773814 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.775907 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.776744 10321 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:51.777849 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.779130 10321 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:51.650027 12885 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:51.780435 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.781440 10243 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:51.781553 10321 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:51.668102 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:51.627347 12790 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34158 (request call id 81) took 3412 ms. Trace:
I20260709 13:15:51.632990 12788 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:51.681281 11002 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:51.646420 12846 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:51.682744 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:51.752348 12677 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.001s
I20260709 13:15:51.684940 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:51.663173 12624 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:51.620358 12773 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.695052 10146 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.795272 10146 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.796017 10319 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:51.696244 10322 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:15:51.705338 12751 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:51.639393 12877 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:15:51.692234 12544 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.801889 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.682638 12737 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.716145 12766 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.718472 12810 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.805663 12882 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:51.722707 12821 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:51.806720 12821 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:51.807188 10319 raft_consensus.cc:2376] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
I20260709 13:15:51.807713 12821 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.808885 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.729188 10393 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.730790 12808 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:51.737690 12851 consensus_meta.cc:287] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 13:15:51.810972 12851 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:51.738575 12772 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:51.748047 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.784037 12790 rpcz_store.cc:276] 0709 13:15:48.330676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.331914 (+  1238us) service_pool.cc:224] Handling call
0709 13:15:48.581459 (+249545us) ts_tablet_manager.cc:1151] Deleting tablet 7df30c54c90e4fcfaeb14736ccbcec7c
0709 13:15:48.581590 (+   131us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:15:50.741094 (+2159504us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:51.393075 (+651981us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:51.627261 (+234186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626630,"tablet-delete.queue_time_us":150371,"thread_start_us":139620,"threads_started":1}
I20260709 13:15:51.812417 10320 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.597184 12811 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:51.759317 12879 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.084s	user 0.003s	sys 0.003s
I20260709 13:15:51.761199 12717 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.846567 10394 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:51.762873 10390 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:15:51.691720 12876 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:51.807192 12875 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.418s	user 0.003s	sys 0.000s
I20260709 13:15:51.765813 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.850320 10325 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:51.701939 12775 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.854875 12775 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:51.779362 10362 leader_election.cc:336] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.533s (SENT)
W20260709 13:15:51.855787 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 76466.7us
I20260709 13:15:51.846508 12717 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:51.858537 12717 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.859618 12717 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.860006 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.813100 12788 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.784538 10247 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:51.784631 10246 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:51.786944 10398 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:15:51.787484 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87590.6us
I20260709 13:15:51.784060 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.874607 10321 raft_consensus.cc:2376] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5. Re-sending same reply.
I20260709 13:15:51.875839 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.877328 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.877686 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.791165 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.878408 10321 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:51.683095 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:51.797914 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 113064us
I20260709 13:15:51.878976 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.799082 10243 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:51.792670 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 137199us
I20260709 13:15:51.880096 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.682405 12525 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:51.796952 10146 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.797783 12624 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:51.788385 12885 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:51.900926 12885 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:51.901921 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.902114 12885 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.902894 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.719698 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:51.811692 10317 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:51.813359 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.904541 10320 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4.
I20260709 13:15:51.905362 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.905553 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.756315 12828 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.840070 10319 raft_consensus.cc:2410] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:51.809101 12821 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.814102 12544 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:51.835721 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.848093 10323 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:51.835628 12765 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.851305 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.857981 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.881134 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.916718 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.924711 10316 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:15:51.925777 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.791873 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:51.926667 10241 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.926998 10324 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:51.882330 10398 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:51.879319 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.884946 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.894639 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.928320 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:51.928401 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49157.6us
I20260709 13:15:51.928686 11002 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:51.895318 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:51.929117 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:51.929447 11000 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:15:51.897091 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:51.884029 10146 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 2, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.900818 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:51.930593 10390 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:15:51.907228 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 187622us
I20260709 13:15:51.931370 10146 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 4, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 4 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:51.932658 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:51.907881 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:51.837898 12723 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.804829 12838 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.933780 10320 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.854907 12773 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:51.945179 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.937484 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:51.946602 10391 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:51.799546 12677 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:51.896571 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet 7df30c54c90e4fcfaeb14736ccbcec7c (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
W20260709 13:15:52.005692 10132 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 109150us
I20260709 13:15:51.898595 12775 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:51.955544 10288 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:51.949252 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:52.002296 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.908699 12808 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:15:51.917086 12846 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.013229 10324 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:52.017974 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:52.020761 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:52.028338 10325 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:51.934688 12838 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.945703 12860 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.024626 10241 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:52.010545 10320 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:51.916265 12494 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:52.034278 10213 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.541s (SENT)
I20260709 13:15:51.889071 12836 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:15:51.888895 12763 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 13:15:51.945077 12756 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:15:51.916880 12751 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:15:51.935005 12713 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:15:51.942543 12481 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:15:51.942457 12765 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.004142 12624 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.393075 12811 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.908453 12882 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.512s
I20260709 13:15:52.420974 12811 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:52.206161 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 348237us
I20260709 13:15:52.423175 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:52.416556 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.415333 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 459818us
I20260709 13:15:52.039958 12846 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.426312 10321 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:52.426519 12811 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:52.427477 12846 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:52.431159 10996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.050s	sys 0.107s
W20260709 13:15:52.441169 10996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.050s	sys 0.108s
I20260709 13:15:52.429842 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:52.434159 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2030) took 1102 ms. Trace:
I20260709 13:15:52.441998 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:52.434583 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 400446us
I20260709 13:15:52.028620 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:51.948565 12865 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.436570 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:52.038704 12616 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:52.437357 12775 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:52.438056 12624 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.013885 12758 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.242364 10319 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:52.238569 12759 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.950248 12772 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:52.159039 11001 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:52.041090 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:52.447204 11000 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.442200 10324 rpcz_store.cc:276] 0709 13:15:51.331608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.040163 (+708555us) service_pool.cc:224] Handling call
0709 13:15:52.040487 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.165778 (+125291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.165826 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.242132 (+ 76306us) log.cc:844] Serialized 26 byte log entry
0709 13:15:52.432399 (+190267us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:52.432468 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.432635 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.433856 (+  1221us) raft_consensus.cc:1685] finished
0709 13:15:52.433876 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.434065 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84647,"raft.queue_time_us":101320,"spinlock_wait_cycles":110714624,"thread_start_us":61513,"threads_started":1,"wal-append.queue_time_us":94875}
I20260709 13:15:52.448763 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:52.307983 12877 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.486886 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 445876us
I20260709 13:15:52.046401 12838 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.024688 12883 consensus_queue.cc:1059] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.472s
I20260709 13:15:52.460958 10998 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:52.469146 12775 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.337105 10997 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:52.454515 12865 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:52.447727 12756 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.470003 12616 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:52.471545 12828 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:52.113106 12675 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:52.472725 12765 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:52.456374 12823 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.501931 12877 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.512769 12616 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.514810 12877 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:52.496227 12759 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.516961 12759 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:52.517004 12677 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:52.518497 12700 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.000s
I20260709 13:15:52.519151 12700 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.521379 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:52.522866 12821 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.001s
I20260709 13:15:52.036356 12773 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:52.047333 12705 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.455422 12896 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.492762 12772 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:52.493448 12784 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:52.495169 12713 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:52.207201 12886 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:52.507989 12717 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.004s
I20260709 13:15:52.504557 12865 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.504693 12756 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:52.509907 12675 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.537871 12713 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:52.547966 12675 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.548913 12713 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.537194 12886 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.551380 12865 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.552693 12886 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:52.531097 12773 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.542948 12823 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.553661 12773 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.542454 12772 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.532822 12705 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.511744 12890 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.545385 12700 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:52.546350 12763 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.546412 12784 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:52.546965 12756 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.561970 12763 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:52.563735 12784 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.564146 12763 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.565380 12763 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.561556 12890 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:52.553640 12865 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:52.568380 12890 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.569415 12890 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:52.444725 10213 leader_election.cc:336] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.664s (SENT)
I20260709 13:15:51.933769 10146 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:52.600889 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:52.604167 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 159389us
W20260709 13:15:52.607156 10213 leader_election.cc:336] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.755s (SENT)
W20260709 13:15:52.051697 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.453819 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.605759 10146 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:52.211041 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.611248 10213 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.806s (SENT)
W20260709 13:15:52.611960 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.613984 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:52.614975 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.616066 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.616243 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.612061 10146 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 3, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:52.625275 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.625136 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 195247us
I20260709 13:15:52.626909 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:52.639969 10317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2017) took 1512 ms (client timeout 1533 ms). Trace:
W20260709 13:15:52.640611 10317 rpcz_store.cc:269] 0709 13:15:51.127313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.136693 (+  9380us) service_pool.cc:224] Handling call
0709 13:15:52.639456 (+1502763us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540022d3d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:52.639707 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409073024}
I20260709 13:15:52.643091 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:52.647392 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:52.648422 10317 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:52.649722 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:52.651058 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:52.652251 10319 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:52.653591 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:52.656442 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2040) took 1063 ms. Trace:
I20260709 13:15:52.656906 10319 rpcz_store.cc:276] 0709 13:15:51.592849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.655045 (+1062196us) service_pool.cc:224] Handling call
0709 13:15:52.655576 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.655980 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.656014 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.656085 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:52.656127 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.656216 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.656339 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.660040 10319 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:15:52.660532 10319 pending_rounds.cc:85] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 3
I20260709 13:15:52.660939 10319 pending_rounds.cc:107] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:52.661417 10319 raft_consensus.cc:2889] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.475912 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:52.663450 10322 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:52.476051 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:52.494632 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 45936.5us
W20260709 13:15:52.449887 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.712440 12883 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:52.541170 12544 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.000s
W20260709 13:15:52.544608 12576 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.001s
W20260709 13:15:52.676661 10364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.002s	sys 0.003s
I20260709 13:15:52.677037 10322 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:52.678207 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 391) took 1487 ms. Trace:
I20260709 13:15:52.680233 12823 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.694842 10324 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:52.695042 12810 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:52.710438 12677 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.802403 10317 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:15:52.803059 12677 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.699891 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:52.704011 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2038) took 1149 ms. Trace:
I20260709 13:15:52.693192 12756 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.697619 12826 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:52.716310 12886 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:52.719717 12901 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.731637 10395 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:52.561507 12705 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.730504 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:52.813464 10364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.004s	sys 0.008s
I20260709 13:15:52.746587 11000 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.709936 12865 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.797746 10321 rpcz_store.cc:276] 0709 13:15:51.191220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.944787 (+753567us) service_pool.cc:224] Handling call
0709 13:15:51.945079 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.426693 (+481614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.677569 (+250876us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540022c4d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:52.677959 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105954688}
I20260709 13:15:52.723078 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:52.806982 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2066) took 1009 ms. Trace:
I20260709 13:15:52.720854 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:52.742517 12494 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:52.734720 12616 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.721671 12851 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.740414 10325 raft_consensus.cc:2376] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6. Re-sending same reply.
I20260709 13:15:52.754559 12821 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.740804 12737 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:52.811873 12810 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:52.826577 12737 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:52.826992 12719 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:52.826699 12544 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.827759 12810 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.828426 12737 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.829814 12737 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.830868 10318 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:52.826743 12918 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.831663 10241 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:52.832264 12677 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:52.830003 12544 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:52.816684 10322 rpcz_store.cc:276] 0709 13:15:51.791340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.664289 (+872949us) service_pool.cc:224] Handling call
0709 13:15:52.664911 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.797299 (+132388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.800362 (+  3063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.839260 12886 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.813371 12901 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:52.757826 12811 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.747256 12844 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:52.855252 10390 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:52.865309 10994 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:15:52.865572 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 45065.5us
I20260709 13:15:52.866068 10994 pending_rounds.cc:85] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 6
I20260709 13:15:52.866585 10994 pending_rounds.cc:107] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:52.866981 10994 raft_consensus.cc:2889] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:52.874727 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:52.876484 10243 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:52.877599 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 388) took 1698 ms. Trace:
I20260709 13:15:52.877492 10399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15565c698f45442aa353abbe927bfc68"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:52.878556 10399 raft_consensus.cc:606] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:52.879190 10399 raft_consensus.cc:614] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.878208 10323 rpcz_store.cc:276] 0709 13:15:51.178612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.942900 (+764288us) service_pool.cc:224] Handling call
0709 13:15:51.943121 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.943416 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:52.440785 (+497369us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.802689 (+361904us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.818428 (+ 15739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.821832 (+  3404us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:52.856339 (+ 34507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.877220 (+ 20881us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.877393 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30397,"prepare.queue_time_us":400072,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":3464,"raft.queue_time_us":46768,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":15515,"thread_start_us":643375,"threads_started":2,"wal-append.queue_time_us":130036}
I20260709 13:15:52.881731 12886 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:52.890072 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.890918 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.895274 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:52.899533 12901 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.900458 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2058) took 1155 ms. Trace:
I20260709 13:15:52.901176 12901 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.901080 10318 rpcz_store.cc:276] 0709 13:15:51.744913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.883625 (+138712us) service_pool.cc:224] Handling call
0709 13:15:52.900138 (+1016513us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54002df354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:52.900364 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068858624}
I20260709 13:15:52.902309 12376 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:52.903093 12376 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.902871 12823 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.907900 10317 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:52.908316 12376 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:52.909934 10322 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:52.910445 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:52.739868 12675 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.886054 12719 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.929682 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:52.932399 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 1934) took 1636 ms. Trace:
W20260709 13:15:52.933635 10993 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.905s	user 0.004s	sys 0.009s
I20260709 13:15:52.855764 12494 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.936251 10321 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:52.915042 12865 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:52.939666 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 563) took 1080 ms. Trace:
I20260709 13:15:52.942389 12821 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.946034 12616 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.947005 12773 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:52.805018 10320 rpcz_store.cc:276] 0709 13:15:51.554819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.039527 (+484708us) service_pool.cc:224] Handling call
0709 13:15:52.039817 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.040031 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:52.663046 (+623015us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.699846 (+ 36800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.699947 (+   101us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:52.700722 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.700869 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.703825 (+  2956us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93427,"prepare.queue_time_us":352390,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":29289,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":36502,"thread_start_us":457305,"threads_started":2,"wal-append.queue_time_us":1208}
I20260709 13:15:52.951380 10395 rpcz_store.cc:276] 0709 13:15:51.296153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.296462 (+   309us) service_pool.cc:224] Handling call
0709 13:15:51.296768 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.834968 (+1538200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.931978 (+ 97010us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002dc654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:52.932295 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200887168}
I20260709 13:15:52.952428 12719 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.974509 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:52.964779 10993 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:52.975863 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:52.979543 10390 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:15:52.983155 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.984189 12616 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:52.985067 12865 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:52.985520 10398 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:52.925313 12851 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.002106 12821 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:53.003113 10243 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:52.957957 10994 rpcz_store.cc:276] 0709 13:15:51.859216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.859381 (+   165us) service_pool.cc:224] Handling call
0709 13:15:51.859767 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.868407 (+1008640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.939220 (+ 70813us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54004f06d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:52.939560 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301418240}
I20260709 13:15:53.005401 12773 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:53.005122 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.004595 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 191199us
W20260709 13:15:53.016569 10993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 551) took 1717 ms (client timeout 2162 ms). Trace:
W20260709 13:15:53.017102 10993 rpcz_store.cc:269] 0709 13:15:51.298971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.386579 (+ 87608us) service_pool.cc:224] Handling call
0709 13:15:53.016244 (+1629665us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400750154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:53.016454 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193789824}
I20260709 13:15:53.017510 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.018486 10999 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.976465 12823 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:53.017922 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 1.115e+06us
I20260709 13:15:53.018143 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:53.022608 12376 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:53.036309 10243 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
W20260709 13:15:53.040474 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.044772 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.048804 12851 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.050606 12675 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:53.052512 12838 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.002s
W20260709 13:15:53.054474 10362 leader_election.cc:336] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.620s (SENT)
I20260709 13:15:53.057360 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.058328 10248 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
W20260709 13:15:53.060334 12922 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:53.052676 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 680) took 1113 ms. Trace:
I20260709 13:15:53.065026 10999 rpcz_store.cc:276] 0709 13:15:51.939229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.939372 (+   143us) service_pool.cc:224] Handling call
0709 13:15:53.017996 (+1078624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:53.039281 (+ 21285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.052351 (+ 13070us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400750150. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:53.052559 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479605504}
I20260709 13:15:53.039022 12821 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:53.112041 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:53.041647 12376 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:53.115149 10391 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:53.111454 12860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.000s	sys 0.028s
I20260709 13:15:53.126765 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.133926 12494 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:53.134506 12756 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:53.135334 12376 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.136075 12756 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.136562 12756 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:53.137313 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.138470 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.139354 10243 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:53.134143 10247 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:53.142379 12737 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.143054 12737 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.144260 12705 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.145483 12737 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:53.146261 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 109513us
I20260709 13:15:53.155858 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:53.129411 12860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.000s	sys 0.029s
I20260709 13:15:53.137579 12756 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.163430 10241 raft_consensus.cc:2410] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:15:53.164433 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 108481us
I20260709 13:15:53.064875 12838 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.171078 12756 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:53.171669 12924 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:15:53.173569 12705 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.163702 12860 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:53.176364 12821 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.177976 12846 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.178936 12821 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.178893 12846 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.182744 10316 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:53.183821 12846 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:53.190027 10362 leader_election.cc:336] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.772s (SENT)
W20260709 13:15:53.193620 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.196069 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:53.197034 10994 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:53.199682 12616 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.200472 12616 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:53.201639 12773 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:53.203037 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:53.203742 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.207381 10250 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:53.181994 12838 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.207953 10250 pending_rounds.cc:85] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 3
I20260709 13:15:53.213021 10250 pending_rounds.cc:107] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:53.213406 10250 raft_consensus.cc:2889] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.216961 12616 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:53.220849 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.175665 12860 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:53.233212 10244 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:15:53.233724 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.234481 10213 leader_election.cc:336] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.632s (SENT)
I20260709 13:15:53.235458 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:15:53.238070 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2068) took 1330 ms (client timeout 1635 ms). Trace:
I20260709 13:15:53.238209 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:53.238847 10316 rpcz_store.cc:269] 0709 13:15:51.907518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.925483 (+ 17965us) service_pool.cc:224] Handling call
0709 13:15:53.237798 (+1312315us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400187ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:53.237989 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888360320}
I20260709 13:15:53.240129 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.240927 10246 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:53.241345 12810 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:53.241474 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.242187 12810 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:53.244884 12810 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:53.245077 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.242040 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.251538 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.251649 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.252328 10320 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:53.252655 10321 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:15:53.256528 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64677.2us
I20260709 13:15:53.259038 12784 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:53.260128 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.260365 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.260787 10322 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.260881 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.261597 10248 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 2.
I20260709 13:15:53.262647 12876 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.262670 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.263525 10325 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:53.263790 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.263933 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:53.264070 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.264531 10320 raft_consensus.cc:2368] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:15:53.264801 10323 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:53.262672 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.202432 12773 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.266130 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.264943 10325 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.257485 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:53.264851 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.265650 10316 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:53.202493 12705 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:15:53.277064 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.277745 10248 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.278602 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.281051 10250 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:53.282878 10324 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:15:53.286506 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 77146.1us
I20260709 13:15:53.288015 10317 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.281811 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.273732 12784 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:53.293067 10213 leader_election.cc:336] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.187s (SENT)
I20260709 13:15:53.291215 10241 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:53.291098 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:53.288690 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.280587 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.291965 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.295353 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:53.296150 10998 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.297853 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34158 (request call id 82) took 1406 ms. Trace:
I20260709 13:15:53.295552 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.298581 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:53.298729 10244 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.313194 10320 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:53.298921 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:53.299446 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:53.300669 12784 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.301101 10318 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:53.302106 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:53.303373 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 81492.5us
I20260709 13:15:53.303866 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.316205 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:53.304699 12616 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:53.322614 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.310118 10319 rpcz_store.cc:276] 0709 13:15:51.891495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.671428 (+779933us) service_pool.cc:224] Handling call
0709 13:15:53.297533 (+626105us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400187ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aee735 00007f58c3ae69fa 00007f58c8aae4c9 00007f58c202ac54 00007f58c202abe2 00007f58c202ab11 00007f58c202aa8c 00007f58c2029d42 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:53.297755 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176240000}
I20260709 13:15:53.310034 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.303960 12713 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:53.312136 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.322315 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.325861 10317 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:53.317571 10322 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:53.329162 10316 raft_consensus.cc:2410] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:53.331694 10323 raft_consensus.cc:2368] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4.
I20260709 13:15:53.334677 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.346294 10993 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:53.346828 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.309252 12719 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:53.333607 10241 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:53.328128 12713 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.326718 12784 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:53.355314 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:53.350710 12918 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.358606 10325 raft_consensus.cc:2368] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:15:53.362221 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:53.368000 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.368183 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:53.331571 12823 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:53.371600 10994 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.374208 12719 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:53.347101 12876 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.394026 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.395104 10241 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:53.378993 10247 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:53.381192 10248 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:53.326843 12616 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:53.382507 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 94369.4us
W20260709 13:15:53.385128 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.367470 12713 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.387912 10250 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:53.333280 12838 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.398795 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.411509 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.402457 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.392617 12846 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:53.418063 12846 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.418545 12846 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.395448 12876 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.422837 12876 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.397938 12616 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:53.427269 12923 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.333s	user 0.000s	sys 0.004s
I20260709 13:15:53.435335 10320 raft_consensus.cc:2368] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:15:53.440002 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.444998 12705 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:53.445688 12705 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.451638 10249 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:53.445678 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.426479 12838 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.468258 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:53.470355 12766 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:53.472934 10998 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:53.480051 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 130030us
I20260709 13:15:53.501614 10241 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.513613 12705 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.514765 12773 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.521164 12821 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.521708 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.537528 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:53.537880 10319 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:53.521826 12821 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.522678 12737 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.539721 12737 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.541237 12737 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.529695 10242 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:53.533382 10246 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:53.534216 10244 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:15:53.537083 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.546666 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.550706 12795 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.541793 12821 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.568882 12719 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:53.593431 12719 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.594533 12763 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:53.596653 12719 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.610610 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:53.611850 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:53.620671 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.585034 12838 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:53.589058 12616 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:53.592097 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.631583 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.631834 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.633064 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.660890 10320 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:53.641185 12951 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.641769 12675 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:53.580962 12901 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.004s
W20260709 13:15:53.650391 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.651321 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.661536 10319 raft_consensus.cc:2410] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:15:53.668083 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 267027us
I20260709 13:15:53.684500 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.686196 10325 raft_consensus.cc:2368] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4.
I20260709 13:15:53.686424 10245 raft_consensus.cc:2410] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:15:53.688010 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.689260 10320 raft_consensus.cc:2410] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:53.669013 12675 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:53.702893 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:53.714066 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 164319us
I20260709 13:15:53.712630 10325 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:53.719226 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:53.721128 10213 leader_election.cc:336] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.758s (SENT)
I20260709 13:15:53.708427 12675 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:53.731065 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 110565us
I20260709 13:15:53.738622 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.739538 10319 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:53.717152 12713 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:53.742002 12616 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:53.742704 12700 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:53.743860 10320 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:53.745632 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:53.761523 10325 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:53.769336 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.770292 10320 raft_consensus.cc:2376] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5. Re-sending same reply.
I20260709 13:15:53.743800 12713 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:53.773779 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.782406 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.779201 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.783792 10325 raft_consensus.cc:2376] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4. Re-sending same reply.
I20260709 13:15:53.786770 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.787603 10320 raft_consensus.cc:2368] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4.
W20260709 13:15:53.786823 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 80377.1us
I20260709 13:15:53.737099 12784 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:53.791944 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.797335 12784 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:53.799093 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.799736 10316 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:53.800662 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.801308 10318 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:53.801654 10994 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:53.793216 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:53.808200 10391 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:53.808457 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.794968 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 62452.6us
I20260709 13:15:53.796460 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.789346 12494 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:53.797794 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.792279 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:53.813844 10396 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.797174 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:15:53.818490 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45922.8us
I20260709 13:15:53.818784 10323 raft_consensus.cc:2368] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:15:53.819075 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:53.798125 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:53.798645 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 402917us
I20260709 13:15:53.819485 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.819824 10317 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:15:53.793038 10213 leader_election.cc:336] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.763s (SENT)
I20260709 13:15:53.820289 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:53.820811 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.821166 10394 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:53.821336 12700 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:53.822263 10213 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.852s (SENT)
I20260709 13:15:53.822755 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.805305 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.806109 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:53.813205 12494 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:53.798576 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.833140 10321 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:53.824290 10288 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:53.835124 10396 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:15:53.829933 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:53.840140 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.841778 10325 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:53.847898 10318 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:15:53.847927 10242 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:53.849341 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.851285 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.851936 10241 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:53.853533 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:53.854422 12773 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:53.854628 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.855134 12773 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:53.855247 10246 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.857362 10395 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:53.858129 10319 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:53.858867 12713 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.859447 12713 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:53.860144 12494 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.861708 12713 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:53.862490 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.863106 10325 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:53.864393 12795 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.865212 12795 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:53.867518 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.868172 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.868952 10317 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:53.868844 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.869693 10320 raft_consensus.cc:2410] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:53.869902 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.830427 12860 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.870653 10323 raft_consensus.cc:2368] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:15:53.845408 12784 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:15:53.871728 10322 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:53.872839 12719 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.873378 12719 raft_consensus.cc:697] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:53.873826 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.874639 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.874358 12719 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.875411 10325 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:15:53.876446 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 54227.9us
W20260709 13:15:53.877373 10213 leader_election.cc:336] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.872s (SENT)
I20260709 13:15:53.881758 10322 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:53.868187 10321 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
W20260709 13:15:53.885212 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 292718us
I20260709 13:15:53.888986 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.889216 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.889057 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.890414 10317 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:53.890215 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.891153 10316 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:53.893348 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.893853 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:53.894338 10323 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:53.896713 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.897361 10322 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:15:53.898485 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45024.5us
I20260709 13:15:53.898720 10321 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:53.899111 10321 pending_rounds.cc:85] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 2
I20260709 13:15:53.899394 10321 pending_rounds.cc:107] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:53.899642 10321 raft_consensus.cc:2889] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.901134 10318 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:53.902468 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.840211 12766 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:53.896468 10397 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:53.906548 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:53.877801 12821 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.899500 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:15:53.953987 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.944109 10317 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:15:53.939468 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.955925 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:53.959435 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.962112 10250 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.961371 10249 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:53.937347 12766 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.881454 12846 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:53.969022 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.966604 10249 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:53.967253 10395 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:53.970515 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:53.972102 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:15:53.976810 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 156503us
I20260709 13:15:53.978562 10243 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:15:53.911306 12876 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:53.978960 10243 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:15:53.983671 10243 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:53.983955 10243 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:53.970463 12766 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.974476 12951 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.982319 10249 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.010172 10246 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:15:54.016829 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.981813 12957 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.026525 12957 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.029320 12957 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:53.984488 12705 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.033231 10241 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:15:54.037600 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 160277us
I20260709 13:15:54.044862 10249 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:54.045387 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:54.046763 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:53.991931 12763 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.052986 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80938.1us
W20260709 13:15:54.076485 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 177094us
I20260709 13:15:54.076879 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:54.081445 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:53.995347 12946 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:15:54.090663 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:54.082324 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 94685.9us
I20260709 13:15:54.076210 12951 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:54.105019 10213 leader_election.cc:336] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.897s (SENT)
I20260709 13:15:54.108124 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:54.109143 10244 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:54.087061 12838 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:15:54.053676 12949 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:54.082901 12756 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:54.111671 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.118647 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.120070 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:54.123889 10248 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.125770 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:54.127152 12823 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:54.127833 12965 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:54.128312 12965 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.128692 12965 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:54.076243 12763 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.152683 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:54.121013 12951 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:54.145267 12821 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:54.163925 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.159204 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:54.167068 12962 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:54.151115 12756 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:54.168525 12763 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.219677 10245 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
W20260709 13:15:54.230505 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.206190 12616 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:54.106330 12675 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:54.187283 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 209706us
I20260709 13:15:54.154588 12823 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:54.230304 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 130002us
I20260709 13:15:54.185401 10249 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
W20260709 13:15:54.240545 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.230612 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 132680us
I20260709 13:15:54.150656 12901 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.184958 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.240360 10249 pending_rounds.cc:85] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:15:54.259034 10249 pending_rounds.cc:107] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:15:54.259171 10244 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:15:54.259358 10249 raft_consensus.cc:2889] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.259716 10244 pending_rounds.cc:85] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 9
I20260709 13:15:54.260015 10244 pending_rounds.cc:107] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:15:54.260267 10244 raft_consensus.cc:2889] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.259219 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:54.261124 10246 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:15:54.262293 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 180933us
I20260709 13:15:54.220636 12846 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.264307 10248 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:54.268091 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:54.235359 12876 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.271409 10245 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:54.272214 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:54.273826 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.280987 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.291981 10246 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:15:54.295732 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:54.296465 10249 raft_consensus.cc:2410] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:54.261917 12901 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.284921 12705 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.312008 12823 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.287727 12951 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.316218 10250 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:54.305469 12756 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.294572 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:54.317433 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:54.320302 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.323853 10999 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:54.327771 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49460.8us
I20260709 13:15:54.325367 12784 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:15:54.331187 12795 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:15:54.335800 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.338773 10145 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.339977 12675 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.340296 12968 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:54.340777 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.341986 12901 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.342582 12967 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:54.342962 10145 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.344938 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:54.345597 10398 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:54.355724 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.340808 12968 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.367239 12968 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.370666 12846 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.358501 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:54.371526 12846 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.372741 10993 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:54.322769 12705 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.375761 12705 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.362505 12838 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.376564 12838 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.379033 12838 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.364174 12719 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.365036 12974 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.379962 12719 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.380124 12974 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:54.380719 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 52251.7us
I20260709 13:15:54.381660 12795 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:54.382594 12719 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.383072 12974 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.365226 12876 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.366150 12973 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.383765 12876 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.383958 12973 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.386253 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:54.385876 12876 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.395277 10398 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:54.390407 12973 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.404011 12966 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:54.404690 12966 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:15:54.407868 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.409679 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 75615.5us
I20260709 13:15:54.413690 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:54.417218 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 87356.2us
I20260709 13:15:54.419044 10999 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:54.421088 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:54.423283 10247 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:15:54.423768 10247 pending_rounds.cc:85] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:15:54.424072 10247 pending_rounds.cc:107] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:54.424340 10247 raft_consensus.cc:2889] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.427474 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:54.428844 12766 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.421802 10317 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:54.433082 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.434022 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:54.434739 10319 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:54.443070 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.443796 10398 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:54.431803 10145 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:54.451859 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.447846 10145 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 4, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:54.453686 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.451179 12494 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.455639 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:54.455757 12494 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.456552 10324 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:54.458333 12494 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.460598 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:54.452098 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.463009 10394 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:54.468765 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.469785 10398 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:54.465669 10145 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:54.480152 10213 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.951s (SENT)
I20260709 13:15:54.480233 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:54.480574 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.481063 10999 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:54.484926 10395 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:54.496233 10391 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:54.493819 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:54.498647 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:54.451457 12973 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.482635 12821 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.488253 10145 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 5, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 5 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:15:54.506940 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 85540.4us
I20260709 13:15:54.471509 12846 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.466572 12967 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:15:54.508143 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 84875.7us
I20260709 13:15:54.503409 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:54.482724 12901 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.482488 12616 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:54.515829 10394 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:54.487498 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:54.529036 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 62979.9us
I20260709 13:15:54.531388 10145 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 4, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:15:54.512095 12838 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:54.551471 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.528558 12846 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:54.560920 12846 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.561381 12846 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.528264 12901 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.567556 12766 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.568374 12901 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.539026 12705 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:15:54.570832 10145 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.515046 12821 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:54.574807 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.576122 12821 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.575599 10146 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 206) took 3576 ms. Trace:
I20260709 13:15:54.539243 12860 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.578020 12860 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.580181 12860 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.582201 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:54.582940 10394 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:54.586433 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51980.1us
I20260709 13:15:54.587702 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.588289 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.588658 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.589552 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.589987 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.590787 10399 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 2.
W20260709 13:15:54.594506 10213 leader_election.cc:336] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.005s (SENT)
I20260709 13:15:54.514024 12973 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.542665 12838 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:54.461833 12966 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.595314 12951 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:54.576594 10146 rpcz_store.cc:276] 0709 13:15:50.999191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.999388 (+   197us) service_pool.cc:224] Handling call
0709 13:15:54.575517 (+3576129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:52.683214 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:52.683762 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:52.683801 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:15:52.683826 (+    25us) tablet.cc:662] Decoding operations
0709 13:15:52.684855 (+  1029us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:52.684944 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:52.684961 (+    17us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:15:52.685901 (+   940us) tablet.cc:701] Row locks acquired
0709 13:15:52.685967 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:15:52.686194 (+   227us) write_op.cc:270] Start()
0709 13:15:52.686425 (+   231us) write_op.cc:276] Timestamp: P: 1783602952686089 usec, L: 0
0709 13:15:52.686478 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:15:52.813826 (+127348us) log.cc:844] Serialized 5891 byte log entry
0709 13:15:53.417870 (+604044us) op_driver.cc:464] REPLICATION: finished
0709 13:15:53.903916 (+486046us) write_op.cc:301] APPLY: starting
0709 13:15:53.904022 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:53.904360 (+   338us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:53.904490 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:54.026767 (+122277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:54.027134 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:15:54.027177 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:54.048695 (+ 21518us) log.cc:844] Serialized 107 byte log entry
0709 13:15:54.048929 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:54.049140 (+   211us) write_op.cc:454] Released schema lock
0709 13:15:54.049230 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:54.049682 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:54.049713 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":571,"reported_tablets":24,"spinlock_wait_cycles":181760,"child_traces":[["op",{"apply.queue_time_us":485679,"apply.run_cpu_time_us":5720,"apply.run_wall_time_us":145739,"num_ops":15,"prepare.queue_time_us":43969,"prepare.run_cpu_time_us":19119,"prepare.run_wall_time_us":178911,"raft.queue_time_us":212388,"raft.run_cpu_time_us":36254,"raft.run_wall_time_us":387822,"replication_time_us":702325,"thread_start_us":526492,"threads_started":4,"wal-append.queue_time_us":104495}]]}
I20260709 13:15:54.603788 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.594214 12756 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:54.610188 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.527573 12968 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.604847 12838 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.622422 10394 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:54.623153 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.623843 12990 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:54.622668 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.628043 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.632253 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 112008us
I20260709 13:15:54.633433 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:54.611467 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71135.3us
I20260709 13:15:54.637109 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:54.624540 12968 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.640166 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:54.663218 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.663388 12838 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.664149 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:54.664605 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:54.664817 10244 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:54.665582 12838 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.666505 12977 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:54.665916 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.667303 12959 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.667691 12993 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.667886 12959 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.669199 10290 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.672168 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:54.672523 12993 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:54.672884 10249 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:54.640430 12876 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.624864 12773 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.683302 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:54.685575 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:54.675393 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:54.675248 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 119389us
W20260709 13:15:54.689477 10213 leader_election.cc:336] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.061s (SENT)
W20260709 13:15:54.690449 10213 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.152s (SENT)
I20260709 13:15:54.690796 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:54.691943 10213 leader_election.cc:336] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.672s (SENT)
I20260709 13:15:54.692358 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.692461 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:54.677664 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:54.693081 10399 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:54.693768 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52802.9us
I20260709 13:15:54.693861 10319 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:54.695753 12616 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.695932 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:54.696417 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:54.696503 12616 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:54.697242 10319 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:54.695442 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.698009 10320 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:54.698149 12713 raft_consensus.cc:2764] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:15:54.699590 12990 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:54.699424 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:54.700310 12990 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.700549 10324 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:54.677213 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:54.703224 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.706939 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.707679 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:54.622457 12846 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.708309 10246 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.642191 12719 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:54.677254 12838 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:54.677924 12965 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.004s
I20260709 13:15:54.664165 12705 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.710593 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:54.703593 12876 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.679636 12959 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:54.720607 10324 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:54.722030 12982 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:15:54.727231 12957 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:54.726344 12993 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:54.744858 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:54.745867 10319 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:54.717594 12838 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:54.759727 12838 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.720036 12965 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.716776 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:54.719833 12719 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:54.767094 12957 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.767620 12957 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:54.784257 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 57722.6us
W20260709 13:15:54.805348 12999 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:15:54.847921 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 3.342s (SENT) [suppressed 61 similar messages]
I20260709 13:15:54.845052 10246 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:54.858150 10249 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:54.845647 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.780156 12616 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:15:54.850548 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 133266us
W20260709 13:15:54.851477 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.863162 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.859607 10399 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:54.876986 12795 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:54.869401 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:54.881151 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.881928 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 140510us
W20260709 13:15:54.882784 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.885627 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.888957 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.896008 12838 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:54.896498 10323 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:54.899818 12719 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.902990 10325 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:54.904363 12974 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:54.904856 12763 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:54.905526 12763 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:54.906473 12763 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:54.913538 10316 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:54.912756 12838 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:54.933547 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48948.5us
I20260709 13:15:54.935009 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.859959 12700 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:15:54.946252 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:54.948383 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:54.949095 10396 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
W20260709 13:15:54.948028 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 86386.5us
I20260709 13:15:54.915275 12973 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.955396 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:54.958729 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:54.957228 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:15:54.973737 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 84851.7us
I20260709 13:15:54.948920 12705 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.955260 12965 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:54.969875 12959 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.985759 12756 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:54.977072 12967 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:54.975178 12846 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:55.017321 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.040947 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66222us
W20260709 13:15:55.046664 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 88055.4us
W20260709 13:15:55.047914 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 172020us
I20260709 13:15:55.000273 12784 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:55.049753 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.054083 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:55.058068 12756 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:55.068269 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.069628 10993 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:55.063062 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:15:55.073971 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.059556 12756 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.098430 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.071085 12973 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.069434 12784 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:55.091321 12846 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.092610 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.128597 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:55.120642 12924 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 13:15:55.139552 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:55.141386 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:55.119681 12846 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:55.166512 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.176872 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:55.395558 10316 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.176887 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.125473 12992 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:55.139081 13006 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:55.187054 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64068.3us
I20260709 13:15:55.187626 12860 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:55.119985 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:55.301631 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.310165 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:55.311172 12997 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.557s	user 0.007s	sys 0.001s
W20260709 13:15:55.402364 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 307336us
I20260709 13:15:55.311962 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.416067 10391 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.312160 10399 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:15:55.312779 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 130583us
I20260709 13:15:55.417663 10394 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:55.314404 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 173013us
I20260709 13:15:55.139681 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.326751 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.181253 12784 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.341132 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:55.325726 13017 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:15:55.413347 12957 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.006s
I20260709 13:15:55.318701 12705 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:55.390049 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:55.316820 12974 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:55.342386 13014 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.094686 12993 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:15:55.446985 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.428663 10250 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:55.354825 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.433708 10390 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:55.400821 12992 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:55.413663 12846 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.442989 10245 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:15:55.445472 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.400110 12675 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.412839 12860 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:55.431356 13001 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.496s	user 0.005s	sys 0.005s
I20260709 13:15:55.428259 10995 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:55.442276 13006 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:55.515040 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:55.539577 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.516243 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.557164 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.572806 10394 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:55.446406 12957 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.505564 12860 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:55.509127 12705 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:15:55.480890 13014 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.620512 10993 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:55.498836 12675 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:55.617053 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 215270us
I20260709 13:15:55.629879 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.632042 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 521) took 1223 ms. Trace:
I20260709 13:15:55.653512 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:15:55.631655 13016 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:15:55.659806 13010 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:15:55.660269 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.660741 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.668720 10392 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.663682 12766 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:55.634753 10243 rpcz_store.cc:276] 0709 13:15:54.393049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.393179 (+   130us) service_pool.cc:224] Handling call
0709 13:15:54.405689 (+ 12510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.464498 (+ 58809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.464532 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.464995 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.638261 (+173266us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:54.638307 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.638381 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.904966 (+266585us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:55.310827 (+405861us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b2400115088. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a3a09d 00007f58c366c10e 00007f58c368388c 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221
0709 13:15:55.615711 (+304884us) raft_consensus.cc:1685] finished
0709 13:15:55.615740 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.615933 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32955,"raft.queue_time_us":63483,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":10866,"spinlock_wait_cycles":125925888,"thread_start_us":125015,"threads_started":1,"wal-append.queue_time_us":185251}
W20260709 13:15:55.675511 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 255611us
I20260709 13:15:55.678021 10390 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:55.677651 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:55.672245 10391 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:55.679863 10394 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:55.680282 10394 pending_rounds.cc:85] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 5
I20260709 13:15:55.680498 10394 pending_rounds.cc:107] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:55.680747 10394 raft_consensus.cc:2889] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:55.680784 10318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.062s	sys 0.066s
W20260709 13:15:55.681524 10318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.063s	sys 0.066s
I20260709 13:15:55.695238 10316 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:55.697448 10213 leader_election.cc:400] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:15:55.697853 10213 leader_election.cc:403] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:55.698272 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:55.700495 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:55.704083 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:55.704675 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:55.705436 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:55.708228 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:55.709615 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:55.709956 10249 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:55.710403 10246 raft_consensus.cc:2410] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:55.699731 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:55.715505 10244 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:55.708485 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:55.722771 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:55.723701 10248 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:15:55.732544 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:55.675644 12766 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:55.745167 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.749912 10390 raft_consensus.cc:2368] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:15:55.720297 12838 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:55.735428 13026 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
W20260709 13:15:55.749591 12876 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.018s	user 0.020s	sys 0.002s
I20260709 13:15:55.697423 12974 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:15:55.775048 12876 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:55.786973 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.787101 12992 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:55.730850 13006 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:55.796200 12973 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:15:55.810269 10396 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:55.811499 13027 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:15:55.803037 12876 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:55.836668 10397 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:55.803396 12766 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.838471 12766 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.811956 13000 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:55.843884 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.827988 12973 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.832633 12992 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:15:55.842429 12957 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:55.869974 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 211850us
I20260709 13:15:55.854504 13007 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:55.891485 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.856369 12719 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:55.887771 13025 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:15:55.886955 13030 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:55.897961 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 419) took 1006 ms. Trace:
I20260709 13:15:55.898458 10318 rpcz_store.cc:276] 0709 13:15:54.891417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.891538 (+   121us) service_pool.cc:224] Handling call
0709 13:15:54.891969 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.920879 (+ 28910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.920909 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.941925 (+ 21016us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.682011 (+740086us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:55.716543 (+ 34532us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.716781 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.716899 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.897743 (+180844us) raft_consensus.cc:1685] finished
0709 13:15:55.897761 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.897903 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29041,"prepare.queue_time_us":34217,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":134213,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":7868,"thread_start_us":704840,"threads_started":1,"wal-append.queue_time_us":805650}
I20260709 13:15:55.902740 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.908159 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:55.909046 10999 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:15:55.908871 10324 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.860093 13045 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.911700 13045 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:55.912614 13022 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:15:55.920019 13013 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.530s	user 0.000s	sys 0.011s
I20260709 13:15:55.897557 12719 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.927491 12978 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:55.928079 12978 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:55.930328 12978 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:55.932194 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:55.933820 10391 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:55.980952 10392 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:55.982076 10396 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:55.984398 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.998979 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 299294us
I20260709 13:15:56.000936 10393 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:15:56.001466 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.001556 10250 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:56.002164 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.003751 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:56.004514 10247 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:56.007565 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 413) took 1261 ms. Trace:
I20260709 13:15:56.009931 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.007601 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:56.010756 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.010275 10319 rpcz_store.cc:276] 0709 13:15:54.745012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.855618 (+110606us) service_pool.cc:224] Handling call
0709 13:15:54.872826 (+ 17208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.918178 (+ 45352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.918210 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.926427 (+  8217us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.053035 (+126608us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:55.415989 (+362954us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.425610 (+  9621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.426168 (+   558us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.919490 (+493322us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b2400180ed8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a3a09d 00007f58c366c10e 00007f58c368388c 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221
0709 13:15:55.935194 (+ 15704us) raft_consensus.cc:1685] finished
0709 13:15:55.983796 (+ 48602us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.004935 (+ 21139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24835,"prepare.queue_time_us":394678,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":21528,"spinlock_wait_cycles":14886656,"thread_start_us":391989,"threads_started":2,"wal-append.queue_time_us":155347}
I20260709 13:15:55.993117 12838 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.015777 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.016110 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.016427 10322 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:15:56.013631 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.020546 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.007869 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:56.022912 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.023649 10321 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.024163 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.022846 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.022462 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.025969 10316 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:56.026288 13047 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.027004 13002 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.027361 13035 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:15:56.027580 13002 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.028081 12973 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.028805 12973 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.029289 12973 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:55.984795 12860 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.030247 12973 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.008710 12675 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:56.032331 12860 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:56.029973 13002 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:56.035540 10390 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:15:56.001895 12719 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:56.022076 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 368962us
I20260709 13:15:56.054145 13045 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:56.054663 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:56.060050 10993 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.059744 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.024003 12756 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:56.086277 10999 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:56.090405 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:56.096151 10993 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:56.098356 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.109072 10250 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:56.014550 13000 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:15:56.094583 10362 connection.cc:256] RPC call timeout handler was delayed by -2.7141555739999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 13:15:56.093693 12846 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
W20260709 13:15:56.138999 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 116212us
I20260709 13:15:56.054656 12838 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.148056 10999 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:56.149197 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.167312 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.170832 10316 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:56.171810 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:56.154645 10362 connection.cc:256] RPC call timeout handler was delayed by -1.48605145800002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
I20260709 13:15:56.088207 12957 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:15:56.162341 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:56.091602 12966 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:15:56.177740 10999 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:56.173211 10242 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:15:56.179324 10243 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.180576 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.183548 10317 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:56.140048 12719 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.187256 10242 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:56.190465 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:56.191423 10318 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:15:56.191520 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.138413 13049 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.202625 10316 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:56.167475 12978 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:56.240108 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.243466 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.207630 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.141865 12965 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:15:56.201315 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.230921 10317 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:15:56.247685 10324 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:56.144819 12846 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.144219 13032 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:15:56.269325 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.195892 13014 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:56.197970 12795 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.188556 12616 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:15:56.308066 10322 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:15:56.311636 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.192790 13021 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:15:56.199254 12713 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:15:56.318836 10316 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:15:56.320091 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 123889us
I20260709 13:15:56.265869 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:56.322846 10320 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:56.322050 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.324432 10316 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:56.328372 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:56.245388 12968 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:15:56.312839 12700 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.331810 10242 raft_consensus.cc:2410] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:56.332144 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.322540 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:56.331584 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:56.332033 10999 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:56.258170 12978 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.330528 12971 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.341861 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.331449 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:56.330660 10997 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
W20260709 13:15:56.381047 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 189256us
I20260709 13:15:56.389628 13021 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:56.380883 13012 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.313700 13039 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.272s
I20260709 13:15:56.320871 12795 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.332031 12960 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:15:56.415369 10967 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:56.398664 10995 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:15:56.444796 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 237255us
I20260709 13:15:56.446221 12766 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:56.444945 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 99890.8us
I20260709 13:15:56.451640 10317 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:56.452018 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:56.452018 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:56.468019 10317 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:56.470310 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.469732 13006 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:15:56.473805 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 55893.8us
W20260709 13:15:56.459012 13060 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:15:56.479417 13054 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:56.451510 12766 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.465610 12616 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.457832 12700 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:56.493777 13064 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:15:56.494079 12795 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:56.493906 13055 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:15:56.500085 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:56.488554 12766 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.501567 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:56.501899 13047 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.480973 13021 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:56.507395 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:56.491379 13054 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:56.500556 13012 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:15:56.502516 13056 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:15:56.499722 12846 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:56.514822 12978 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:56.515543 13058 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:15:56.502481 13006 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:15:56.516049 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54badd91404d4f7894752c8769345dca"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:56.502769 12960 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:56.527695 10395 raft_consensus.cc:606] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
W20260709 13:15:56.541472 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.542326 10324 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:15:56.544271 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.546567 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.552265 13012 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.561836 13078 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.562337 13003 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:56.563009 13003 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.563743 13054 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.564956 10243 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:15:56.574927 12616 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:56.575690 12616 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.576162 12616 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.578397 13067 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:15:56.579058 13078 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:56.579438 13078 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:56.580332 13078 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.581646 13078 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:56.585170 13083 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.585781 13083 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.586552 13076 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.587301 13076 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:56.588299 13083 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:56.564795 12700 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.595201 12766 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.571803 12978 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:15:56.614359 12978 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:56.614899 12978 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:56.616032 12978 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.578161 12616 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:56.617740 12978 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:56.622723 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 115439us
I20260709 13:15:56.624830 13003 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:56.623936 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.627712 12616 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:56.628114 12616 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.628450 12616 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.643211 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.645382 13067 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.645800 13067 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.646167 13067 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.648065 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:56.588264 13076 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.649479 13081 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:56.651086 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:56.654688 13081 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:56.655135 13081 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.655498 13081 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.636030 12960 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:56.644187 12616 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.668637 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:56.671205 12838 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:56.689249 13038 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:56.683806 13009 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:56.692155 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 817938us
I20260709 13:15:56.692386 13009 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.693675 12992 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:56.693073 13006 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.695890 13009 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:56.694950 12860 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:56.697211 12860 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:56.698122 12860 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.698772 10250 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:56.699388 12860 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:56.700481 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.701370 13050 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:56.734920 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:56.739472 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:56.670557 12960 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.693186 12766 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:56.681749 13081 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.767017 13051 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:56.739073 13045 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.773221 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.702021 13050 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:56.830880 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.804780 12838 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:56.833647 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 179589us
I20260709 13:15:56.693280 13038 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.843627 13081 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:56.850124 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.860435 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:15:56.858769 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 127657us
W20260709 13:15:56.826347 13086 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:15:56.868655 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:56.869349 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:56.872228 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:56.874629 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:56.848961 13046 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:56.876483 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:56.859148 13053 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:56.868191 13090 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.879359 13081 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:56.870415 12973 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:56.848434 13045 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.865348 12960 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:56.876579 13097 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:56.894937 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.895478 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:56.888576 12993 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.897708 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:15:56.848508 13051 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.879585 13046 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:56.884546 12616 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:56.905774 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.906651 10316 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.907265 10323 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:56.908387 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:56.908939 10323 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.866484 12838 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.911123 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:56.921844 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.910315 13046 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.947757 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:56.948968 10244 raft_consensus.cc:2410] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:15:56.935420 13071 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:15:56.904822 12973 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.901510 13091 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:15:56.889330 13067 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.962852 10316 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:56.969092 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:56.974545 13104 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:56.975871 13104 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:56.976295 13104 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.988287 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:56.983412 13100 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:56.961783 13105 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:15:57.007893 13050 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:56.904585 13097 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:56.885135 13053 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:56.910773 12993 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.031334 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:15:57.019943 13038 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:57.042855 13095 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 13:15:57.008677 13088 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 13:15:57.044751 13088 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:57.045184 13088 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:57.046550 13018 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:57.050657 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1376) took 1050 ms. Trace:
I20260709 13:15:57.051625 13067 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:57.052037 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.052640 13051 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:57.053263 13101 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:15:57.051095 10245 rpcz_store.cc:276] 0709 13:15:55.999808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.999967 (+   159us) service_pool.cc:224] Handling call
0709 13:15:56.013713 (+ 13746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.693762 (+680049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.693800 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.694316 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.772916 (+ 78600us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:56.848337 (+ 75421us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.864670 (+ 16333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.864748 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.050383 (+185635us) raft_consensus.cc:1685] finished
0709 13:15:57.050404 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.050586 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689937,"prepare.queue_time_us":75459,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":699059,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":13215616,"thread_start_us":78199,"threads_started":1,"wal-append.queue_time_us":138412}
I20260709 13:15:57.055541 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:57.061295 13097 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.064931 13018 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:57.065889 12993 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.066457 10324 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:15:57.066004 13018 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.068225 13053 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:57.068746 13102 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.222s	user 0.002s	sys 0.001s
W20260709 13:15:57.070753 13107 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:57.071797 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.074098 10323 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:57.050539 13045 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.007622 13100 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.046125 13088 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.136296 13104 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.134078 13012 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:57.142450 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.142606 13012 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.144990 13012 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.145991 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.146700 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:57.147334 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.148725 10250 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:15:57.149077 10250 pending_rounds.cc:85] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:15:57.149290 10250 pending_rounds.cc:107] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:15:57.149499 10250 raft_consensus.cc:2889] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.149583 11001 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:57.141088 13078 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.002s
I20260709 13:15:57.146157 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 424) took 2013 ms. Trace:
I20260709 13:15:57.151122 11000 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:57.151296 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2039) took 1152 ms. Trace:
I20260709 13:15:57.151705 10318 rpcz_store.cc:276] 0709 13:15:55.998651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.998779 (+   128us) service_pool.cc:224] Handling call
0709 13:15:57.151118 (+1152339us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001bbf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:57.151231 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415815552}
I20260709 13:15:57.154281 13104 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.154661 12973 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.154407 10398 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:57.159791 13011 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:57.160792 13093 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:15:57.160516 13011 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.164556 13011 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.165843 10250 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:15:57.166404 10250 pending_rounds.cc:85] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:15:57.166947 10250 pending_rounds.cc:107] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:15:57.167528 10250 raft_consensus.cc:2889] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.150925 10320 rpcz_store.cc:276] 0709 13:15:55.132366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.132507 (+   141us) service_pool.cc:224] Handling call
0709 13:15:55.132832 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.326565 (+1193733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.145919 (+819354us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001879d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:57.146103 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2734952704}
W20260709 13:15:57.154310 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.147891 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.178941 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.203943 10394 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:57.174698 13035 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.175045 13078 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:15:57.208086 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 304835us
I20260709 13:15:57.287894 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:57.261843 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.241786 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:57.271930 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.267994 13081 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.280175 10397 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:57.181376 13067 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.183363 12978 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:57.295419 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.306653 10392 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:15:57.307621 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 178356us
I20260709 13:15:57.269778 13046 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.240983 13000 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.307540 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:57.312629 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:57.243623 13057 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:57.322068 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.322968 10392 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:57.306144 13006 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.350030 10245 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:57.296132 13104 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:57.370004 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 57502.1us
I20260709 13:15:57.371340 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.372675 10393 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:57.309101 13067 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.296273 13078 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.309674 12978 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.294162 13035 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.317984 13045 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:57.346823 13057 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:57.380386 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 548) took 1204 ms. Trace:
I20260709 13:15:57.395162 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:57.430255 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.369232 13104 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:57.372372 13006 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.321167 13000 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.440109 10399 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.441720 10397 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:15:57.378099 13105 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:57.373942 13051 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:57.348121 13097 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:15:57.442771 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:57.440922 13104 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.451429 13006 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.431789 13091 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:57.427157 13045 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.454694 10393 raft_consensus.cc:2410] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:57.448988 10392 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.430187 10248 rpcz_store.cc:276] 0709 13:15:56.175563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.175947 (+   384us) service_pool.cc:224] Handling call
0709 13:15:56.176269 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.176533 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:57.176273 (+999740us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b18003bae80. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c74e03c7 00007f58c3af29a7 00007f58c3b020bf
0709 13:15:57.176409 (+   136us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.379892 (+203483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.379974 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:57.380045 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.380140 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.380309 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158350,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":596,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2965,"spinlock_wait_cycles":11419904,"thread_start_us":397275,"threads_started":2}
I20260709 13:15:57.440750 12705 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:57.441526 12992 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.464104 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:57.467900 13105 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.467728 12784 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:57.468500 13046 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.469094 10392 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:57.442082 13100 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.445245 13051 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.469298 12860 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:57.456519 13045 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.466719 12705 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.469023 13000 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.452339 13091 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.471527 13114 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:15:57.488667 12705 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:57.489194 12860 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:57.532888 12860 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.495226 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:57.512507 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.537411 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:57.505631 13057 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.540153 13057 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:57.489542 13051 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.541314 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:57.512841 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.516883 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:57.486129 10399 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:57.512109 13067 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.522912 13078 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:57.543213 10996 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:15:57.580328 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:57.527539 10393 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:57.501715 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.535549 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:57.577610 13000 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:57.589664 10213 connection.cc:256] RPC call timeout handler was delayed by -3.1945026799999141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:15:57.590592 10213 connection.cc:256] RPC call timeout handler was delayed by -3.1945026799999141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:15:57.591069 10213 connection.cc:256] RPC call timeout handler was delayed by -3.1696228670000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:15:57.591523 10213 connection.cc:256] RPC call timeout handler was delayed by -3.0723228720000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:15:57.506824 13118 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:57.599272 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.508805 13091 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:15:57.600586 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.603235 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.604872 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:57.609051 13104 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.530987 13045 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.610692 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.523613 12978 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:57.613775 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.621579 10993 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:57.623207 10993 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:57.523478 12838 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.511085 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.574461 13011 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:15:57.502686 13035 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.621444 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.631421 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.632083 10395 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:57.633024 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.593807 12846 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:57.634586 12705 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.610139 13119 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:57.638209 12705 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.634181 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.639853 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.619890 13009 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:57.640967 13009 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.641350 13009 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.623528 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:57.618095 12756 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.625533 10993 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.647897 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:57.653452 10996 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:57.665170 10993 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.655169 12756 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.708426 10243 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:57.714598 13104 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.714866 13051 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.736759 12860 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.739930 12860 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.791288 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:57.716789 12756 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.792021 10393 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:57.765836 10993 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:15:57.705576 13126 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:57.794003 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 693) took 1644 ms. Trace:
W20260709 13:15:57.769089 13107 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:15:57.795351 10993 rpcz_store.cc:276] 0709 13:15:56.149997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.177876 (+ 27879us) service_pool.cc:224] Handling call
0709 13:15:56.178170 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.621485 (+1443315us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540034f920. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5fdc0 00007f58c3aea1c0 00007f58c3aeb231 00007f58c3ae7d8f 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c
0709 13:15:57.793700 (+172215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.793944 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638870912}
W20260709 13:15:57.806517 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 214304us
I20260709 13:15:57.795298 12705 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.796087 13051 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.797340 13073 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:57.802691 13011 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.812594 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:57.805253 13108 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.817204 10213 leader_election.cc:336] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 2.220s (SENT)
I20260709 13:15:57.819337 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.823159 13051 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:57.819357 13108 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.826215 13045 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.813483 12705 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:57.831620 10213 connection.cc:256] RPC call timeout handler was delayed by -2.8013412899999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:15:57.833076 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 426) took 1684 ms. Trace:
I20260709 13:15:57.833477 10322 rpcz_store.cc:276] 0709 13:15:56.148728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.169871 (+ 21143us) service_pool.cc:224] Handling call
0709 13:15:56.170222 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.308695 (+138473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.832833 (+1524138us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000cc454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:57.833019 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310647552}
I20260709 13:15:57.834921 10322 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:57.832074 10213 connection.cc:256] RPC call timeout handler was delayed by -2.8013412899999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:15:57.817401 13073 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.817305 13011 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:57.850682 10213 connection.cc:256] RPC call timeout handler was delayed by -2.7075513950001096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:15:57.851272 10213 connection.cc:256] RPC call timeout handler was delayed by -2.6810560410001472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:15:57.851739 10213 connection.cc:256] RPC call timeout handler was delayed by -2.6806254580001223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:15:57.852094 10213 connection.cc:256] RPC call timeout handler was delayed by -2.6393468989999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 13:15:57.852527 10213 connection.cc:256] RPC call timeout handler was delayed by -2.5648228669999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2544s for a response
W20260709 13:15:57.853216 10213 connection.cc:256] RPC call timeout handler was delayed by -2.2883530799999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:15:57.854054 10213 connection.cc:256] RPC call timeout handler was delayed by -2.0039530799999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:15:57.854635 10213 connection.cc:256] RPC call timeout handler was delayed by -2.0039530799999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:15:57.855156 10213 connection.cc:256] RPC call timeout handler was delayed by -1.6733423069999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:15:57.852511 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:15:57.859833 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.867233 13073 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:57.873288 13096 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.030s	user 0.000s	sys 0.004s
I20260709 13:15:57.878461 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.884208 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.886807 10213 leader_election.cc:400] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:15:57.887686 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.888263 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1380) took 1753 ms. Trace:
I20260709 13:15:57.890897 12860 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.891906 13011 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.892305 13108 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.893410 12705 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.894275 10319 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.888578 10247 rpcz_store.cc:276] 0709 13:15:56.134664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.134857 (+   193us) service_pool.cc:224] Handling call
0709 13:15:56.135286 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.695662 (+560376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.695696 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.696225 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.770524 (+ 74299us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:56.770595 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.770693 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.872501 (+1101808us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:57.883112 (+ 10611us) raft_consensus.cc:1685] finished
0709 13:15:57.883138 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.888196 (+  5058us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559934,"raft.queue_time_us":561099,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":36119936,"thread_start_us":73881,"threads_started":1,"wal-append.queue_time_us":146913}
I20260709 13:15:57.899657 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2104) took 1004 ms. Trace:
I20260709 13:15:57.884996 13051 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:57.900065 10324 rpcz_store.cc:276] 0709 13:15:56.894991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.895168 (+   177us) service_pool.cc:224] Handling call
0709 13:15:57.899477 (+1004309us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003ec1d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:57.899600 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377586048}
I20260709 13:15:57.890205 13045 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.899124 12860 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:15:57.896428 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.908290 13045 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.908864 13104 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.910909 10391 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:57.911451 13061 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.512s	user 0.002s	sys 0.001s
W20260709 13:15:57.912175 13137 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:15:57.913111 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1373) took 2204 ms. Trace:
I20260709 13:15:57.917423 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1375) took 2199 ms. Trace:
I20260709 13:15:57.919720 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 1956) took 2079 ms. Trace:
I20260709 13:15:57.920137 10396 rpcz_store.cc:276] 0709 13:15:55.840096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.840249 (+   153us) service_pool.cc:224] Handling call
0709 13:15:55.981800 (+141551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.982552 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.919500 (+1936948us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003b9cd0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:57.919638 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288205056}
I20260709 13:15:57.913529 10241 rpcz_store.cc:276] 0709 13:15:55.709048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.709208 (+   160us) service_pool.cc:224] Handling call
0709 13:15:55.737534 (+ 28326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.881963 (+144429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.882011 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.008493 (+126482us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.189015 (+180522us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:56.189056 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.189128 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.910860 (+1721732us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:15:57.912789 (+  1929us) raft_consensus.cc:1685] finished
0709 13:15:57.912812 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.913030 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":950793,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":9185152,"thread_start_us":306856,"threads_started":2,"wal-append.queue_time_us":297994}
I20260709 13:15:57.924300 12960 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:57.926765 13011 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.927361 13011 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.928514 12846 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:57.929070 12846 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.930389 12965 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:57.931226 12846 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.930968 12965 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.931802 12846 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.933274 12965 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:57.935431 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:57.943825 10324 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:57.946736 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:57.947420 10324 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:15:57.947306 13051 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:57.948454 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:57.941141 12675 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:15:57.949188 13006 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:57.950181 13080 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:57.949620 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:57.917860 10246 rpcz_store.cc:276] 0709 13:15:55.717843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.718005 (+   162us) service_pool.cc:224] Handling call
0709 13:15:55.718439 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.797970 (+ 79531us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:55.810779 (+ 12809us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.677342 (+866563us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b18003aebe0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09c92a6 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1
0709 13:15:56.678573 (+  1231us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b18003aebe0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:15:56.688421 (+  9848us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b18003aebe0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c0975c0a 00007f58ca0b5219 00007f58c79bc58f 00007f58c09fb571 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd
0709 13:15:57.825200 (+1136779us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b18003aebe0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c368823a 00007f58c3af2a2a
0709 13:15:57.877137 (+ 51937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.879887 (+  2750us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.880094 (+   207us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:57.880391 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.880621 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.880715 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.917201 (+ 36486us) raft_consensus.cc:1685] finished
0709 13:15:57.917219 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.917360 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5081,"prepare.queue_time_us":12718,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":116746,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":8554,"spinlock_wait_cycles":409362176,"thread_start_us":128777,"threads_started":2,"wal-append.queue_time_us":2059802}
I20260709 13:15:57.951475 13080 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:57.953926 13080 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:57.954741 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:57.955145 13080 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.955601 12494 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:57.956307 12494 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:57.930099 13011 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:57.959935 10324 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.961948 13009 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:57.965127 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.976289 12756 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:57.994956 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:57.995656 10318 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:15:57.996160 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:57.996559 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:57.996773 10247 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:57.996922 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:57.997677 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:57.996778 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1381) took 1678 ms. Trace:
I20260709 13:15:57.999670 10241 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:58.000036 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:58.000391 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.000612 10247 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.000396 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.002146 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.002779 10318 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.002810 10250 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:58.000716 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.005625 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.006418 10245 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:58.007287 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.006933 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.008160 10243 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:58.009696 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:58.010088 12957 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:15:58.011754 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2101) took 1120 ms. Trace:
I20260709 13:15:58.011905 10245 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:58.012176 10317 rpcz_store.cc:276] 0709 13:15:56.891274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.891415 (+   141us) service_pool.cc:224] Handling call
0709 13:15:56.901767 (+ 10352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.927358 (+ 25591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.927387 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.927434 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:56.927467 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.011534 (+1084067us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b54002bc354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:58.011583 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.011697 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58350336}
I20260709 13:15:58.013562 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.013816 13106 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:58.018280 13032 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:58.018744 13032 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:58.019570 13032 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.020649 13032 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.020702 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.021696 10243 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:58.022403 10318 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:58.022691 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.023304 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.023880 10318 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:15:58.024087 10395 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:58.024729 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.025270 10318 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:15:58.026093 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.026814 10318 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:15:58.027599 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.029112 10318 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:58.033354 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.033639 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2099) took 1743 ms. Trace:
I20260709 13:15:58.000066 10241 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:58.034283 10321 rpcz_store.cc:276] 0709 13:15:56.282607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.501696 (+219089us) service_pool.cc:224] Handling call
0709 13:15:57.154764 (+653068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.162703 (+  7939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.162734 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.163213 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.313499 (+150286us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:57.479551 (+166052us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.479791 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.479869 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.710969 (+231100us) raft_consensus.cc:1685] finished
0709 13:15:57.710997 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.026081 (+315084us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54001bbf50. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:58.026210 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7518,"prepare.queue_time_us":189130,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":10488,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":1624,"spinlock_wait_cycles":1500669056,"thread_start_us":205374,"threads_started":2,"wal-append.queue_time_us":447396}
I20260709 13:15:58.037618 10325 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:58.037885 10316 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:58.032635 10290 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:57.977772 12860 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:57.951025 12846 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:58.044078 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52777.2us
I20260709 13:15:58.052129 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:58.045208 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.043282 10241 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.053172 10241 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:58.043905 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.039541 10324 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:15:58.047674 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 57658.5us
I20260709 13:15:57.998368 10242 rpcz_store.cc:276] 0709 13:15:56.318817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.369094 (+ 50277us) service_pool.cc:224] Handling call
0709 13:15:56.369507 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.702359 (+332852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.702395 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.702904 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.863023 (+160119us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:56.871637 (+  8614us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.977244 (+1105607us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18003aec40. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287 00007f58c3b03208
0709 13:15:57.996391 (+ 19147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.996462 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.996504 (+    42us) raft_consensus.cc:1685] finished
0709 13:15:57.996598 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.996727 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320666,"prepare.queue_time_us":9750,"prepare.run_wall_time_us":1879,"raft.queue_time_us":417124,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":44053,"spinlock_wait_cycles":10160384,"thread_start_us":114611,"threads_started":2,"wal-append.queue_time_us":143969}
I20260709 13:15:58.038425 13011 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.986321 12766 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:15:58.064724 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.071106 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:58.047655 13006 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.105625 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.107129 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 70076.5us
W20260709 13:15:58.110080 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.088243 13035 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.112820 10241 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:58.116573 10241 pending_rounds.cc:85] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 2
I20260709 13:15:58.116829 10241 pending_rounds.cc:107] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:58.117072 10241 raft_consensus.cc:2889] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:58.127555 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75508.8us
I20260709 13:15:58.076824 13011 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.089310 12860 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.115875 13035 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:58.169533 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 104851us
I20260709 13:15:58.095927 13006 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.170823 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:58.152966 12968 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:58.143818 12876 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:15:58.176201 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.178916 10250 raft_consensus.cc:2410] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:58.157146 13149 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.156553 13057 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.185127 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.164597 13035 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.187702 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:58.164244 13152 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:58.193869 10247 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:58.194572 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.199007 10394 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:58.200052 10248 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.192654 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.208119 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.159708 13070 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:15:58.183401 12968 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:58.185988 13014 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.190526 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 96823.8us
W20260709 13:15:58.231796 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.256071 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:58.232318 13144 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:15:58.272886 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.171795 13158 consensus_queue.cc:1059] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:15:58.223528 12756 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.199872 12838 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:15:58.302027 12846 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.288605 13000 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.313830 13157 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.192950 13149 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.320858 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 434) took 1138 ms. Trace:
I20260709 13:15:58.321205 12860 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:15:58.322050 13146 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:15:58.321338 10322 rpcz_store.cc:276] 0709 13:15:57.182739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.835638 (+652899us) service_pool.cc:224] Handling call
0709 13:15:57.842581 (+  6943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.842812 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:57.863270 (+ 20458us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.895975 (+ 32705us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.305969 (+409994us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b1800356c80. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c0975c0a 00007f58ca0b5219 00007f58c09fda40 00007f58c09f84e4 00007f58c09f8455 00007f58c74e03c7 00007f58c3af29a7 00007f58c3b020bf 00007f58c3b02038
0709 13:15:58.306189 (+   220us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.319508 (+ 13319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.319558 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:58.319606 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.319670 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.320779 (+  1109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13755,"prepare.queue_time_us":21295,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":166,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":34747264,"thread_start_us":32063,"threads_started":1,"wal-append.queue_time_us":62000}
I20260709 13:15:58.324443 13006 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.317081 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.310976 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.328593 10399 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:58.331187 13011 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.337312 13157 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:58.347067 13092 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 1.504s	user 0.004s	sys 0.001s
I20260709 13:15:58.347574 13157 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:58.297993 13014 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.350067 13014 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.315605 13000 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:58.363940 10993 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:58.373539 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 228247us
W20260709 13:15:58.375722 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 247068us
I20260709 13:15:58.380192 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:15:58.381033 13151 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:58.389616 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:15:58.390448 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.390559 13009 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.390506 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:15:58.392139 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.398777 13150 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:15:58.401099 13149 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.373659 13000 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.400269 13088 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.411595 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.412652 13009 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.415733 13152 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:58.416301 13152 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.417402 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 519) took 1045 ms. Trace:
I20260709 13:15:58.417843 10391 rpcz_store.cc:276] 0709 13:15:57.371824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.372114 (+   290us) service_pool.cc:224] Handling call
0709 13:15:57.910717 (+538603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.911412 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.417198 (+505786us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002dc150. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:58.417335 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237849344}
I20260709 13:15:58.418911 13152 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.419596 13035 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.421446 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.421725 13035 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.427584 10993 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:58.432832 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:58.435442 13164 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:58.398718 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:58.491103 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 44025.9us
W20260709 13:15:58.483975 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 85336.4us
I20260709 13:15:58.499403 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:58.491148 12705 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.519665 13161 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:58.455083 13162 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:58.557550 13161 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:58.566924 13161 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.544626 13054 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:58.597012 13054 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.602082 13054 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.544224 12705 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:15:58.632957 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 134721us
I20260709 13:15:58.619233 13000 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:58.638249 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 138952us
I20260709 13:15:58.636900 12705 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.649304 13000 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.655421 12838 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:58.655905 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.656876 12838 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.657083 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.657272 12838 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.657637 12838 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.665292 10323 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.665844 10319 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:58.665339 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.668654 10319 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:58.669662 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.671339 10317 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:58.671525 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:58.671717 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.672333 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.672600 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.672890 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.673532 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.673818 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 431) took 1499 ms. Trace:
I20260709 13:15:58.674284 10316 rpcz_store.cc:276] 0709 13:15:57.173977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.174557 (+   580us) service_pool.cc:224] Handling call
0709 13:15:57.899624 (+725067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.038302 (+138678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.672883 (+634581us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003ec1d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:58.673657 (+   774us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54003ec1d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:58.673768 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984281216}
W20260709 13:15:58.674122 10398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1948) took 3041 ms (client timeout 2606 ms). Trace:
I20260709 13:15:58.663067 13035 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:58.675946 10398 rpcz_store.cc:269] 0709 13:15:55.621228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.621497 (+   269us) service_pool.cc:224] Handling call
0709 13:15:57.071632 (+1450135us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:15:58.662634 (+1591002us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b54002de454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:58.662772 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192612992}
I20260709 13:15:58.675468 13119 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:58.677098 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.677757 11001 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:58.677412 13119 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.678211 10993 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.679037 10995 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:58.679527 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.679809 13119 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.680248 10998 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:15:58.673784 10317 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:58.680506 10999 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:58.681658 11000 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:58.675493 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.683001 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.685662 10391 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:58.686271 10391 pending_rounds.cc:85] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 6
I20260709 13:15:58.686570 10391 pending_rounds.cc:107] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:58.686888 10391 raft_consensus.cc:2889] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:58.688555 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.690215 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.703158 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.704523 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.651547 13073 raft_consensus.cc:3055] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:58.706355 10398 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:58.707047 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.708811 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.712129 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.712318 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.712810 10399 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:58.711225 10316 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.717212 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:58.711753 10317 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:15:58.718588 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.718762 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.719718 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.722954 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.723232 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.724746 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.724809 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:15:58.704643 13035 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:58.728037 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.729717 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:58.730433 10993 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:15:58.727667 13081 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.733026 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.733604 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.734164 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.735064 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.735668 10393 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:15:58.736466 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.710855 13073 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:15:58.741277 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.715988 13164 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:58.744040 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.721272 13168 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:58.742776 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 671711us
I20260709 13:15:58.750754 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:58.751181 11002 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:58.746340 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:58.745649 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.752149 10243 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.752501 10248 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:58.740061 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.754920 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.747020 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:58.756494 10246 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.755088 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.758659 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:58.759315 10249 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:58.770430 10394 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:15:58.773768 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:15:58.728220 12967 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:15:58.739434 13009 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.739828 13109 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:58.748749 13046 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.792184 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:58.764719 12860 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.740052 13070 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:58.804982 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:15:58.733141 13035 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.765177 13159 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.816634 10243 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:58.806836 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.771790 13097 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:58.742200 13081 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.750530 13151 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:15:58.843470 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:58.803005 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:58.832024 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:15:58.789515 13045 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:58.776568 13108 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:15:58.856338 10246 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:15:58.772841 13164 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.805842 12860 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:58.845777 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:58.901403 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 55692.2us
I20260709 13:15:58.815860 13100 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.874449 10317 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:58.915693 13100 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:58.900223 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 68085.1us
I20260709 13:15:58.916164 13100 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.917409 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:58.919149 13080 raft_consensus.cc:2764] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:58.919612 13157 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:58.920692 13080 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:58.921087 13080 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:58.922063 13080 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.847762 10392 raft_consensus.cc:606] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:15:58.871824 13097 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.928447 13097 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.909031 13149 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:58.929472 13149 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:58.930768 13149 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.932403 13149 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.834095 13159 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.936951 13159 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.834611 12675 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.937686 13159 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:58.806717 13046 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.942591 13159 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.944217 13046 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:58.801895 13009 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.945246 13159 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.946173 10392 raft_consensus.cc:614] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:58.946597 13009 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:58.947252 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.947547 13104 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.947978 13104 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:58.872913 13051 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.902966 12860 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.948385 13104 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.952452 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 435) took 1767 ms. Trace:
I20260709 13:15:58.952853 10325 rpcz_store.cc:276] 0709 13:15:57.185301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.836711 (+651410us) service_pool.cc:224] Handling call
0709 13:15:57.837038 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.038063 (+201025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.952170 (+914107us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b540021cfd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:15:58.952388 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460867456}
I20260709 13:15:58.941679 13035 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.939980 13164 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:58.936625 12968 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.962472 12968 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:58.964581 12705 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:58.945319 12838 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:58.954053 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:58.972530 10325 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:15:58.803488 13109 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:58.974357 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 200228us
I20260709 13:15:58.979588 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.980937 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:58.979588 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:59.005213 10320 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:59.006937 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:59.011341 10246 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.993933 13091 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:59.014976 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.016422 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.019817 10244 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:59.020510 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.021147 10249 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:15:59.025380 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:59.029737 10250 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.024058 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.040829 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:59.006211 13175 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:59.011161 13065 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:59.048734 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:59.048858 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:59.059867 10999 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
W20260709 13:15:59.060223 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 312205us
I20260709 13:15:59.049837 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:59.061206 10290 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:59.064296 10241 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.065428 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:15:59.009963 13076 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:59.068754 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.062939 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.018919 13051 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:59.078604 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:59.078552 13051 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.025790 13046 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:59.073755 13000 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.074753 12838 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:59.075256 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:59.076081 13065 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:59.080192 13046 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.080973 13065 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:59.076072 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.037428 13091 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.043370 13097 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:59.083914 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:15:59.142583 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 66576us
I20260709 13:15:59.047664 13045 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.047869 13161 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:59.059465 13039 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:59.157390 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.066134 12705 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.068235 13159 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:59.048224 13148 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.165334 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.081394 13065 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.167915 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.177526 10241 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:15:59.154829 13168 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.178943 10247 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:59.158807 13097 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:15:59.169610 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.081359 13051 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.170470 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:15:59.072845 13158 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.093310 13081 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.088032 13109 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.154907 13161 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.057999 13009 consensus_queue.cc:1059] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
W20260709 13:15:59.213871 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 295275us
I20260709 13:15:59.045544 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.154748 13045 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:59.063705 13175 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.183049 13097 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.180578 13168 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.163703 13104 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:15:59.220355 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 157533us
I20260709 13:15:59.180253 13159 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:59.166659 13039 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.224570 13051 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:59.215814 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:15:59.183513 13177 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:59.212110 13161 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.224740 13045 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:59.218196 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 172731us
I20260709 13:15:59.240063 10241 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.244894 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:59.246157 13012 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.246883 13148 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:59.247506 13012 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:59.248004 13012 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.249465 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:15:59.248175 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.252156 13148 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:59.252610 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.228142 13168 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.255766 10996 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:15:59.214934 13100 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.271721 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:59.236248 13051 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:59.224103 13081 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:59.280596 10290 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:15:59.287972 10246 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:59.291179 13179 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:59.292353 12860 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.293685 10243 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:59.302166 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:15:59.303918 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.306455 10249 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:59.311692 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.317436 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.280447 13051 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:59.325500 10967 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.317863 10364 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:59.291173 13186 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:15:59.279899 13046 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.328246 10244 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:15:59.317162 13009 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:59.324380 13178 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:59.310833 13193 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:59.377328 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.331012 12494 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:59.307152 12705 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.359105 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:59.359495 10316 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:59.360105 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:59.359563 10323 raft_consensus.cc:1217] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:15:59.386755 10323 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:59.360771 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:59.363523 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:15:59.360428 13076 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:59.299810 13011 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:59.369165 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.287079 13188 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:15:59.370363 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.279654 13163 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:15:59.353487 13190 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:59.388298 10320 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.388700 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.434810 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.435701 10244 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:15:59.388236 10325 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.347164 13159 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.439668 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:15:59.440343 10249 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:59.371667 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 117796us
I20260709 13:15:59.395087 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:15:59.368299 13078 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:15:59.445039 13078 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:59.445557 13078 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:59.430979 13178 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:59.447471 13178 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.317024 12675 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:15:59.390547 13148 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:15:59.451207 13148 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:59.452472 13191 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:59.441699 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.453675 13193 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:59.354219 13070 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.453817 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.454210 13193 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:15:59.374969 13067 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:59.455116 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:15:59.395282 13011 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.455750 13011 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.455189 13193 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:15:59.468035 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 150291us
I20260709 13:15:59.372684 13032 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:15:59.386018 13009 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:15:59.393750 13046 raft_consensus.cc:2764] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:59.469640 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:15:59.481220 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 111261us
I20260709 13:15:59.532929 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:15:59.487164 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 234888us
I20260709 13:15:59.534361 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.458500 12860 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.540863 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.542562 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.545035 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:15:59.548190 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:15:59.528309 10320 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:15:59.549899 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.551578 10249 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:15:59.555780 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 99617.8us
I20260709 13:15:59.545979 13078 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.560536 13078 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.568881 13011 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.574064 13011 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:59.574805 13194 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:15:59.554419 12876 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:59.586627 13211 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.596014 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 710) took 1412 ms. Trace:
I20260709 13:15:59.596549 10996 rpcz_store.cc:276] 0709 13:15:58.183860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.184922 (+  1062us) service_pool.cc:224] Handling call
0709 13:15:59.595794 (+1410872us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54005d2fd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:15:59.595944 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975598848}
I20260709 13:15:59.598639 13100 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.599481 13100 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:59.599987 13100 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:59.600471 13100 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.600621 13067 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:15:59.601318 13067 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.604817 13065 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.606748 10317 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:15:59.607774 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.614544 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66372.1us
I20260709 13:15:59.613262 13039 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:59.619946 12973 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.620612 12973 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.621462 12860 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.621903 12860 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:59.622313 12860 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.622927 12973 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:59.544150 13181 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:59.630522 13183 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.631036 13183 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.631377 13183 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.645812 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2219) took 1628 ms. Trace:
I20260709 13:15:59.646476 10245 rpcz_store.cc:276] 0709 13:15:58.017091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.017411 (+   320us) service_pool.cc:224] Handling call
0709 13:15:58.017740 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.750742 (+733002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.750798 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.772891 (+ 22093us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.010559 (+237668us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:59.010598 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.010658 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.645471 (+634813us) raft_consensus.cc:1685] finished
0709 13:15:59.645508 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.645719 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":732961,"raft.queue_time_us":723380,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":30092,"thread_start_us":194175,"threads_started":1,"wal-append.queue_time_us":370848}
I20260709 13:15:59.656634 10325 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:15:59.657303 10241 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.552968 13184 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.661159 13119 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:59.556517 13175 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:59.662837 13175 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:15:59.663045 13119 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:59.663496 13119 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:15:59.663335 13175 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.664333 13119 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.632158 13091 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:15:59.665362 13175 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:15:59.665587 13119 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.665913 13091 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.666319 13091 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:15:59.666705 13091 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.667421 13011 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:15:59.667943 13011 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.668663 13097 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.659000 13070 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.658618 12756 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.672003 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.701109 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:15:59.673877 10250 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:59.593977 13012 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:15:59.702663 10245 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:15:59.710096 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 540) took 1018 ms. Trace:
I20260709 13:15:59.671715 13188 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:59.679543 13081 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:59.928602 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.732568 10390 rpcz_store.cc:276] 0709 13:15:58.692177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.692328 (+   151us) service_pool.cc:224] Handling call
0709 13:15:58.692809 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.693100 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:58.716691 (+ 23591us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.717110 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.573039 (+855929us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b18002a7480. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c0975c0a 00007f58ca0b5219 00007f58c369ed70 00007f58c3692293 00007f58c3687cea 00007f58c368823a 00007f58c3af2a2a 00007f58c3b020bf 00007f58c3b02038
0709 13:15:59.622675 (+ 49636us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b18002a7480. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:15:59.709466 (+ 86791us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.709694 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.709752 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:59.709807 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.709881 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.710025 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173729,"prepare.queue_time_us":929264,"prepare.run_cpu_time_us":160,"prepare.run_wall_time_us":2692,"raft.queue_time_us":135519,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2969,"spinlock_wait_cycles":23240320}
I20260709 13:15:59.704809 12675 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.009050 12675 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.672703 13070 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.011178 12675 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:59.665403 13067 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.012645 13070 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:15:59.699282 12756 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:15:59.670169 13011 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:59.683723 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 127206us
W20260709 13:16:00.015909 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:00.016335 13097 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:15:59.794862 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 252392us
I20260709 13:16:00.017465 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:15:59.673341 13164 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.756454 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.022146 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:59.805015 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 446) took 1048 ms. Trace:
W20260709 13:16:00.020043 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 550457us
I20260709 13:16:00.015249 10145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 282) took 6951 ms. Trace:
I20260709 13:16:00.023972 10321 rpcz_store.cc:276] 0709 13:15:58.756805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.756938 (+   133us) service_pool.cc:224] Handling call
0709 13:15:58.775791 (+ 18853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.012196 (+236405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.012227 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.013456 (+  1229us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.277836 (+264380us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:59.291160 (+ 13324us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.301345 (+ 10185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.301430 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.804787 (+503357us) raft_consensus.cc:1685] finished
0709 13:15:59.804809 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.804951 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19788,"prepare.queue_time_us":12638,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":178967,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":20164,"spinlock_wait_cycles":1171968,"thread_start_us":446277,"threads_started":2,"wal-append.queue_time_us":751455}
I20260709 13:16:00.029018 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:15:59.670838 13206 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:16:00.034125 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:15:59.873983 13168 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.003s
I20260709 13:16:00.035209 10245 raft_consensus.cc:2410] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:59.671619 13073 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.038208 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:15:59.874022 13002 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.044432 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.043303 10397 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:16:00.054670 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2228) took 1037 ms. Trace:
I20260709 13:16:00.055254 10243 rpcz_store.cc:276] 0709 13:15:59.017429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.017564 (+   135us) service_pool.cc:224] Handling call
0709 13:15:59.017889 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.294127 (+276238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.054324 (+760197us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000b9ad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:00.054564 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633761152}
I20260709 13:16:00.058432 13012 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.058563 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2222) took 1049 ms. Trace:
I20260709 13:16:00.059191 13012 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:00.059103 10248 rpcz_store.cc:276] 0709 13:15:59.008976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.009107 (+   131us) service_pool.cc:224] Handling call
0709 13:15:59.009451 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.233989 (+224538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.234033 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.234089 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:59.234133 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.058231 (+824098us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540006efd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:00.058324 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.058495 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515812608}
I20260709 13:15:59.818429 13154 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.060578 13154 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.062429 13104 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.062834 13154 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:00.062723 13175 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:00.063730 13175 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.064101 13175 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:00.065026 13175 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.065863 13216 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.066283 13216 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.067196 13216 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.068393 12494 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.068295 13002 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.071164 13002 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.024260 10145 rpcz_store.cc:276] 0709 13:15:53.064128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.070506 (+  6378us) service_pool.cc:224] Handling call
0709 13:16:00.015120 (+6944614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:54.857587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:54.887742 (+ 30155us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:54.887776 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:15:54.887796 (+    20us) tablet.cc:662] Decoding operations
0709 13:15:54.888735 (+   939us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:54.888785 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:54.888826 (+    41us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:15:54.889469 (+   643us) tablet.cc:701] Row locks acquired
0709 13:15:54.889486 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:54.889637 (+   151us) write_op.cc:270] Start()
0709 13:15:54.889757 (+   120us) write_op.cc:276] Timestamp: P: 1783602954889589 usec, L: 0
0709 13:15:54.889779 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:54.977289 (+ 87510us) log.cc:844] Serialized 3238 byte log entry
0709 13:15:55.759029 (+781740us) op_driver.cc:464] REPLICATION: finished
0709 13:15:56.332612 (+573583us) write_op.cc:301] APPLY: starting
0709 13:15:56.335482 (+  2870us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:56.404514 (+ 69032us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:56.418245 (+ 13731us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:56.516517 (+ 98272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:56.516790 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:15:56.516846 (+    56us) write_op.cc:312] APPLY: finished
0709 13:15:56.517151 (+   305us) log.cc:844] Serialized 65 byte log entry
0709 13:15:56.517351 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:56.517485 (+   134us) write_op.cc:454] Released schema lock
0709 13:15:56.517533 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:56.532324 (+ 14791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:56.540850 (+  8526us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":257133,"reported_tablets":36,"spinlock_wait_cycles":23296,"child_traces":[["op",{"apply.queue_time_us":553977,"apply.run_cpu_time_us":4113,"apply.run_wall_time_us":192479,"num_ops":8,"prepare.queue_time_us":244410,"prepare.run_cpu_time_us":4427,"prepare.run_wall_time_us":151534,"replication_time_us":850143,"thread_start_us":438751,"threads_started":2}]]}
I20260709 13:15:59.825074 13051 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.068869 12494 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:00.018170 13164 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.030877 13097 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.672662 13045 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.089944 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2224) took 1075 ms. Trace:
I20260709 13:15:59.737910 13188 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.046592 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:00.085919 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.097415 10246 rpcz_store.cc:276] 0709 13:15:59.014418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.014606 (+   188us) service_pool.cc:224] Handling call
0709 13:15:59.014881 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.288569 (+273688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.076475 (+787906us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540006ead4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:00.089871 (+ 13396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627455872}
I20260709 13:16:00.095202 10393 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:15:59.666533 13009 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.032467 12675 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.099815 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:00.108516 10397 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.085151 13175 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:00.098140 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51611.7us
I20260709 13:16:00.111390 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.111939 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:00.090250 13161 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.829s	user 0.005s	sys 0.005s
I20260709 13:16:00.000236 13183 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.107487 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:00.092523 13073 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.114475 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.115804 10242 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:00.118444 10393 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.099196 13188 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.120638 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:00.120846 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.123013 10391 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:00.042773 13168 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.086827 13207 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:00.104625 13065 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.105242 13104 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.125203 10391 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:00.085309 13091 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.098892 12860 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.109838 13051 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.133309 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.134009 10321 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:00.135587 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.121508 13203 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:00.136365 10321 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:00.136478 10391 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:00.137297 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:00.145113 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.127453 13205 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:00.147573 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.130262 13097 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:00.148276 10321 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:00.148530 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.149328 10324 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:00.156351 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1861081219999505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:16:00.156805 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1735081220001575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:16:00.157932 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1402081220001037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:16:00.158368 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0664081219999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:16:00.158870 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0376081219999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:16:00.116408 12675 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.124178 13046 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:00.166031 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:00.170058 10324 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.160604 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:00.171180 10319 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.167443 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.136808 12756 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.171942 10321 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:00.173035 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:00.173626 10325 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.121738 13161 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.148092 13183 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.197079 13204 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:00.197940 13204 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.199574 12860 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.164572 13205 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:00.205101 10319 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:16:00.158308 13203 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:00.169046 13067 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.172564 13065 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:00.220302 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:00.192457 13011 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.192116 13097 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:00.232124 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:00.233976 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.241421 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:00.242492 10249 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:00.248495 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.227450 13065 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:00.289434 10213 leader_election.cc:336] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.629s (SENT)
I20260709 13:16:00.290138 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:00.291553 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.643s (SENT) [suppressed 3 similar messages]
I20260709 13:16:00.261715 13046 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:00.296834 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 265321us
I20260709 13:16:00.262558 13148 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:00.296063 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 272261us
I20260709 13:16:00.271317 13091 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.304272 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:00.293588 13159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.021s
I20260709 13:16:00.295567 12860 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:00.275020 13204 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.307399 13168 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.309661 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.302552 13045 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.275215 13081 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.314821 13097 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:00.336788 13100 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.733s	user 0.014s	sys 0.000s
I20260709 13:16:00.213003 12494 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.237679 13011 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.321303 10397 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:00.318892 10325 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:00.325553 10393 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:00.331208 13091 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:00.333694 13161 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.349298 13039 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.330736 13148 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.336591 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:00.325069 10324 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:00.332288 13067 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:16:00.333009 13204 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:16:00.335222 13046 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:00.344949 13159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.001s	sys 0.021s
W20260709 13:16:00.372218 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80697.2us
I20260709 13:16:00.344512 13076 consensus_queue.cc:1059] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:16:00.377020 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.302017 13205 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:00.402504 10213 leader_election.cc:336] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.877s (SENT)
I20260709 13:16:00.368093 12675 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.333756 13203 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.377496 13088 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:00.374832 13221 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:00.400141 13119 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.001s
I20260709 13:16:00.351475 13100 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.374709 13039 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.413149 12494 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.416218 13224 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:00.444864 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.449955 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.451474 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.452096 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.452410 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.452159 10245 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:16:00.453047 10249 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:16:00.452536 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.401155 13193 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:00.420274 13220 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:00.458956 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.422569 13088 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:00.459818 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 155621us
I20260709 13:16:00.470201 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:00.470360 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:00.447729 13224 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.479187 10323 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:00.459122 13234 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.457983 13067 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:00.462765 13088 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.423470 13081 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.428960 13221 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.466728 13076 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:16:00.486572 13067 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.508098 10250 raft_consensus.cc:2410] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:16:00.511826 13201 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.974s	user 0.007s	sys 0.005s
W20260709 13:16:00.517242 13223 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:00.544905 13011 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.545782 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 714) took 1829 ms. Trace:
I20260709 13:16:00.546083 13067 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.547220 13067 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.546203 10995 rpcz_store.cc:276] 0709 13:15:58.715976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.730890 (+ 14914us) service_pool.cc:224] Handling call
0709 13:15:58.779590 (+ 48700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.900524 (+120934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.902871 (+  2347us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.914351 (+ 11480us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.053673 (+1139322us) spinlock_profiling.cc:243] Waited 911 us on lock 0x7b1800250de0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:00.285528 (+231855us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:00.294287 (+  8759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.305935 (+ 11648us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.545469 (+239534us) raft_consensus.cc:1685] finished
0709 13:16:00.545494 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.545719 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2374,"raft.queue_time_us":40844,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":36684,"spinlock_wait_cycles":2094976,"thread_start_us":218690,"threads_started":1,"wal-append.queue_time_us":1466914}
W20260709 13:16:00.523566 13225 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:16:00.528870 13039 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.477747 13220 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:16:00.487346 13234 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.558562 13234 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:00.561301 13076 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:00.531272 13221 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.536540 10246 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:00.540916 13175 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:00.543799 13148 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:00.553340 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.561779 13076 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.570456 13175 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.570647 13076 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.499249 13065 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.555789 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.573035 13175 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.574051 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.549364 13204 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:16:00.541251 13045 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:00.505441 13222 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:00.585155 10324 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:00.602526 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:00.563673 13051 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:00.603722 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.582347 13088 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.619117 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:00.619760 10321 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:00.624670 10213 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.712s (SENT)
I20260709 13:16:00.635604 10391 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:00.600099 13045 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.562310 13224 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.609906 13051 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:00.649763 13212 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.776s	user 0.002s	sys 0.000s
I20260709 13:16:00.654369 13088 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.656917 13039 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.657582 13039 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.659437 13164 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.662012 13178 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:00.666388 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.670033 10323 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:00.671718 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:00.641023 13046 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:00.722645 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.732779 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.734362 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:00.735001 10246 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:00.735884 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:00.736516 10246 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.685691 13196 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:00.745085 10248 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.747431 10248 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:00.761878 10244 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.764410 10246 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:00.746485 13196 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.682680 13178 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.741283 13246 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.728976 13070 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:00.728489 12494 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.746840 13100 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.778023 10993 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:00.790277 10995 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:00.792479 13250 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.793247 13250 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.773049 13080 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.775130 13242 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.837396 13243 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:16:00.838806 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 584) took 1182 ms. Trace:
I20260709 13:16:00.839296 10242 rpcz_store.cc:276] 0709 13:15:59.656502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.673978 (+ 17476us) service_pool.cc:224] Handling call
0709 13:15:59.675573 (+  1595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:00.119747 (+444174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.838521 (+718774us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54002eb654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:00.838745 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005092736}
I20260709 13:16:00.845271 13242 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.851567 13039 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.852257 13203 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:00.852862 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.853543 13250 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.857280 13152 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.857971 13152 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.886713 10364 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:00.892607 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 426418us
I20260709 13:16:00.893457 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:00.806927 13164 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:00.896088 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:00.835459 13018 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:00.904649 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:00.855052 13100 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:00.902000 13245 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.907027 13100 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.907635 13245 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.908015 13245 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.909253 13100 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.842963 13249 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.909653 13242 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.780323 13070 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.912366 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:00.799821 12494 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.774493 13246 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.882833 13250 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.899609 13213 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.925067 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:00.910121 13249 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.910213 13242 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:00.936586 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:00.855343 13196 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.910645 13154 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:00.921670 13078 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:00.852869 13203 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.944547 10321 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:00.945385 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 56678.4us
I20260709 13:16:00.903352 13164 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.931149 13240 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:00.939998 13152 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.959008 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:00.959748 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:00.958845 13109 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.971864 13217 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:00.972343 13217 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:00.973270 13217 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.974042 10321 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:00.930949 13088 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:00.975406 13217 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.926983 13157 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:00.977515 13253 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:00.977967 12675 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.978545 12675 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.979398 13253 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:00.979327 12675 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:00.980650 12675 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.983675 13216 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.986995 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.988219 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.988513 13249 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.989382 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.990141 13097 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.989703 13217 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:00.960332 13196 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.932507 13250 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.918264 13018 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:00.943140 13039 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:16:00.944567 13239 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:00.942028 13081 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.938637 13100 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:00.971558 13109 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.027464 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.028090 10247 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:00.979843 13253 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:00.967855 13203 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.967227 13070 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:00.965296 13246 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:00.990223 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:00.991488 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:01.015060 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.999754 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.000422 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.000757 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.001055 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:01.002549 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.010950 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51295.1us
I20260709 13:16:00.996233 13237 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:00.990545 13097 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:01.000136 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.018268 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.009079 13250 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.019620 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.018805 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:01.021116 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.023926 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:01.024212 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:01.024792 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:00.961117 13188 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.832s	user 0.013s	sys 0.000s
I20260709 13:16:01.026340 10245 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:01.029858 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.032771 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.010726 13039 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.036430 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.065603 10243 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:01.065707 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.029682 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.020336 13239 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.990743 13217 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.005693 13051 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.010742 13018 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.017823 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:01.038192 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48038.4us
I20260709 13:16:01.084456 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:01.085376 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:01.086773 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:01.042012 10249 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.994974 13178 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:00.990841 13202 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:01.044574 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.042213 10399 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.000065 13045 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.043267 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.043289 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.046842 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.043315 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.047953 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:01.096606 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 49989.6us
I20260709 13:16:01.096925 10322 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:01.049489 10321 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:00.999871 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.050625 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:01.051363  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:01.063417 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:01.063889 10319 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:01.022991 13081 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.064559 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.074270 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:01.074847 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:00.995556 13235 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:01.079954 10242 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:01.038409 12860 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:01.082463 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:01.093226 13175 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:01.093434 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.053712 13097 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.147989 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:01.150663 10998 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.151055 10994 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.049037 13237 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.095687 10248 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:01.101718 10321 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:01.102860 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.065122 13039 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:01.115511 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.161154 10316 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:01.115957 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.162438 10322 raft_consensus.cc:2410] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:01.043679 13100 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.105787 10323 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:01.174834 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.087815 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:01.078747 13217 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.205624 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:01.215111 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 276564us
I20260709 13:16:01.169730 10996 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.076064 13239 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.170473 10245 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:01.105872 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.170251 10399 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:01.072561 13188 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.158789 13018 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.147059 12973 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:16:01.102415 13253 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.174840 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:01.176605 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:01.230285 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 53758.1us
I20260709 13:16:01.230463 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.181485 13039 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.184911 10998 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:01.234373 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:01.187965 13237 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.189217 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.199246 10248 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:01.094429 13202 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:01.202843 10146 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 7, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.106674 10317 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:01.149423 13184 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:01.149847 13081 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.226202 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.094152 13205 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:01.244302 13184 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.252466 13205 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:01.243130 13202 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.253504 13205 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.254032 13039 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.236008 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.256263 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.257050 13152 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.240859 13073 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:16:01.234896 13168 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.238734 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:01.238619 13018 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.261758  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:01.239089 10146 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 7, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.263095 13018 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.263299 10146 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 7, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.094075 13051 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:01.243669 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:01.245750 10323 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:01.247057 10317 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:01.265128 10146 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:01.250334 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.252535 13184 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.266914 10394 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:01.266378 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.243528 10249 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:01.250412 10994 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:01.269506 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.280936 10248 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:01.267997 10146 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.290398 10395 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:16:01.337159 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.338420 10390 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:01.339336 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.340809 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.341396 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.341940 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.335180 13253 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.290086 10146 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 4 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:01.347870 10244 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:01.218611 13245 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.353569 10146 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.266834 13203 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:01.369431 10997 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:16:01.372350 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.372447 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.374435 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.370378 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.273494 12838 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.273739 13051 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:01.287878 13035 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:16:01.332647 13011 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.376010 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.383390 10393 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:01.363817 13232 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.790s	user 0.004s	sys 0.010s
I20260709 13:16:01.287555 13178 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:16:01.355441 13238 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:01.350842 12860 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:01.392956 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:01.341477 10197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 43966.8us
I20260709 13:16:01.273737 12494 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.441370 13097 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.447311 10242 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:01.451900 13224 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:01.357646 13080 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:16:01.459750 13076 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.445914 13245 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.375762 10390 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:01.462903 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.463747 10390 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:01.465945 13237 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.465757 12860 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.467741 13204 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:01.469153 13204 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.469590 13204 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.461036 13207 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.471086 13207 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.487077 13097 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.487881 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.489539 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.499359 10399 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:01.354563 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 266784us
I20260709 13:16:01.371698 13203 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:01.398033 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:01.407224 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.407889 13109 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.390116 13152 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.379475 13051 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.410974 13187 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:01.389420 13011 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.411576 13073 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:01.418553 13100 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.420346 13175 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:01.427460 13188 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.428205 13238 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:01.431789 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.438912 13088 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:01.439740 13254 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.441479 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.608917 10393 raft_consensus.cc:2376] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4. Re-sending same reply.
I20260709 13:16:01.380888 13164 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.452991 10250 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:01.610667 10250 pending_rounds.cc:85] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 2
I20260709 13:16:01.610962 10250 pending_rounds.cc:107] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:01.611191 10250 raft_consensus.cc:2889] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.454210 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:01.454896 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:01.613099 10245 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:01.455996 10996 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:01.457561 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.458448 10243 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:01.614928 10243 pending_rounds.cc:85] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 3
I20260709 13:16:01.615186 10243 pending_rounds.cc:107] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:01.615427 10243 raft_consensus.cc:2889] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.506664 10391 raft_consensus.cc:2368] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:16:01.512913 13202 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.516607 13081 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.517814 13217 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.518577 13204 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.521376 10392 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:01.520537 13239 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.576642 13109 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.533525 13184 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:01.535693 13216 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.003s
I20260709 13:16:01.540750 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.542939 13224 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:01.546844 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.548698 13207 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.378248 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 4, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:16:01.559969 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 285179us
W20260709 13:16:01.568359 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 302048us
I20260709 13:16:01.634835 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.559242 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:01.567979 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 340850us
I20260709 13:16:01.634783 10146 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.635665 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.636060 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:01.569658 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 171694us
I20260709 13:16:01.636384 10146 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 4 to 6, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 6 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.637215 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.638435 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:01.638652 10146 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.639732 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:01.640457 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 81299us
I20260709 13:16:01.641511 10146 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.642184 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:01.643553 10146 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 5, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.567636 13203 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:01.617211 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.648977 10146 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 1 to 5, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:01.650280 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.618706 13073 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:01.623409 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.645961 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:01.579461 13235 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:01.522317 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.576412 13237 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:01.662449 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.570760 13187 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:01.626652 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.580296 13158 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:01.627286 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.646555 13091 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.645494 10246 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:01.579939 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.647256 10396 raft_consensus.cc:2368] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 5.
I20260709 13:16:01.651008 10146 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 4, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 4 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.677901 10395 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:01.571466 13260 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:01.653658 10397 raft_consensus.cc:2368] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:16:01.661800 13018 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.655339 13249 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.655256 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:01.659053 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.661525 13204 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:01.655966 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 77942.3us
W20260709 13:16:01.688511 10213 leader_election.cc:336] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 2.098s (SENT)
I20260709 13:16:01.688916 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:01.689970 13265 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:01.690877 13265 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:01.691085 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:01.692269 10242 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:01.661405 10244 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:01.606683 13088 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.668159 13208 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:01.696194 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.671739 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:01.625895 13188 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:01.619508 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.649441 13240 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:01.629613 13196 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:01.656172 12494 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:01.671752 13238 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.725018 10390 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:01.652689 13039 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:01.726431 13039 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:01.726854 13039 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.671568 13175 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:01.730356 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.618518 13254 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.681680 10399 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:01.733268 10399 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:01.658558 13252 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:01.655944 13080 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.659358 13207 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.694991 13205 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.691402 13265 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:01.692680 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:01.689023 13260 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:01.649524 13220 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:01.693285 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 57694us
I20260709 13:16:01.699287 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.650377 13224 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.671870 13235 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.702399 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.761739 10395 raft_consensus.cc:2368] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:16:01.734505 13240 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.723393 13208 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.680629 13158 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.694733 13097 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:01.689121 13011 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.704629 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:01.653743 10394 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:01.669365 13237 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.886833 13163 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:01.886945 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 182392us
I20260709 13:16:01.888461 13237 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.724571 12494 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.695401 13256 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:01.694631 13100 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.889866 13100 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.892052 13100 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.680649 13253 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:16:01.893191 13253 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:01.893411 13239 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.893615 13253 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:01.894480 13217 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.894548 13253 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.895987 13253 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.896306 13254 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.901113 10390 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:01.901224 13158 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.902542 13202 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:01.903105 10399 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:01.903512 13184 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.744155 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:01.746562 10392 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:01.740823 13080 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.908805 13196 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.909451 13196 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.910790 13080 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:01.911527 10391 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:01.911564 13196 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.749198 10242 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:01.749243 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56636us
I20260709 13:16:01.913448 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:01.735323 13245 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:01.912811 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.644735 13109 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.904650 13208 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.917372 13109 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.755313 12860 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:01.765878 13224 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.766767 13235 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.768976 13039 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.749931 13207 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:01.880426 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 123702us
I20260709 13:16:01.924201 13207 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.924858 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:01.906844 12494 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:01.881108 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.707144 13119 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:16:01.926869 13119 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:01.927260 13119 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:01.928233 13119 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.928843 13109 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:01.929571 13119 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.775604 13265 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.930160 13109 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:01.794914 13081 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:01.699450 13249 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.707453 13187 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.723807 13091 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:16:01.965198 10318 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:01.965592 13091 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:01.883249 13271 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:01.831079 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.713447 13073 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:01.889271 13178 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:01.752538 13260 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:01.919313 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.712568 13088 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:01.936055 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 248536us
I20260709 13:16:01.917760 13240 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:01.938956 10323 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:01.940196 10319 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:16:01.933966 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 299059us
I20260709 13:16:01.942065 10322 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:01.942854 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.938215 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.879921 13097 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.937249 13264 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.993588 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.994339 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:01.995388 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:01.996634 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:01.958989 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.959810 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:01.962747 13220 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.956084 13267 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:01.963400 10321 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:01.964316 10320 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:01.966017 13091 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:02.004184 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 90825.1us
I20260709 13:16:02.004400 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.968597 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.969355 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.970329 10390 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:01.970605 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.971341 10394 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:01.971477 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.973351 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.975140 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:01.979707 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:01.983718 10317 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:16:01.989372 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.990257 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.990830 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:01.992149 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:02.005024 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:02.023522 10246 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:02.023736 10392 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:02.006104 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:02.005848 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.024829 10323 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.026780 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:02.030467 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.002842 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:01.957882 13184 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:02.039484 10316 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:16:02.041090 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49009.7us
I20260709 13:16:02.042126 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:02.034170 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:02.037431 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:01.978951 13245 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:01.979239 13178 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:01.993264 13097 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:02.068328 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.071349 13039 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:02.064334 12973 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:01.931550 13109 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.020809 13205 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:02.057955 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.978713 13224 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:02.003028 13187 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.062834 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:02.001531 13196 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:02.075875 10316 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:02.056269 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.029234 13188 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:16:02.039949 13252 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:02.065188 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.051107 13070 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.048362 13266 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:02.090098 10323 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:02.050525 13253 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:02.094897 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.152223 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.095187 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:02.153689 10246 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:02.096073 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.097405 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:02.097537 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.098647 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:02.087476 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.113623 10393 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:02.003825 13018 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:16:02.021562 13264 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.146286 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.149112 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.146663 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.157900 10993 raft_consensus.cc:2393] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:02.160267 10996 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
W20260709 13:16:02.161825 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64529us
I20260709 13:16:02.040225 13263 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:16:02.060098 13184 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.191612 13184 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.167526 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.193645 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.138036 13091 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.167773 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.186957 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:02.194447 11000 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:02.030014 13220 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.074977 13260 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.175958 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.076161 13245 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.134920 13080 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:02.141201 13100 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:02.162989 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 70545.7us
I20260709 13:16:02.194612 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.144292 13164 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.197948 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.153224 13158 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:02.089274 13224 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.146647 13207 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:16:02.203418 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.204778 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:02.204825 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.206120 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.221946 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.206764 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:02.168032 12973 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:02.229481 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.144974 13070 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:02.213824 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:02.198752 13051 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.002s
I20260709 13:16:02.200835 10324 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:02.030351 13267 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:02.224458 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.194470 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.231072 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:02.234366 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.227624 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:02.169018 13253 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.242624 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.176180 13237 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:16:02.231120 13076 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.002s
I20260709 13:16:02.272553 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.237010 13080 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.240628 13070 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.278010 13253 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.210750 13152 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:02.239089 12675 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:02.249577 10391 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 2.
I20260709 13:16:02.238021 13163 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.242339 13266 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.295423 10398 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:16:02.296231 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 278904us
I20260709 13:16:02.304268 10996 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:02.284564 13011 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.214505 13164 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.311110 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.288199 13263 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.285597 13238 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.315091  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:02.251487 13051 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.331615 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:02.332908 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 181469us
I20260709 13:16:02.312388 13249 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:02.341073 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:02.321302 13011 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:02.348657 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.344388 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.355394 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.355571 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.359285 10392 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:02.320374 13263 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:02.362810 10247 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:02.363409 10213 leader_election.cc:400] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:16:02.365309 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.365361 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:02.366340 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:02.314465 12860 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:02.391189 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.390573 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.364056 13175 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:02.361306 13011 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.416854 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.422652 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.423765 10394 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:02.425971 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.363873 13283 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:02.367429 13249 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.428076 10213 leader_election.cc:400] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:16:02.429118 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.432431 10392 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:02.401180 13100 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:02.431409 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.435360 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.447535 10996 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:02.433193 13249 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.429682 13264 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.402201 13152 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:02.449306 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.460204 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.459789 10999 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:02.449700 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.449361 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.463380 10392 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:02.455178 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.464846 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.459215 11001 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:02.465879 10393 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:02.408093 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:02.456094 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:02.441665 13220 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.459324 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.466545 10998 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:02.462571 10394 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:16:02.459771 13202 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:02.459990 13249 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.468195 13287 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:02.482384 13175 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:02.483382 13267 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:02.484988 13203 consensus_meta.cc:287] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.823s	user 0.006s	sys 0.006s
I20260709 13:16:02.485458 13203 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:02.469959 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.487445 11000 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:02.472023 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:02.473078 10394 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:02.474257 10395 pending_rounds.cc:85] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 4
I20260709 13:16:02.491634 10395 pending_rounds.cc:107] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:16:02.491866 10395 raft_consensus.cc:2889] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.495105 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.495371 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.496985 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.498898 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.499648 10320 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:02.501446 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.503697 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.505306 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.505673 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.506459 10322 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
W20260709 13:16:02.487414 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 80855.5us
I20260709 13:16:02.508245 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.508440 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.446195 10995 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:02.510286 10322 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:16:02.510838 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.429420 13285 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:02.511695 10999 raft_consensus.cc:2410] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:16:02.567462 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 69897.6us
I20260709 13:16:02.522640 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2255) took 1071 ms. Trace:
W20260709 13:16:02.569460 10398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 1987) took 1469 ms (client timeout 1581 ms). Trace:
I20260709 13:16:02.522359 11000 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:02.570667 10398 rpcz_store.cc:269] 0709 13:16:01.051323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.102629 (+ 51306us) service_pool.cc:224] Handling call
0709 13:16:02.520532 (+1417903us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002ddf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:02.520689 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580737920}
I20260709 13:16:02.569964 10247 rpcz_store.cc:276] 0709 13:16:01.451069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.458799 (+  7730us) service_pool.cc:224] Handling call
0709 13:16:01.459114 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.366341 (+907227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.522291 (+155950us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540043dad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:02.522556 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077913344}
W20260709 13:16:02.579281 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 66081.8us
W20260709 13:16:02.480453 13280 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:16:02.481415 13286 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:02.480907 13051 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:02.470268 13250 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.513221 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:02.480892 13279 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:16:02.605003 10249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.002s	sys 0.029s
W20260709 13:16:02.581489 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 124056us
W20260709 13:16:02.605413 10249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.002s	sys 0.029s
I20260709 13:16:02.605751 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:02.585532 10398 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:02.589536 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:02.587013 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:02.573781 13285 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:02.470085 13245 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.454028 13217 raft_consensus.cc:2764] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:02.406968 13097 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.480439 13164 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.592131 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:02.608394 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:02.663618 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 74146.2us
I20260709 13:16:02.669322 10322 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
W20260709 13:16:02.669762 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 61490.8us
I20260709 13:16:02.511356 13224 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:02.661727 10250 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.673615 10322 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.510188 13263 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.599678 12838 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.645244 13051 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:02.683099 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:02.681092 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0717573679999077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:16:02.683961 10322 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:02.684341 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0105573680000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:16:02.599277 13283 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:02.630302 13175 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:02.596006 10995 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:02.604314 13287 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.685642 10245 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:02.681072 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.688771 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:02.595475 13002 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:16:02.627167 13265 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:02.692080 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:02.663543 13285 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.668237 13252 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.692837 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.715852 10999 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:02.706753 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:02.711289 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:02.740301 13300 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:02.741027 13288 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:16:02.726045 13292 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:02.746589 13282 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
I20260709 13:16:02.687295 13283 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:02.713570 13175 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.748497 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.655233 13152 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.679886 13217 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:02.738117 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.626682 13295 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:16:02.686003 12838 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.522823 12860 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.697543 13263 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.994088 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:03.091578 13296 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.092006 13217 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:03.092305 13296 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.093140 13217 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:02.894315 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.001039 10394 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:16:02.933427 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 248583us
W20260709 13:16:02.896678 13119 consensus_meta.cc:287] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.941s	user 0.010s	sys 0.004s
I20260709 13:16:03.026932 10391 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:02.869083 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:02.855325 10248 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:03.052088 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.086668 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1442) took 1114 ms. Trace:
I20260709 13:16:02.816139 10250 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:02.807868 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.051519 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:02.957945 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:02.869176 10995 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.955837 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:03.050010 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:02.911168 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.102943 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.017091 10399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.004s	sys 0.005s
W20260709 13:16:03.103672 10399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.007s	sys 0.006s
W20260709 13:16:02.951982 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.738514 10322 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:02.810942 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:02.695175 13287 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:02.944499 13076 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:03.106860 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.045912 13285 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.115759 10997 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:02.682664 13051 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:03.118414 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.718322 13252 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.816311 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:03.101526 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 363459us
I20260709 13:16:03.025986 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:03.103703 10398 raft_consensus.cc:2368] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
W20260709 13:16:02.909394 13301 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.283s	user 0.003s	sys 0.000s
I20260709 13:16:02.913434 13203 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.106549 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.102334 10319 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:03.107442 10995 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:03.108383 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 56377.6us
I20260709 13:16:03.107632 10998 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
W20260709 13:16:02.957828 13304 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:03.100143 10244 rpcz_store.cc:276] 0709 13:16:01.972481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.972633 (+   152us) service_pool.cc:224] Handling call
0709 13:16:02.026547 (+ 53914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.026807 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.026834 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.027329 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:16:02.292350 (+265021us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:02.292404 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.292530 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.086430 (+793900us) raft_consensus.cc:1685] finished
0709 13:16:03.086451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.086605 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":264541,"threads_started":1,"wal-append.queue_time_us":312924}
W20260709 13:16:02.883988 13311 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.105s	user 0.000s	sys 0.005s
I20260709 13:16:03.114894 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:03.115921 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:03.135140 10324 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:16:02.887100 13070 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.002s
I20260709 13:16:03.120206 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.137754 10319 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:03.120489 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.138417 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.939440 13310 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:03.119459 13292 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:02.737890 13265 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:02.908195 13202 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:03.126891 13163 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.811400 13109 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.129045 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.106696 13271 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.125355 13252 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.107234 13076 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:03.141467 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:02.908654 13011 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.123952 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:03.142223 11001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.011s	sys 0.012s
I20260709 13:16:03.117609 13245 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.141351 13018 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.124747 13051 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:03.136086 13308 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:16:03.126549 13207 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.146718 13070 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.150884 13292 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:03.152685 13296 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:03.163724 13245 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:03.164383 13109 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:03.242835 13275 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.843s	user 0.003s	sys 0.005s
I20260709 13:16:03.121297 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2265) took 1106 ms. Trace:
I20260709 13:16:03.113202 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:03.140592 10324 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:16:03.149307 10994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.017s	sys 0.008s
W20260709 13:16:03.451748 10994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.018s	sys 0.008s
I20260709 13:16:03.453570 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 739) took 1018 ms. Trace:
I20260709 13:16:03.156582 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.454756 13205 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.455751 11000 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:03.441696 10250 rpcz_store.cc:276] 0709 13:16:01.994020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.998543 (+  4523us) service_pool.cc:224] Handling call
0709 13:16:02.586895 (+588352us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b5800002a98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3eee 0000000000375939 00007f58c8a371e0 00007f58c8b000c4 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:16:03.100375 (+513480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10648576}
I20260709 13:16:03.427192 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.454140 10994 rpcz_store.cc:276] 0709 13:16:02.435243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.436839 (+  1596us) service_pool.cc:224] Handling call
0709 13:16:02.437233 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.437535 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.437570 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.438110 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.452738 (+1014628us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:03.452859 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.453060 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.453138 (+    78us) raft_consensus.cc:1685] finished
0709 13:16:03.453151 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.453427 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":884234,"threads_started":1,"wal-append.queue_time_us":690405}
W20260709 13:16:03.160763 11001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.011s	sys 0.012s
I20260709 13:16:03.459936 13224 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:03.460489 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 331364us
I20260709 13:16:03.461480 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 746) took 1003 ms. Trace:
I20260709 13:16:03.162539 13202 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:03.464262 13240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.005s	sys 0.005s
W20260709 13:16:03.464824 13240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.005s	sys 0.005s
I20260709 13:16:03.457789 13109 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.468021 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.468911 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 564) took 1006 ms. Trace:
I20260709 13:16:03.163781 13163 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:03.453890 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 340620us
I20260709 13:16:03.471226 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.150456 13276 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:16:03.162705 13283 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.126118 13287 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.480160 13283 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.481381 13287 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.148867 13293 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:03.152027 13310 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.482780 13119 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:03.483776 13293 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:03.484221 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.485077 13310 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.360323 10993 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:03.486330 13276 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:03.486904 13276 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:16:03.145248 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.015s
I20260709 13:16:03.487615 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 609) took 1344 ms. Trace:
W20260709 13:16:03.488206 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.014s	sys 0.015s
I20260709 13:16:03.488196 10993 rpcz_store.cc:276] 0709 13:16:02.143216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.206431 (+ 63215us) service_pool.cc:224] Handling call
0709 13:16:02.237709 (+ 31278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.486035 (+1248326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.487214 (+  1179us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003093d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:03.487500 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2579721088}
I20260709 13:16:03.209292 13292 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:03.168702 13100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.019s	sys 0.030s
W20260709 13:16:03.491086 13100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.026s	sys 0.036s
W20260709 13:16:03.491222 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.484234 13293 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:03.492424 10997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 708) took 1395 ms (client timeout 1780 ms). Trace:
W20260709 13:16:03.493067 10997 rpcz_store.cc:269] 0709 13:16:02.096578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.096682 (+   104us) service_pool.cc:224] Handling call
0709 13:16:03.491982 (+1395300us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b540034dd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:03.492195 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203684736}
I20260709 13:16:03.493770 13293 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.495368 13276 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.499547 12860 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.500487 12860 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.505214 13307 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.506472 13307 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.509557 13307 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.473925 13163 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:03.511191 13202 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.167546 13271 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.511433 13091 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.511741 13307 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:03.512810 13307 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:03.515141 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:03.469650 10397 rpcz_store.cc:276] 0709 13:16:02.462061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.462177 (+   116us) service_pool.cc:224] Handling call
0709 13:16:02.508771 (+ 46594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.508966 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.508992 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.509036 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:02.509067 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.509124 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.468415 (+959291us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b54000bc7d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:03.468673 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106323712}
I20260709 13:16:03.185619 13207 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:03.522161 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.261650 13260 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.256743 13273 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:03.244874 13278 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.906s	user 0.001s	sys 0.001s
I20260709 13:16:03.526731 12860 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.253424 13285 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.471707 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.462112 11001 rpcz_store.cc:276] 0709 13:16:02.458436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.489867 (+ 31431us) service_pool.cc:224] Handling call
0709 13:16:02.490282 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.490641 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.490669 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.510804 (+ 20135us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.460532 (+949728us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:03.460627 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.460786 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.460884 (+    98us) raft_consensus.cc:1685] finished
0709 13:16:03.460906 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.461206 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16080,"raft.queue_time_us":21401,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":50384,"thread_start_us":857150,"threads_started":1,"wal-append.queue_time_us":640923}
W20260709 13:16:03.529119 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 57602.9us
I20260709 13:16:03.498359 13205 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:03.498461 13310 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:03.531203 13310 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.533865 13310 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.534849 13310 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.531224 13205 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.472190 13240 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.511050 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.189648 13070 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.538932 13073 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.544523 13250 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:03.545644 13250 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.546469 13205 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:03.192111 13299 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:03.548022 13267 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:03.191226 13097 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:03.183351 13187 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.091s	user 0.011s	sys 0.003s
I20260709 13:16:03.550585 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:03.550766 10320 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:03.553574 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:03.188522 13175 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.554613 10391 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:03.526733 13273 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:03.556504 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:03.183202 13076 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.496353 13293 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:03.182509 13302 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:03.530181 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:03.363597 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 222561us
I20260709 13:16:03.568764 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.573256 13297 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:16:03.573629 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:03.569628 13267 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:03.574831 13297 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:03.575616 13297 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:03.569608 13250 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.577461 10288 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.574819 10397 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:03.491506 13100 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:03.187644 13266 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.878s	user 0.002s	sys 0.016s
W20260709 13:16:03.360515 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 229806us
W20260709 13:16:03.515434 12494 consensus_meta.cc:287] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.590s	user 0.008s	sys 0.011s
I20260709 13:16:03.577289 13297 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.591504 13109 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:03.577320 13088 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.600903 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 466) took 1091 ms. Trace:
I20260709 13:16:03.604964 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.607985 10250 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:03.610566 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.615018 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.557299 13307 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.616367 13207 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:03.617007 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.618718 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.619797 13296 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.620433 13276 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.624145 13175 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:03.624265 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 94303.7us
W20260709 13:16:03.624791 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.625289 13100 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.627166 13178 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.631398 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.627880 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:03.635234 10995 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.001s
I20260709 13:16:03.635986 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:03.638250 13271 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.639928 13097 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:03.190555 13256 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.195962 13011 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:03.240276 13249 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
I20260709 13:16:03.649479 10320 rpcz_store.cc:276] 0709 13:16:02.503250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.503403 (+   153us) service_pool.cc:224] Handling call
0709 13:16:03.593993 (+1090590us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002bcd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:03.594142 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404844800}
I20260709 13:16:03.649142 13109 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.660439 10144 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 4 to 5, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 5 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:03.671679 10246 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:16:03.671788 13178 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.642797 12494 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.694774 11002 raft_consensus.cc:2368] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:16:03.694932 13109 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.695968 12494 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:03.696060 11002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 706) took 1600 ms (client timeout 1712 ms). Trace:
W20260709 13:16:03.696601 11002 rpcz_store.cc:269] 0709 13:16:02.095910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.096018 (+   108us) service_pool.cc:224] Handling call
0709 13:16:03.695833 (+1599815us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54005d2fd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:03.695991 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3544737024}
I20260709 13:16:03.672551 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.672684 13208 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.673544 10995 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:16:03.672566 10391 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 3.
I20260709 13:16:03.678843 13158 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.678889 10245 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:03.679576 13266 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:03.680724 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49577.4us
I20260709 13:16:03.681238 13250 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:03.682020 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 104752us
I20260709 13:16:03.699358 10995 pending_rounds.cc:85] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 6
I20260709 13:16:03.682435 13073 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:03.682701 13097 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.188175 12838 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.232301 13265 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.703521 10995 pending_rounds.cc:107] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:03.715811 10995 raft_consensus.cc:2889] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.724979 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.739271 13080 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.739969 13080 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.745651 13080 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.746718 13250 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:03.747574 13250 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.749167 13321 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.749866 13321 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.751950 13250 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.752796 13321 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:03.753608 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.756525 10245 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:03.756946 10245 pending_rounds.cc:85] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 3
I20260709 13:16:03.757196 10245 pending_rounds.cc:107] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:03.757436 10245 raft_consensus.cc:2889] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.758625 13205 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:03.759266 13205 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:03.760232 13283 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:03.760627 13245 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.760452 13205 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.761008 13283 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.761729 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:03.763036 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 53609.1us
I20260709 13:16:03.763810 13283 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.764276 13266 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:03.766198 10392 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:03.767028 13097 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.767714 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.771867 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.773046 12494 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:03.730360 13297 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:03.774199 13119 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:03.774720 13119 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:03.775173 13119 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.774741 13292 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.781045 13292 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.767876 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.246608 13252 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.768900 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 614) took 1401 ms. Trace:
I20260709 13:16:03.763859 10288 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:03.782692 10995 rpcz_store.cc:276] 0709 13:16:02.367544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.395140 (+ 27596us) service_pool.cc:224] Handling call
0709 13:16:02.429129 (+ 33989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.768604 (+1339475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.768837 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.769479 13246 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:03.698890 13273 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.785394 13109 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.786548 13273 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:03.768608 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.789831 11001 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:03.791931 13252 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.793605 10995 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:16:03.794087 13265 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:03.796378 13158 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.792795 13119 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.797757 13152 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:03.797582 10144 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.798764 13246 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:03.799098 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.799865 12838 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.702683 13296 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.804265 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.826423 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:03.835803 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 364841us
I20260709 13:16:03.818481 12838 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.844383 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:03.845376 10247 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:03.845240 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.846518 10241 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:03.847638 13287 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:03.849696 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.851233 13097 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.852201 13306 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:03.853693 13051 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.663s	user 0.003s	sys 0.016s
I20260709 13:16:03.854293 13051 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.854681 13321 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.855412 13321 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.856722 13051 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:03.856820 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:03.857565 13051 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:03.858628 10395 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:03.858749 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:03.859598 13175 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:03.859961 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:03.860375 13175 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:03.860869 10397 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 4: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:03.861145 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:03.861620 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:03.861990 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:03.862741 13249 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.863706 10393 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
W20260709 13:16:03.863930 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59785.7us
I20260709 13:16:03.864449 10996 raft_consensus.cc:2368] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6.
I20260709 13:16:03.857770 13321 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.871989 10245 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:03.858693 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:03.874606 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:03.874787 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.867071 12838 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.875630 10244 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:03.876693 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 743) took 1440 ms. Trace:
I20260709 13:16:03.877099 10996 rpcz_store.cc:276] 0709 13:16:02.436380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.459937 (+ 23557us) service_pool.cc:224] Handling call
0709 13:16:03.876474 (+1416537us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54006108d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:03.876634 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3226972032}
I20260709 13:16:03.879413 13265 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.861987 13175 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:03.881633 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.846428 13250 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:03.865236 13249 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:03.878401 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:03.887396 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 88366us
I20260709 13:16:03.853750 13256 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:03.920832 10243 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.921454 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.921890 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:03.924185 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.888044 13250 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.886055 13175 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:03.935364 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:03.937033 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 54651.8us
I20260709 13:16:03.917765 13256 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:03.923378 13109 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:03.936244 13076 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.934557 13250 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:03.937377 13175 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.933063 13152 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.941138 13263 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:03.958050 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.942003 13296 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:03.958865 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:03.961020 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:03.938401 13265 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:03.948721 13158 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:03.970420 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.968258 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:03.967994 13002 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:03.972121 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1539) took 1702 ms. Trace:
I20260709 13:16:03.972121 13254 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:03.986344 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.987795 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:03.990587 13178 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.991087 13178 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.991469 13178 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.991977 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:03.992668 10995 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:03.993623 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.003810 10241 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:04.006798 10243 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:03.976336 10390 rpcz_store.cc:276] 0709 13:16:02.253699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.253911 (+   212us) service_pool.cc:224] Handling call
0709 13:16:02.254348 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.366742 (+112394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.366771 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.389346 (+ 22575us) log.cc:844] Serialized 26 byte log entry
0709 13:16:02.466507 (+ 77161us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:02.466541 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.466611 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.943396 (+1476785us) raft_consensus.cc:1685] finished
0709 13:16:03.945921 (+  2525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.955913 (+  9992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34298,"raft.queue_time_us":29772,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6065,"thread_start_us":127635,"threads_started":2,"wal-append.queue_time_us":622735}
I20260709 13:16:04.011935 13091 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:04.014835 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:04.014966 13091 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.016352 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.017071 10995 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:04.017228 13091 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.019650 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:04.019376 13002 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.024039 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.027063 10320 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:16:04.027941 13287 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:04.030028 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.030967 10317 raft_consensus.cc:2410] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:04.001453 13246 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:04.031612 13246 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.025797 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.003080 13119 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.037262 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:04.037384 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:04.037914 13163 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:16:04.038321 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:04.039021 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.039124 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:03.974881 13152 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:03.968796 13263 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:04.039872 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 81534.6us
I20260709 13:16:04.014339 13205 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:04.073875 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:04.075881 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.085991 10997 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.087445 10245 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:04.077239 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:04.061523 13321 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:04.090740 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.091480 10998 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:04.092909 13293 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.003s
I20260709 13:16:04.093724 13152 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.086481 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.098673 10997 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:16:04.098905 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.099591 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.093657 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.104172 10247 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:04.036437 13100 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:04.105895 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.107156 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:04.107576 10319 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:04.157356 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.108022 13283 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:04.115396 13263 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.118749 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.159638 13175 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:04.160596 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 74427us
I20260709 13:16:04.122694 10995 raft_consensus.cc:2393] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:04.162384 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 55332.6us
I20260709 13:16:04.162905 13175 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.163611 10213 leader_election.cc:400] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:16:04.164104 10213 leader_election.cc:403] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.164997 13287 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:04.166358 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.117444 13245 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.073022 13097 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.167171 10323 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:04.167383 13097 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:04.167866 13097 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.168471 13245 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.162928 13297 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.164122 13080 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:04.098524 13296 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:04.152591 10325 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:04.157224 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.172013 10993 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:04.171839 13296 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.176563 10994 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:04.163582 13175 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:04.085952 13205 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:04.171232 13080 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:04.131780 13271 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:04.126335 13256 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:04.137061 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 91334.3us
W20260709 13:16:04.193840 13336 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:04.180680 10288 leader_election.cc:400] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6.
I20260709 13:16:04.161789 13250 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.140480 12494 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:04.183821 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:04.185906 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:04.191529 13271 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:04.200217 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:04.193311 13260 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.006s
I20260709 13:16:04.155439 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.198879 10288 leader_election.cc:403] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.166481 13287 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9.
I20260709 13:16:04.158018 13100 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:04.208479 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 194496us
I20260709 13:16:04.205317 13263 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.211146 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.156922 13321 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.225415 10316 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.231547 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:04.234134 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.235522 10318 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:04.235839 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:04.239220 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.240087 10245 raft_consensus.cc:2410] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:04.243888 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 70986.7us
I20260709 13:16:04.214347 13119 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.254402 10997 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:04.253527 13246 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.214457 13283 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:04.265489 10394 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:04.236884 13265 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.273146 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.290459 10241 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:04.241427 13100 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.231511 12860 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:04.281220 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.256338 13175 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:04.251156 13245 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.280112 13163 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.253844 13109 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:16:04.293498 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.325070 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.256482 13002 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.334427 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.280699 13119 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:04.270964 13249 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:04.341832 10318 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:04.321965 13293 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.350441 10391 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:04.344910 10325 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:16:04.355505 13249 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:04.358515 13245 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.358902 13163 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.360839 13245 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.321854 13271 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.362154 13271 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.362596 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2157) took 1368 ms. Trace:
I20260709 13:16:04.362970 12860 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.363473 13163 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.363724 10242 raft_consensus.cc:2410] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:16:04.361301 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 186129us
I20260709 13:16:04.357736 13249 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.365567 13250 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:04.366031 13338 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:16:04.366964 13254 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.325958 13205 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.353367 13175 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:04.376961 13273 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.005s
I20260709 13:16:04.361656 13178 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.342566 13080 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:04.386195 13348 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:04.324247 13283 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.392778 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:04.386209 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 299916us
I20260709 13:16:04.265995 13263 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.401110 10316 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:04.393312 10144 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 4 to 5, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 5 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.408181 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:04.408376 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 176895us
W20260709 13:16:04.404464 13088 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.043s	sys 0.047s
I20260709 13:16:04.398742 10322 rpcz_store.cc:276] 0709 13:16:02.966417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.135438 (+169021us) service_pool.cc:224] Handling call
0709 13:16:03.135694 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.870758 (+735064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.879886 (+  9128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:03.879931 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:03.879976 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.292901 (+412925us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54003dde54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:04.292960 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.334308 (+ 41348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29426,"raft.queue_time_us":25762,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":41138,"spinlock_wait_cycles":1636019584}
I20260709 13:16:04.434165 13163 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.435124 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.344484 13152 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:16:04.450528 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:04.456041 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.426285 13051 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.461215 11001 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:16:04.474669 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:04.464979 13088 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.043s	sys 0.048s
I20260709 13:16:04.438726 13293 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.491173 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:04.496909 13076 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.497882 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:04.500985 10146 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 314) took 9572 ms. Trace:
I20260709 13:16:04.492574 10325 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:04.501713 13263 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.478247 13051 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.502642 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.503065 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.503919 10246 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:04.503744 13163 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.507213 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.493283 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.484189 10144 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 1 to 2, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.477411 13296 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.506049 13163 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:04.548554 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 279055us
I20260709 13:16:04.548761 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:04.550340 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.480242 13245 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:16:04.566207 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.568034 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:04.575646 10248 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.579671 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:04.550338 13076 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:04.580638 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.495800 12838 consensus_meta.cc:287] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.616s	user 0.013s	sys 0.000s
I20260709 13:16:04.577183 13347 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:04.585956 13347 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:04.586455 13347 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:04.589103 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.551846 13296 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:04.594161 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 43925.8us
I20260709 13:16:04.559948 13321 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.594993 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:04.506747 13175 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:04.605628 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.590101 13073 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:04.602819 10997 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:04.603406 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:04.629637 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:04.606935 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.616999 10325 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:04.617903 10318 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:04.618954 10322 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.589097 13293 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.623394 13296 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:04.623958 13265 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:04.624640 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:04.539165 13119 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.634670 10290 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.640287 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:04.637317 10316 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.602010 13260 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:04.644515 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.635672 13265 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.651477 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:04.651299 13285 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:16:04.592077 12838 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.661263 13051 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.651369 13076 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.663285 10998 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:04.664150 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:04.665338 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.669538 10993 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:04.659052 13353 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:04.673352 10967 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.654819 13263 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.653075 13109 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6.
I20260709 13:16:04.643688 13354 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:04.654559 13178 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.670001 13265 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.713348 10324 raft_consensus.cc:2368] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:16:04.501456 10146 rpcz_store.cc:276] 0709 13:15:54.887744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.889712 (+  1968us) service_pool.cc:224] Handling call
0709 13:15:55.072370 (+182658us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a52090 00007f58c3af0f3a 00007f58c98a71cc 00007f58c99a537e 00007f58c7e662a4 00007f58c7e66232 00007f58c7e66161 00007f58c7e660dc 00007f58c7e65392 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:04.447095 (+9374725us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:02.205837 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:02.339395 (+133558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:02.345967 (+  6572us) write_op.cc:435] Acquired schema lock
0709 13:16:02.352532 (+  6565us) tablet.cc:662] Decoding operations
0709 13:16:02.595557 (+243025us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:02.603258 (+  7701us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:02.607460 (+  4202us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:16:02.896171 (+288711us) tablet.cc:701] Row locks acquired
0709 13:16:02.904707 (+  8536us) write_op.cc:260] PREPARE: finished
0709 13:16:02.970560 (+ 65853us) write_op.cc:270] Start()
0709 13:16:02.993659 (+ 23099us) write_op.cc:276] Timestamp: P: 1783602962937387 usec, L: 0
0709 13:16:03.035255 (+ 41596us) op_driver.cc:348] REPLICATION: starting
0709 13:16:03.131257 (+ 96002us) log.cc:844] Serialized 5944 byte log entry
0709 13:16:03.273666 (+142409us) op_driver.cc:464] REPLICATION: finished
0709 13:16:03.283471 (+  9805us) write_op.cc:301] APPLY: starting
0709 13:16:03.283576 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:03.284008 (+   432us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:03.284166 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:03.286141 (+  1975us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:03.290706 (+  4565us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:16:03.290781 (+    75us) write_op.cc:312] APPLY: finished
0709 13:16:03.291292 (+   511us) log.cc:844] Serialized 107 byte log entry
0709 13:16:03.291507 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.291714 (+   207us) write_op.cc:454] Released schema lock
0709 13:16:03.291800 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:03.292331 (+   531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:03.292370 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":550,"reported_tablets":31,"spinlock_wait_cycles":243511552,"child_traces":[["op",{"apply.queue_time_us":9478,"apply.run_cpu_time_us":4716,"apply.run_wall_time_us":8820,"num_ops":15,"prepare.queue_time_us":442735,"prepare.run_cpu_time_us":19959,"prepare.run_wall_time_us":1091418,"raft.queue_time_us":1539,"raft.run_cpu_time_us":4335,"raft.run_wall_time_us":13178,"replication_time_us":238186,"thread_start_us":415167,"threads_started":4,"wal-append.queue_time_us":133702,"wal-append.run_cpu_time_us":4560,"wal-append.run_wall_time_us":1086328}]]}
W20260709 13:16:04.710978 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 88314.4us
W20260709 13:16:04.719089 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 84493.3us
W20260709 13:16:04.723523 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.714838 13292 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:16:04.724997 10242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2277) took 1621 ms (client timeout 1523 ms). Trace:
W20260709 13:16:04.725504 10242 rpcz_store.cc:269] 0709 13:16:03.101608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.101825 (+   217us) service_pool.cc:224] Handling call
0709 13:16:04.718516 (+1616691us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540009e554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:04.723056 (+  4540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491462400}
I20260709 13:16:04.726653 13355 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.727197 13321 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:04.727246 13355 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.727823 13321 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.728529 13076 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.684338 13163 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:16:04.731101 13355 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.728894 13321 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.689927 13293 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:04.676288 13356 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:04.688350 13073 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:04.689616 13283 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:04.746405 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 119499us
I20260709 13:16:04.709895 13254 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:04.748165 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.764897 10316 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:04.718135 13263 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:16:04.753785 13350 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:16:04.770946 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:04.735536 13256 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.773841 10325 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 10. Ops: []
I20260709 13:16:04.744949 13354 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:04.777613 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:04.777801 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 129625us
I20260709 13:16:04.712546 13051 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:16:04.783090 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:04.783474 10318 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:04.785944 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.791266 10242 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:04.794641 13254 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.794953 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.795392 13362 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.795329 13254 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.737118 13293 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.796511 13273 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.797010 13273 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.798455 13293 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.799059 12838 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.774114 13356 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:04.801095 13356 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.802040 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:04.803081 13296 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:04.785866 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:04.803468 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.803695 13356 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.804342 13356 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.804994 13356 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.805560 13293 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:04.807065 13293 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:04.806874 13354 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.807945 13293 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:04.808333 13293 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:04.809216 13293 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.812548 13293 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.819527 13265 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.799079 13273 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.820192 13347 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.823925 13355 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:04.824384 13355 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:04.824610 13347 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:04.807406 12860 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:04.806165 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:04.854673 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 106597us
W20260709 13:16:04.855311 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 49207.5us
W20260709 13:16:04.837867 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.847015 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.797811 13283 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:16:04.865481 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:04.865895 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:04.870708 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:04.868963 10397 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:16:04.875765 10316 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.869355 10322 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:04.880414 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:04.891175 10317 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:04.865556 13356 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:04.896665 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.864434 13362 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:04.894009 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:04.887270 13073 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:04.915105 10996 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.920208 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.921100 10995 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:04.915766 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:04.924425 10999 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:04.893818 13356 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.919483 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:04.916435 13271 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:16:04.917248 13073 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.922094 13076 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.922443 13080 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.901221 13254 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.947322 13091 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.939337 13088 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.953696 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.948803 13276 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.979377 13250 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:04.979838 13250 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:04.967739 13205 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:16:04.980818 13250 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.968706 13091 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.983572 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.983989 13091 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:04.984405 10316 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:04.984604 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.984766 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.985237 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.985781 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.985985 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.986362 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.986451 10319 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:04.986579 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:04.987161 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.987502 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:04.987802 10321 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:04.988107 10319 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:04.971638 10394 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:04.989025 13109 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:04.956562 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:04.989508 13109 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:04.971549 10393 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:04.990913 13109 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:04.992781 13109 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.993150 13088 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.985985 10316 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:04.956928 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:04.961797 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:04.956477 11000 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:04.995159 10242 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.964636 13372 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:04.964740 13351 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:05.005650 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:04.966464 13367 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:04.979053 13276 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.985430 10325 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.928860 13263 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.996445 10317 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.964351 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:04.964835 13355 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:04.998585 13368 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:04.999430 10246 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:04.961267 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:05.002415 10322 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:04.954784 13073 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:05.008126 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.023329 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:05.026973 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:05.027902 10391 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:16:04.944796 13356 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:05.011111 10242 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:04.982074 13250 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.972343 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.026078 10246 pending_rounds.cc:85] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:16:05.019680 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:05.038007 10246 pending_rounds.cc:107] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:16:05.027947 10395 raft_consensus.cc:2376] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8. Re-sending same reply.
I20260709 13:16:05.038513 10246 raft_consensus.cc:2889] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.020219 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:05.020368 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.025799 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:05.025183 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:05.025681 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 61430.8us
I20260709 13:16:05.040020 10318 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:04.995836 13265 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:05.040177 10999 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:05.005270 13088 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:05.037936 10247 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:16:05.042438 10390 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:05.036034 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:05.042893 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.044376 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.039979 10290 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:05.047065 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.040405 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:05.014951 13260 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:05.048454 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.061347 10320 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:05.036955 13354 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:05.026862 13368 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.063095 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.063992 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.064185 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.064764 10317 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:05.061805 10323 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:05.047209 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:05.056973 10322 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:04.996197 13080 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.069897 11001 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:05.068365 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.033607 13245 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:05.074499 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:05.082072 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:05.083441 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:05.076061 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:05.084378 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.042516 13076 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:05.077405 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.038106 13091 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:05.086318 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2092) took 1006 ms. Trace:
I20260709 13:16:05.058772 13271 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:05.120766 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:05.121975 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.062477 13354 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:05.092859 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:05.067469 13260 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:05.093389 10324 rpcz_store.cc:276] 0709 13:16:04.071988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.072116 (+   128us) service_pool.cc:224] Handling call
0709 13:16:05.071701 (+999585us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003aa554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:05.078715 (+  7014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273740672}
I20260709 13:16:05.062574 13070 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:05.150619 11000 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:16:05.037904 13372 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.148641 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.078337 13368 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.092650 13245 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.091878 13205 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:05.091804 13347 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:05.086593 13287 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.149402 13354 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.198936 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.202441 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:05.159320 13070 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.201786 13011 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.205470 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:05.116433 13283 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:16:05.207055 10999 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:05.081787 13265 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.137391 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.302038 10323 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:05.303390 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.304342 10323 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:05.120247 13097 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.952s	user 0.014s	sys 0.000s
I20260709 13:16:05.306619 13097 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.309268 13097 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:05.217175 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:05.117882 13076 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.223526 10394 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:05.207361 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:05.224561 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.310711 10395 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:05.130731 12860 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:16:05.197870 13355 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:05.225742 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:05.236747 13375 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:16:05.237738 13100 consensus_meta.cc:287] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.000s
I20260709 13:16:05.238521 13347 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:05.361634 13347 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.241537 13080 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:05.243068 13374 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:16:05.244726 10398 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:05.371184 10996 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:16:05.250712 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47272.7us
W20260709 13:16:05.272423 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.310948 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.372802 10324 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:05.312039 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:05.300061 13321 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 13:16:05.318768 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:05.321216 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:05.378448 10997 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.246411 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:05.379566 10396 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.324468 10250 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.326268 11002 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:05.329010 10325 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:05.202375 13051 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:16:05.228083 13205 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:05.248620 13287 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:05.335673 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 203716us
I20260709 13:16:05.199200 13091 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.340528 10999 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.300434 13119 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.347916 13076 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:05.348361 13100 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.350000 13349 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.256976 13070 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.357451 13276 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:05.313477 13011 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.367264 10393 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:05.248179 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:05.374967 10248 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:05.376386 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:05.400869 13287 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.380986 10320 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: [4.7-5.8]
I20260709 13:16:05.369515 13271 raft_consensus.cc:697] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:05.550839 10997 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:05.388572 10324 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:05.326463 13175 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:05.420137 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.411660 13109 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:05.429065 13368 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.430414 10244 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.377704 13366 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:05.382261 13163 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:05.389782 13205 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.483546 10242 raft_consensus.cc:2393] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:05.314996 13265 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.382874 10996 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:05.571872 10999 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:05.429236 13382 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:05.387847 13321 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.616811 10997 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:16:05.528739 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.500s (SENT) [suppressed 19 similar messages]
I20260709 13:16:05.777086 10316 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:05.779883 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 387775us
I20260709 13:16:05.846113 10319 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:16:05.847530 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.850093 13351 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:05.850721 13351 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.853030 13351 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:05.843065 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:05.860769 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:05.866355 10391 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:05.869601 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:05.788879 13265 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.587910 13256 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:05.483556 13356 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:05.839388 13306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.029s
I20260709 13:16:05.892690 10249 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:05.799551 13366 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:05.898403 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:05.671712 13109 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.571159 13119 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.882129 13245 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:05.904042 13306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.006s	sys 0.029s
W20260709 13:16:05.885907 13260 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.000s
I20260709 13:16:05.704154 13175 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:05.935057 10316 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:05.937506 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:05.559867 13349 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.891333 13273 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.923558 10399 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:05.964761 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 641) took 1315 ms. Trace:
W20260709 13:16:05.947486 10396 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.002s
W20260709 13:16:05.910180 13373 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.410s	user 0.002s	sys 0.000s
I20260709 13:16:05.965871 10396 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:05.909948 13351 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:05.965274 10250 rpcz_store.cc:276] 0709 13:16:04.625688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.625818 (+   130us) service_pool.cc:224] Handling call
0709 13:16:04.626135 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.380290 (+754155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.941293 (+561003us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400101dd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:05.941483 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575266048}
I20260709 13:16:05.971321 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:05.926021 13073 consensus_meta.cc:287] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.877s	user 0.008s	sys 0.002s
W20260709 13:16:05.996004 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 58598.7us
I20260709 13:16:05.972841 10396 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:05.968290 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 439546us
I20260709 13:16:06.017119 10994 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.939148 13372 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:05.902818 13256 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:05.910395 13391 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.964811 13100 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.044313 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:05.968056 13398 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:06.052532 13349 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.052734 13398 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.053231 13398 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:06.022527 13091 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:06.057006 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:06.059968 13119 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:06.060606 13119 raft_consensus.cc:2764] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:06.061297 13119 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.063061 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.063746 13256 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:06.064471 13396 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:16:06.065824 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.066483 10396 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:06.067380 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.067900 10396 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:06.068702 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.069386 10396 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:06.046383 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.075212 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:06.075968 10399 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:06.070142 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:06.076695 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:06.076758 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:06.082590 10213 leader_election.cc:336] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.581s (SENT)
I20260709 13:16:06.083748 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:06.085211 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:06.081526 10399 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:16:06.063786 10250 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
W20260709 13:16:06.046840 13379 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.630s	user 0.001s	sys 0.000s
I20260709 13:16:06.133639 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:06.135435 10399 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:06.103803 13285 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:05.906198 13271 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.027900 13097 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:06.047461 13073 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.104293 13367 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:06.136739 10399 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:06.152990 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2174) took 1142 ms. Trace:
I20260709 13:16:06.154757 10322 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:06.146622 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:06.137987 10997 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:05.995226 13249 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.125795 13387 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:16:06.052608 13386 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:16:06.126590 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:06.176165 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 92500.2us
I20260709 13:16:06.177078 10213 leader_election.cc:400] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:16:06.177400 10213 leader_election.cc:403] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:16:06.178730 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.180259 10994 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:06.076347 13366 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.131625 13175 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:06.113808 10393 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.000s
I20260709 13:16:05.966856 13260 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.142712 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.142480 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:06.153352 10321 rpcz_store.cc:276] 0709 13:16:05.010057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.319279 (+309222us) service_pool.cc:224] Handling call
0709 13:16:05.319620 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.329384 (+  9764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.329429 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.336432 (+  7003us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.858526 (+522094us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:05.858577 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.858650 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.152761 (+294111us) raft_consensus.cc:1685] finished
0709 13:16:06.152780 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.152930 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2546,"raft.queue_time_us":10238,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4959,"thread_start_us":447216,"threads_started":1,"wal-append.queue_time_us":720537}
W20260709 13:16:06.147212 13393 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:06.175024 13387 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.189622 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:06.175732 10395 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.141561 13097 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.137349 13273 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.107221 13254 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.199702 10393 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:06.143568 13100 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:06.202040 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:06.219750 10316 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:06.207418 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:06.220942 10997 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:06.224428 13387 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.226516 13051 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:06.228109 13321 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.229338 13109 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.230504 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 758) took 1223 ms. Trace:
I20260709 13:16:06.137408 13285 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.230906 11000 rpcz_store.cc:276] 0709 13:16:05.007090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.007225 (+   135us) service_pool.cc:224] Handling call
0709 13:16:06.230213 (+1222988us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54005a8054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:06.230416 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254370688}
W20260709 13:16:06.231551 13354 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.920s	user 0.008s	sys 0.002s
W20260709 13:16:06.232137 13385 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:16:06.232062 13354 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.232757 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.233214 10242 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:06.233474 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 739) took 1369 ms. Trace:
I20260709 13:16:06.234181 13283 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:06.234947 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 632) took 1319 ms. Trace:
I20260709 13:16:06.226400 13100 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.234087 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.202072 10249 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:06.235368 10993 rpcz_store.cc:276] 0709 13:16:04.915553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.949809 (+ 34256us) service_pool.cc:224] Handling call
0709 13:16:05.004657 (+ 54848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.026132 (+ 21475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.026169 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.045858 (+ 19689us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.335413 (+289555us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:05.335465 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.335514 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.234743 (+899229us) raft_consensus.cc:1685] finished
0709 13:16:06.234775 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.234895 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7137,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7126,"thread_start_us":243125,"threads_started":1,"wal-append.queue_time_us":392059}
I20260709 13:16:06.244741 10395 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:06.150162 13398 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.270352 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 765) took 1191 ms. Trace:
I20260709 13:16:06.196560 13091 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:06.226469 13401 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:06.207988 13372 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:06.201646 13364 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:06.310377 13381 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.291381 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.149290 13367 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.201584 13395 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6.
I20260709 13:16:06.235152 13254 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.237131 13175 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:06.306852 13163 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.307499 13321 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:06.310468 13364 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.188228 13205 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:06.264364 13355 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.930s	user 0.004s	sys 0.007s
I20260709 13:16:06.221681 13011 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.233831 10998 rpcz_store.cc:276] 0709 13:16:04.863638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.863788 (+   150us) service_pool.cc:224] Handling call
0709 13:16:04.886974 (+ 23186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.030559 (+143585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.030611 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.040353 (+  9742us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.388890 (+348537us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:05.388942 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.389036 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.231483 (+842447us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:06.233168 (+  1685us) raft_consensus.cc:1685] finished
0709 13:16:06.233188 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.233406 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43489,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8103,"spinlock_wait_cycles":65741696,"thread_start_us":436016,"threads_started":2,"wal-append.queue_time_us":906716}
I20260709 13:16:06.288614 11001 rpcz_store.cc:276] 0709 13:16:05.079194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.395234 (+316040us) service_pool.cc:224] Handling call
0709 13:16:05.432409 (+ 37175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.463152 (+ 30743us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:05.908129 (+444977us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.269973 (+361844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:06.270031 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:06.270074 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.270151 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.270291 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":616057,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":107,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"thread_start_us":608707,"threads_started":2}
I20260709 13:16:06.316644 13051 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.450537 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.451314 10247 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
W20260709 13:16:06.324142 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 52292.4us
W20260709 13:16:06.344450 13070 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.786s	user 0.005s	sys 0.004s
W20260709 13:16:06.346879 13250 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.286s	user 0.011s	sys 0.000s
I20260709 13:16:06.349568 10996 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:06.311355 13381 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.357133 13347 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.490763 13347 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:06.491791 13347 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.493070 13347 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.359331 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:06.361617 10398 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:06.495173 13100 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.495530 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.405890 13163 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.495869 13100 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:06.496372 13100 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.496697 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:06.497278 10398 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:06.365398 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2175) took 1355 ms. Trace:
I20260709 13:16:06.369987 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2033) took 1169 ms. Trace:
I20260709 13:16:06.498054 13306 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.498278 10391 rpcz_store.cc:276] 0709 13:16:05.200334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.200518 (+   184us) service_pool.cc:224] Handling call
0709 13:16:05.225701 (+ 25183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.866851 (+641150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.369619 (+502768us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54002dd054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:06.369887 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472883456}
I20260709 13:16:06.498651 13306 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.501009 13306 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:06.378685 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:06.501535 13306 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:06.501871 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 123271us
I20260709 13:16:06.381178 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2285) took 2042 ms. Trace:
I20260709 13:16:06.382171 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:06.503835 10997 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:06.387187 13387 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.504571 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:06.388196 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.392184 13362 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.396189 10243 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:06.401826 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.402817 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.530635 10242 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:06.404510 10248 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:06.411053 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.362128 13356 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.458437 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.478412 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.348140 13372 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.539006 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:06.489123 10245 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:06.394835 13073 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.489610 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:06.490346 13381 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.364257 10390 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:06.497840 10320 rpcz_store.cc:276] 0709 13:16:05.010289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.325593 (+315304us) service_pool.cc:224] Handling call
0709 13:16:05.380739 (+ 55146us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:05.514199 (+133460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.365112 (+850913us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54003ec1d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:06.365316 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90982272}
I20260709 13:16:06.501557 10391 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.460368 13260 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.350548 13368 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.502810 10244 rpcz_store.cc:276] 0709 13:16:04.338510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.338734 (+   224us) service_pool.cc:224] Handling call
0709 13:16:04.354498 (+ 15764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.780104 (+1425606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.380825 (+600721us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540009ef54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:06.381088 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473734912}
I20260709 13:16:06.406939 13364 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.338990 13091 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.487756 13070 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.534921 10249 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:06.536338 13424 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.535748 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:06.613000 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 77337.8us
I20260709 13:16:06.613883 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:06.455722 13011 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:06.540503 10242 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:06.538338 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:06.508684 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.541968 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1570) took 1171 ms. Trace:
I20260709 13:16:06.618315 10390 rpcz_store.cc:276] 0709 13:16:05.370646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.375668 (+  5022us) service_pool.cc:224] Handling call
0709 13:16:06.363489 (+987821us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:16:06.363764 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.541701 (+177937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.541909 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41876736}
I20260709 13:16:06.444073 13321 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:06.555051 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50620.9us
I20260709 13:16:06.594473 13354 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.535827 10241 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:06.606696 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:06.459759 13395 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:16:06.662276 10245 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:06.542307 13271 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.541951 13355 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.460685 13051 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.502106 13306 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.551149 13421 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.584683 13175 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:06.537091 13387 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.667982 13424 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.661260 13073 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:06.623303 13260 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:06.539142 13362 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.612219 13381 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:06.740504 13427 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:06.740773 13381 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.741309 13427 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:06.743294 13405 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 13:16:06.744513 13409 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:16:06.745076 13362 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.745734 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2116) took 1357 ms. Trace:
I20260709 13:16:06.707623 13073 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.760804 13073 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.690929 13378 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.667294 13011 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.749410 10245 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:06.765763 13011 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.683364 13428 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:06.746243 13411 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:16:06.701833 13254 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.798741 13428 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:06.789426 13100 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.799357 13428 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.802767 13175 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.746124 10324 rpcz_store.cc:276] 0709 13:16:05.388539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.585315 (+196776us) service_pool.cc:224] Handling call
0709 13:16:05.585671 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.669696 (+ 84025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.669725 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.880175 (+210450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.263251 (+383076us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:06.263293 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.263366 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.745469 (+482103us) raft_consensus.cc:1685] finished
0709 13:16:06.745490 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.745661 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":58747,"thread_start_us":295391,"threads_started":1,"wal-append.queue_time_us":479322}
I20260709 13:16:06.790333 13321 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.798617 13387 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.791550 13051 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.725028 13431 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.793877 13398 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:06.794078 13091 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:06.795185 13205 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:06.796357 13372 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:06.699415 13355 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:06.796828 13070 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:06.798605 13287 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.210s	user 0.011s	sys 0.001s
I20260709 13:16:06.789063 13260 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:06.826071 10322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 494) took 1780 ms (client timeout 1654 ms). Trace:
I20260709 13:16:06.826947 10325 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:06.838340 13265 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.931s	user 0.004s	sys 0.008s
I20260709 13:16:06.854638 13431 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:06.700553 13271 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.159029 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 635) took 1049 ms. Trace:
I20260709 13:16:07.116894 13398 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.160336 13398 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.159667 11000 rpcz_store.cc:276] 0709 13:16:06.109183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.231914 (+122731us) service_pool.cc:224] Handling call
0709 13:16:06.232278 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.232516 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.232545 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.233054 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.272727 (+ 39673us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:06.272760 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.272821 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.158740 (+885919us) raft_consensus.cc:1685] finished
0709 13:16:07.158769 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.158951 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":39402,"threads_started":1,"wal-append.queue_time_us":321297}
W20260709 13:16:07.164906 10322 rpcz_store.cc:269] 0709 13:16:05.045205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.077163 (+ 31958us) service_pool.cc:224] Handling call
0709 13:16:06.825790 (+1748627us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400209c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:06.825994 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453132032}
W20260709 13:16:07.150681 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 526617us
I20260709 13:16:07.171795 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:16:06.948593 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 333367us
W20260709 13:16:07.175995 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.061266 10362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.011s
W20260709 13:16:07.177086 10362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.000s	sys 0.011s
I20260709 13:16:07.177264 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2113) took 1919 ms. Trace:
W20260709 13:16:07.177624 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 818323us
I20260709 13:16:07.178857 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:07.182035 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.184368 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:07.185623 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:07.185774 10393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2036) took 1974 ms (client timeout 2106 ms). Trace:
I20260709 13:16:07.188475 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:07.183665 13430 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.179668 13254 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:07.191462 13430 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:07.177911 10323 rpcz_store.cc:276] 0709 13:16:05.298802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.413009 (+114207us) service_pool.cc:224] Handling call
0709 13:16:05.837917 (+424908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:05.874163 (+ 36246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:05.924190 (+ 50027us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.271022 (+346832us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:06.273222 (+  2200us) log.cc:844] Serialized 52 byte log entry
0709 13:16:06.273571 (+   349us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:06.541999 (+268428us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.542733 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.542802 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.800413 (+257611us) raft_consensus.cc:1685] finished
0709 13:16:06.800434 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.177204 (+376770us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74740,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":17709,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":21145,"thread_start_us":513681,"threads_started":2,"wal-append.queue_time_us":489593}
W20260709 13:16:07.188477 10393 rpcz_store.cc:269] 0709 13:16:05.204742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.205188 (+   446us) service_pool.cc:224] Handling call
0709 13:16:07.178733 (+1973545us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540045c254. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:07.178847 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252199168}
I20260709 13:16:07.193912 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:07.163396 13398 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.158677 13306 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.204286 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.197554 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:07.183861 13372 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.211300 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:07.210000 10247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.003s	sys 0.025s
I20260709 13:16:07.210378 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.192523 13297 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.191968 13430 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:06.796370 13073 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.196179 13091 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:07.297135 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 85940.2us
I20260709 13:16:07.186293 13347 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:07.191779 13254 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.254889 13205 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.191985 13276 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:07.184894 13287 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:07.303791 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 93537.7us
I20260709 13:16:07.189456 13364 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.328902 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:07.306349 13321 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.184101 13265 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.207918 13424 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.196326 13436 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:07.308650 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 767) took 2078 ms (client timeout 1632 ms). Trace:
I20260709 13:16:07.197427 13250 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:16:07.313832 13205 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.192785 13440 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:16:07.311206 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.302152 13387 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.304407 13051 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:07.304055 13411 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.102s	user 0.001s	sys 0.002s
I20260709 13:16:07.303283 13423 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.224474 13398 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:16:07.330847 13321 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.307477 13091 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:07.332893 10994 rpcz_store.cc:269] 0709 13:16:05.226045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.300315 (+ 74270us) service_pool.cc:224] Handling call
0709 13:16:07.303741 (+2003426us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400639f54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:07.303902 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469446912}
W20260709 13:16:07.300105 10247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.008s	sys 0.039s
I20260709 13:16:07.346814 10250 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.345825 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:07.393110 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47387.5us
I20260709 13:16:07.394059 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.344069 13205 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.351449 13387 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:07.353155 13426 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:16:07.354456 13271 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.355510 13287 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.356153 13431 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.363385 13321 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.357491 13073 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.302922 13306 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:16:07.350795 13427 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.343429 13436 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:07.393386 13428 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.006s
I20260709 13:16:07.359840 13423 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.416929 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2039) took 2033 ms. Trace:
I20260709 13:16:07.437672 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1584) took 1035 ms. Trace:
I20260709 13:16:07.438266 10391 rpcz_store.cc:276] 0709 13:16:06.402197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.544826 (+142629us) service_pool.cc:224] Handling call
0709 13:16:06.545171 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.677002 (+131831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.677030 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:06.677070 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:06.677096 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.437279 (+760183us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540021b954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:07.437343 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.437581 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302728960}
I20260709 13:16:07.395213 13424 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.421407 13367 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.393561 13091 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.364120 13381 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.392994 13011 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:16:07.425208 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 220538us
I20260709 13:16:07.457708 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:07.424713 13443 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.391571 13051 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.423390 13260 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.430756 10394 rpcz_store.cc:276] 0709 13:16:05.383967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.384097 (+   130us) service_pool.cc:224] Handling call
0709 13:16:06.386654 (+1002557us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800173d98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:16:06.386876 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.551201 (+164325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.551238 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.661063 (+109825us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.017150 (+356087us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:07.017207 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.416654 (+399447us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54004501d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:07.416697 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.416730 (+    33us) raft_consensus.cc:1685] finished
0709 13:16:07.416739 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.416873 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21474,"raft.queue_time_us":143578,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":15429,"spinlock_wait_cycles":274595328,"thread_start_us":292294,"threads_started":1,"wal-append.queue_time_us":463134}
I20260709 13:16:07.434103 13427 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:07.451682 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 122848us
I20260709 13:16:07.434369 13423 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.452732 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2280) took 3235 ms. Trace:
W20260709 13:16:07.452703 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 249345us
I20260709 13:16:07.434653 13428 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.468070 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:07.469338 13428 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.462479 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:07.451391 13254 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.466142 10243 rpcz_store.cc:276] 0709 13:16:04.214702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.214841 (+   139us) service_pool.cc:224] Handling call
0709 13:16:04.234409 (+ 19568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.395988 (+2161579us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b54001444a0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5fdc0 00007f58c3aea1c0 00007f58c3aeb231 00007f58c3ae7d8f 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c
0709 13:16:06.529746 (+133758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.449758 (+920012us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540006ccd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:07.450017 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234225408}
W20260709 13:16:07.476672 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82690.9us
I20260709 13:16:07.477655 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:07.462726 13381 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.481209 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:07.482097 10324 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:07.484191 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:07.472651 13187 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:16:07.485996 13271 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:07.486400 13271 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:07.487234 13271 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.488401 13271 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.490329 13447 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.490877 13447 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.491825 10392 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:07.492590 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1566) took 2485 ms. Trace:
I20260709 13:16:07.493270 10322 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:07.492914 10392 rpcz_store.cc:276] 0709 13:16:05.007362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.007591 (+   229us) service_pool.cc:224] Handling call
0709 13:16:05.038400 (+ 30809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.491658 (+2453258us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002128a0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5fdc0 00007f58c3aea1c0 00007f58c3aeb231 00007f58c3ae7d8f 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c
0709 13:16:07.492245 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.492485 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277142272}
I20260709 13:16:07.494014 13387 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:07.490895 13442 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:16:07.463970 13073 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.493016 10319 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:07.499640 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.501708 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:07.474678 13265 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.495150 13445 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:07.503281 13445 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.503446 13372 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.503643 13445 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.504305 13423 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.505813 13446 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:16:07.506839 13446 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:07.507205 13446 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:07.508258 13446 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.508773 13423 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:07.501245 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:07.462531 13011 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.495743 13436 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.522097 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:07.471038 13443 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:07.530857 11002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 726) took 3460 ms (client timeout 1500 ms). Trace:
I20260709 13:16:07.518682 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:07.522707 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:07.541110 10395 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:07.530550 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54159.2us
I20260709 13:16:07.543032 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1477) took 1091 ms. Trace:
I20260709 13:16:07.543335 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:07.523317 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:07.523985 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:07.524792 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:07.522464 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:07.546463 10319 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
W20260709 13:16:07.540087 11002 rpcz_store.cc:269] 0709 13:16:04.034351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.034467 (+   116us) service_pool.cc:224] Handling call
0709 13:16:07.494169 (+3459702us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54004f42d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:07.495009 (+   840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2733305600}
I20260709 13:16:07.548381 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:07.525769 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:07.549677 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:07.542089 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:07.552112 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:07.553308 10395 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:07.543303 10247 rpcz_store.cc:276] 0709 13:16:06.451795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.452097 (+   302us) service_pool.cc:224] Handling call
0709 13:16:06.452381 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.452608 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:06.548789 (+ 96181us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.542746 (+993957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.542789 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:07.542827 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.542881 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.542988 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":471096,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":32406,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2082,"spinlock_wait_cycles":4820352,"thread_start_us":1026259,"threads_started":3,"wal-append.queue_time_us":814408}
I20260709 13:16:07.555249 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:07.556270 10323 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:07.556308 10395 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:07.557657 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:07.558362 10316 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.479741 13306 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.549568 13276 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:07.519073 13423 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:07.509743 13446 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.510538 13424 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.564954 10245 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:07.561393 13440 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.512077 13372 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.565747 13265 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:07.566187 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:07.566322 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.489881 13430 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.573065 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:07.579308 13265 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:07.579768 13265 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.580116 13265 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.580422 13430 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.566396 13443 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.566864 13276 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.554656 13347 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.567553 13321 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.516693 13011 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.499974 13364 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.567808 13187 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.540053 13254 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:07.555084 13377 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.510257 13073 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:07.567858 13070 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:07.575892 13378 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:07.583396 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:07.585769 10243 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:07.587071 10316 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:07.562847 13306 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:07.574484 13423 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:07.588866 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 112501us
I20260709 13:16:07.583447 13424 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.593958 10392 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:07.602598 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.596061 13457 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.574359 13362 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:07.594918 13377 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:07.614990 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.618432 11002 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.617906 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:07.602596 13306 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.622697 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.623363 11000 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:07.625240 13452 consensus_queue.cc:1059] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:07.625989 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.626219 13452 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:07.621323 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.626726 13452 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:07.627024 10997 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.627219 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.627912 11001 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:07.627662 13452 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.628324 13387 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:07.628733 13387 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:07.628787 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.620340 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.608273 13424 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.621323 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:07.621961 10998 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:07.621876 13276 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.630658 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.631574 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:07.606498 13423 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.650210 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.589540 13091 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.620355 13377 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.634379 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.634007 10994 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.620473 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:07.662515 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:07.662562 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.637722 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:07.663719 10323 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:07.634331 13175 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.616518 13457 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.642936 13073 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.644150 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2114) took 2265 ms. Trace:
I20260709 13:16:07.647094 10393 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.601926 13187 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.690114 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.614707 13430 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.614531 13440 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.631057 13367 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:07.629004 13452 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.660405 11001 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:07.666625 11002 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
W20260709 13:16:07.672114 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:07.672150 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.673985 13321 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:07.674578 13446 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:07.629657 13387 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.717834 13381 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:07.676571 13260 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:07.677035 13448 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:07.677670 13175 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:07.678435 13265 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.599776 13070 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.686342 10994 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:07.687786 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.688468 10325 rpcz_store.cc:276] 0709 13:16:05.378792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.434026 (+ 55234us) service_pool.cc:224] Handling call
0709 13:16:06.826683 (+1392657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.170389 (+343706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.643788 (+473399us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400209c50. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:07.644019 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3201963904}
I20260709 13:16:07.696221 10397 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:07.699016 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:07.658057 13456 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.753659 13355 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.754340 13355 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.754179 13456 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.755028 13265 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.701041 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:07.757154 13456 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.757961 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.759176 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.760350 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.705957 13458 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:07.703480 13306 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.690852 10244 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:07.659408 10997 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:07.708731 10393 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:07.752741 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:07.710498 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.671195 13378 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:07.711717 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.714074 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.714880 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:07.716450 13454 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:16:07.717216 13460 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.050s	user 0.000s	sys 0.004s
I20260709 13:16:07.764467 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:07.820638 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.821358 10244 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:07.821245 13378 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.822539 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.823500 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.824429 10997 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:16:07.825402 10998 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:07.675992 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.718578 13187 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.719282 13457 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:07.824196 11001 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:07.714129 13427 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:07.727223 13389 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.382s	user 0.006s	sys 0.018s
I20260709 13:16:07.690264 13287 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:16:07.712730 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:07.834847 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 122187us
I20260709 13:16:07.829763 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.694413 13372 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:07.739730 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 744) took 1661 ms. Trace:
I20260709 13:16:07.743840 13448 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:07.760120 13205 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.707414 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:07.753739 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 54818us
I20260709 13:16:07.710281 13430 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:07.721782 13051 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.759199 13091 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.845240 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.845597 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.734386 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:07.836098 10994 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:07.842893 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.822551 13265 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:07.846577 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 112280us
I20260709 13:16:07.831449 10247 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:07.840787 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.846609 11001 raft_consensus.cc:2376] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8. Re-sending same reply.
I20260709 13:16:07.836850 10999 rpcz_store.cc:276] 0709 13:16:06.078399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.211511 (+133112us) service_pool.cc:224] Handling call
0709 13:16:06.267038 (+ 55527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.407787 (+140749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.407831 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.457028 (+ 49197us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.538946 (+ 81918us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:06.538988 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.733567 (+1194579us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400750154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:07.733625 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.733679 (+    54us) raft_consensus.cc:1685] finished
0709 13:16:07.733696 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.739632 (+  5936us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":13316,"spinlock_wait_cycles":322529024,"thread_start_us":41116,"threads_started":1,"wal-append.queue_time_us":211630,"wal-append.run_cpu_time_us":1843,"wal-append.run_wall_time_us":1090644}
I20260709 13:16:07.853340 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.855441 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.855516 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 633) took 2939 ms. Trace:
I20260709 13:16:07.843904 13254 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.857044 10243 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.856251 10995 rpcz_store.cc:276] 0709 13:16:04.915899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.952661 (+ 36762us) service_pool.cc:224] Handling call
0709 13:16:04.976436 (+ 23775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:04.976875 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:04.976908 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:04.994296 (+ 17388us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.375945 (+381649us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:05.375993 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.376070 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.726577 (+2350507us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:07.855204 (+128627us) raft_consensus.cc:1685] finished
0709 13:16:07.855225 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.855429 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1611,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":11489152,"thread_start_us":381266,"threads_started":1,"wal-append.queue_time_us":1226366}
I20260709 13:16:07.843039 13436 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.861533 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.862141 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.863173 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.863762 13254 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.867396 13378 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:07.869452 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.844250 13457 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:07.865965 13254 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.871480 10997 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:07.873365 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.874786 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.874697 13448 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.875945 13430 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.862733 13436 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.876804 13205 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.878540 13070 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.884676 10994 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:07.851982 13398 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.881508 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.913268 13398 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:07.913647 10241 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:07.913731 13398 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.857313 13367 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:07.914995 13457 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.917871 13457 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:07.903537 10243 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:16:07.903613 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:07.907799 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:07.859416 13265 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:07.911180 13436 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.908787 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:07.964986 13254 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.924784 13378 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:07.974329 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:07.994854 13073 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.995251 13271 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.995054 13446 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.040011 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.037670 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:08.044373 13398 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:08.045423 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53347.3us
I20260709 13:16:08.047976 13097 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.047585 13446 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.048542 13271 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:07.991735 13378 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.050671 13271 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.052088 13378 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:08.055403 13445 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
I20260709 13:16:08.055737 13070 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:08.056267 13070 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:08.056006 13445 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.056733 13070 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.057766 11000 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:07.982760 13424 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.023244 13377 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.050598 13265 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.059666 13424 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:08.045444 13073 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.050645 13446 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.062619 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:08.063431 10391 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:08.062671 13073 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.064556 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:08.065366 10997 raft_consensus.cc:2410] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:08.065120 13070 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:08.065865 10246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2305) took 1661 ms (client timeout 1769 ms). Trace:
W20260709 13:16:08.066286 10246 rpcz_store.cc:269] 0709 13:16:06.404159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.406884 (+  2725us) service_pool.cc:224] Handling call
0709 13:16:08.065709 (+1658825us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b5400070154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:08.065805 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055412992}
I20260709 13:16:08.067204 13070 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.067858 13436 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.069451 13436 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:08.018465 13306 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.097090 10325 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:08.110214 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:08.095652 13439 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.003s	sys 0.003s
I20260709 13:16:08.114938 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.086956 13458 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:16:08.086614 13254 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:16:08.116724 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.117636 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.117008 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.088774 13470 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:16:08.231177 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 658) took 2126 ms. Trace:
I20260709 13:16:08.231652 10250 rpcz_store.cc:276] 0709 13:16:06.104369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.104541 (+   172us) service_pool.cc:224] Handling call
0709 13:16:06.175910 (+ 71369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.395487 (+1219577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.230916 (+835429us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002eca54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:08.231113 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692275968}
I20260709 13:16:08.224990 10325 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:08.233371 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.234022 10325 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:08.234117 13366 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.234910 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.235543 10325 raft_consensus.cc:2368] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:16:08.238747 13398 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.213745 10321 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.194164 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 741) took 2119 ms. Trace:
W20260709 13:16:08.144811 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 72064.4us
I20260709 13:16:08.118112 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.159807 10322 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:08.117624 10319 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:08.226204 13445 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:08.223557 13466 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:16:08.160272 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.240633 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:08.213287 13423 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.003s
I20260709 13:16:08.242151 13285 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.258981 13423 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.260385 10396 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.261178 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.242739 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:08.214152 13439 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.004s	sys 0.019s
I20260709 13:16:08.243326 13447 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.262487 10317 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:08.263708 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.265465 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.266538 10316 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.276698 13347 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:08.277114 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.278610 13163 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:08.279129 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.280236 10319 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:08.280848 13414 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.732s	user 0.008s	sys 0.014s
I20260709 13:16:08.281415 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.257566 10996 rpcz_store.cc:276] 0709 13:16:06.075175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.092001 (+ 16826us) service_pool.cc:224] Handling call
0709 13:16:06.123862 (+ 31861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.483171 (+359309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.193732 (+1710561us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54005249d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:08.194071 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518374272}
I20260709 13:16:08.096988 13306 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.302069 13306 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.304121 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.305022 13306 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.305897 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:08.283460 10250 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:08.371177 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 65365.7us
I20260709 13:16:08.262562 10323 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.371878 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.372545 10250 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.372622 13431 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:08.373342 13431 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:08.283774 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.374439 10247 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.375403 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.376302 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.376572 13051 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:08.377180 13051 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:08.377664 13051 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.379973 10250 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:08.386513 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.387669 10391 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.388681 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:08.389112 10250 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:08.389632 10391 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.287679 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.296078 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.391439 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.392136 10322 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:16:08.392985 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.393688 10322 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:16:08.394253 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.394578 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.395712 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.396803 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.397840 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:08.398480 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.398705 10250 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:08.399103 13377 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.400750 10241 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:08.401962 13011 raft_consensus.cc:3055] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:08.402403 13011 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:08.399142 13470 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:08.296280 13401 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:08.403226 13011 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.403967 13470 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.404597 13011 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.405537 13387 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.376349 10395 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:08.406726 13470 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.407362 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.408195 10395 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:08.409289 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:08.409940 10395 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.261983 13423 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:08.269968 13447 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:16:08.441706 13447 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:08.442238 13447 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:08.443329 13447 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.444947 13447 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.306015 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.447172 10243 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:08.308617 13451 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:08.309275 13250 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:08.448374 13250 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:08.448403 13451 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.449381 13250 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.450567 13250 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:08.452046 13451 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:08.244447 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.454028 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.454643 10325 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.310447 10317 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:08.311885 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 587) took 2131 ms. Trace:
I20260709 13:16:08.456475 10398 rpcz_store.cc:276] 0709 13:16:06.180840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.499746 (+318906us) service_pool.cc:224] Handling call
0709 13:16:06.500029 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.691206 (+191177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.691239 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:06.691282 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:06.691316 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.311663 (+1620347us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540027b854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:08.311703 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.311831 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439192448}
I20260709 13:16:08.458019 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.459266 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.321455 13364 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.322165 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.459769 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.460227 10393 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:08.460110 13364 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.461139 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:08.461711 10393 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.461540 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.323511 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.323547 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1479) took 1871 ms. Trace:
I20260709 13:16:08.459836 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:08.462540 10249 rpcz_store.cc:276] 0709 13:16:06.452426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.622905 (+170479us) service_pool.cc:224] Handling call
0709 13:16:06.699942 (+ 77037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.026004 (+1326062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.026049 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.026104 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:08.026147 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.323327 (+297180us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540043d5d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:08.323377 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.323493 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049059200}
I20260709 13:16:08.463187 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.463883 13364 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.464004 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.464403 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.465034 10318 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.465456 10249 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:08.465975 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.328570 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.470645 10390 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:08.471629 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:08.472163 10390 raft_consensus.cc:2376] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8. Re-sending same reply.
I20260709 13:16:08.473027 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.314121 10321 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:08.474888 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.475862 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.476485 10321 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:08.477047 10393 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:08.477218 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.477960 10321 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:08.339775 13445 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.340109 10996 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:08.342517 11002 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:16:08.343963 13480 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:08.478600 13445 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.479223 13377 raft_consensus.cc:3055] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:08.345983 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.480501 10399 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.480758 13445 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.345248 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:08.481546 10993 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.482342 13377 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:08.483404 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:08.484207 13480 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:08.484705 13480 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:08.348429 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.485545 13480 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.486734 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.488248 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:08.352672 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.359620 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.481518 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:08.490177 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.490576 10399 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:08.491314 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.491742 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.492856 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.493152 10318 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:08.493654 10321 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:08.367826 13163 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:08.351799 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.494182 13163 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.495154 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.496325 10392 raft_consensus.cc:2410] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:08.496847 13163 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.497390 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.366704 11000 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:08.368764 13376 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:08.498669 13376 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:08.499544 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.500185 10321 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:08.499840 13376 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.383586 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.501003 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:08.501547 10321 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:08.501570 10324 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:16:08.474030 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.502961 10390 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.503342 10324 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:08.504875 10324 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:08.401960 10322 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:08.507242 10993 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:08.507642 10322 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:08.277313 13347 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.510975 10321 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:08.367658 13381 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.514802 13381 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.477955 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:08.516287 10393 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.493940 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.419966 13100 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.283499 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.422652 10323 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:08.412835 13431 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.327540  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:08.427534 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.428229 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.522400 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:08.528275 10392 raft_consensus.cc:2410] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:08.431267 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:08.433346 13293 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.433813 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:08.434906 13424 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:08.536746 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 105585us
W20260709 13:16:08.435505 10364 connection.cc:256] RPC call timeout handler was delayed by -1.8788073739997344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:16:08.436074 13401 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.466679 10249 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:08.325217 13440 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:08.463275 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.479317 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.294401 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:08.492090 10397 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.364648 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.493348 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:08.377573 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:08.553905 10396 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:08.420236 10247 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:08.423046 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:08.521569 10316 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
W20260709 13:16:08.555953 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 133060us
I20260709 13:16:08.557132 10213 leader_election.cc:400] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:16:08.557569 10213 leader_election.cc:403] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:08.525202 10246 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:08.529767 10317 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:08.530172 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.531296 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:08.540285 10364 connection.cc:256] RPC call timeout handler was delayed by -1.5906555520000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:16:08.559942 10364 connection.cc:256] RPC call timeout handler was delayed by -1.3791555519999292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 13:16:08.560575 10364 connection.cc:256] RPC call timeout handler was delayed by -1.3764555519999249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:16:08.561053 10364 connection.cc:256] RPC call timeout handler was delayed by -1.3359555520000868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:16:08.561544 10364 connection.cc:256] RPC call timeout handler was delayed by -1.1235555519999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:16:08.562012 10364 connection.cc:256] RPC call timeout handler was delayed by -1.0182555520000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:16:08.563784 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.565306 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:08.567463 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 133772us
I20260709 13:16:08.568017 10399 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:08.570469 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 122538us
I20260709 13:16:08.571453 10364 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:08.570745 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:08.543987 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:08.554528 10245 raft_consensus.cc:2410] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:08.574870 10393 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:16:08.576002 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.623024 13366 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:08.624190 13366 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:08.576077 10362 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:16:08.538198 13163 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:08.624917 10362 leader_election.cc:403] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:08.576843 13470 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:08.577550 13423 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:08.565400 13424 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.578660 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:08.579872 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.535432 13100 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.569609 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:08.582930 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.524621 13456 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:16:08.585000 13401 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.551728 13293 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.549495 13480 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:08.588770 13381 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.589931 13283 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:08.592667 13431 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.659272 10145 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.593562 13451 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.593827 13364 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.595104 13443 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:16:08.598734 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:08.665093 10247 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:08.647042 13470 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:08.583069 10290 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:08.535804 13377 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.605578 13347 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:08.615199 10397 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:16:08.674973 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 91975.3us
I20260709 13:16:08.563642 10325 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:16:08.621912 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47812.4us
I20260709 13:16:08.677872 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:08.624588 13366 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:08.658604 13423 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:08.625137 13163 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.630266 10395 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
W20260709 13:16:08.632184 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 65428.5us
W20260709 13:16:08.636180 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 66685.4us
I20260709 13:16:08.642704 10392 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:08.651671 10393 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:08.656566 10144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 309) took 14807 ms (client timeout 15000 ms). Trace:
I20260709 13:16:08.658198 10244 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.632915 13481 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:08.632392 13436 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:16:08.665889 10391 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:08.664542 10145 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 5, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 5 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.657768 13249 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.626638 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82746.7us
I20260709 13:16:08.839677 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:08.689913 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.842876 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.664758 13364 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.663141 13451 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:08.667152 13470 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.734193 13285 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.815974 13401 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.816252 13051 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:08.817514 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.817636 13293 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.676108 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:08.880950 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 204972us
W20260709 13:16:08.821605 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 143851us
I20260709 13:16:08.820025 13100 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.874897 10145 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 5 to 6, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:08.904448 10275 heartbeater.cc:646] Failed to heartbeat to 127.8.238.254:38317 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.238.254:38317 timed out after 15.000s (SENT)
I20260709 13:16:08.905714 10145 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.907109 13250 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:08.907725 13250 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.907487 10145 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 1 to 7, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 7 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.874897 13470 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:08.896895 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 71561.3us
I20260709 13:16:08.911371 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:08.897476 13306 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:08.913208 13306 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.913589 13306 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.878093 13249 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.916407 13249 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.861438 13480 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.876926 13364 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.881699 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:08.919459 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:08.921500 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.924234 13401 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.826371 10144 rpcz_store.cc:269] 0709 13:15:53.849587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.850347 (+   760us) service_pool.cc:224] Handling call
0709 13:16:08.656503 (+14806156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:04.724578 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:04.725329 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:04.725386 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:16:04.725417 (+    31us) tablet.cc:662] Decoding operations
0709 13:16:04.750886 (+ 25469us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:04.771537 (+ 20651us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:04.773921 (+  2384us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:16:04.821415 (+ 47494us) tablet.cc:701] Row locks acquired
0709 13:16:04.821473 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:16:04.821644 (+   171us) write_op.cc:270] Start()
0709 13:16:04.821795 (+   151us) write_op.cc:276] Timestamp: P: 1783602964821583 usec, L: 0
0709 13:16:04.821820 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:04.822530 (+   710us) log.cc:844] Serialized 1691 byte log entry
0709 13:16:06.441620 (+1619090us) op_driver.cc:464] REPLICATION: finished
0709 13:16:07.165272 (+723652us) write_op.cc:301] APPLY: starting
0709 13:16:07.165400 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:07.165646 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:07.165828 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:07.166695 (+   867us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:07.196702 (+ 30007us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:16:07.203740 (+  7038us) write_op.cc:312] APPLY: finished
0709 13:16:07.331236 (+127496us) log.cc:844] Serialized 41 byte log entry
0709 13:16:07.485113 (+153877us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.536375 (+ 51262us) write_op.cc:454] Released schema lock
0709 13:16:07.556840 (+ 20465us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:07.591040 (+ 34200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.592765 (+  1725us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":455594,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":723262,"apply.run_cpu_time_us":19465,"apply.run_wall_time_us":417959,"num_ops":4,"prepare.queue_time_us":137211,"prepare.run_cpu_time_us":25627,"prepare.run_wall_time_us":251317,"raft.queue_time_us":836346,"raft.run_cpu_time_us":105395,"raft.run_wall_time_us":666781,"replication_time_us":1491327,"thread_start_us":1183453,"threads_started":5,"wal-append.queue_time_us":413816,"wal-append.run_cpu_time_us":29833,"wal-append.run_wall_time_us":2827411}]]}
I20260709 13:16:08.924731 13401 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.909462 10145 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 5, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 5 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.822304 13423 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:08.821288 13440 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:08.835374 13163 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.922948 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:08.946769 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:08.947949 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:08.933007 10248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.003s	sys 0.026s
W20260709 13:16:08.948918 10248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.003s	sys 0.026s
I20260709 13:16:08.933413 13377 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.951849 13446 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.952333 13446 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.952733 13446 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:08.930195 13293 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:16:08.953672 13293 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:08.954053 13293 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:08.954320 13073 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.955006 13293 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.956231 13293 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.958330 13366 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:08.959852 13347 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.960464 13440 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:08.933434 13401 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.934897 13376 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.938519 10145 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 5, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 5 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:08.942708 13501 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:08.943933 13424 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:08.962859 10245 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:08.909961 13250 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:08.976959 10244 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:08.931651 13387 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:08.961712 13423 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.980584 10145 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:08.961212 13440 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.978509 13366 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:09.008090 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 429472us
W20260709 13:16:09.012115 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 187322us
I20260709 13:16:09.002416 10145 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 3 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:08.960786 13451 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.016891 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:08.983331 13387 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.029702 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:09.012935 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:09.030694 10364 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:09.038446 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:08.999778 13011 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.039692 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:16:09.041781 10362 connection.cc:256] RPC call timeout handler was delayed by -1.1333160899998802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 13:16:09.041798 10145 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 6 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.978650 13306 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.047772 10145 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.046056 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.037294 13283 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.056668 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.039081 13387 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.049043 13443 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:09.047029 13447 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.037170 13381 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:09.058070 10145 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 5 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.016764 13436 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:16:09.016562 13424 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:09.062602 13355 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:09.041410 13401 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:16:09.066299 13447 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:09.073102 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 205507us
I20260709 13:16:09.044695 13347 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:16:09.047292 13285 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:09.064185 13448 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.076447 10145 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 6, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.058763 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.066478 13443 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:09.063333 13283 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.074434 13502 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.090456 13447 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.128175 10242 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:16:09.129945 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 210555us
I20260709 13:16:09.100210 13443 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.131155 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:09.133286 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 185410us
I20260709 13:16:09.133752 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:09.144609 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.146103 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.145153 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.145820 10244 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:09.122040 13499 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:09.205946 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 73097.6us
I20260709 13:16:09.126976 13051 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:09.142611 13490 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:16:09.204452 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58441.3us
I20260709 13:16:09.122562 13481 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:09.208338 13505 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:09.208086 13163 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.211455 13440 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.143374 13448 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:09.145996 13109 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:09.143548 13498 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:09.144501 13502 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:09.216107 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:09.206571 13499 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:09.149350 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:09.143013 13285 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:09.229547 10362 connection.cc:256] RPC call timeout handler was delayed by -1.0280160899999373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:16:09.240650 13163 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:09.279883 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 221185us
I20260709 13:16:09.280710 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.227759 13448 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:09.241926 13306 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:09.238746 13505 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:09.256364 10993 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:09.256740 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.257109 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.371151 11002 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:09.258006 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.372323 10996 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:09.258441 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:09.263238 13497 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:16:09.270394 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54406.2us
I20260709 13:16:09.375450 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.271780 13109 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.271142 13510 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:09.271976 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 122701us
I20260709 13:16:09.271909 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 664) took 1708 ms. Trace:
I20260709 13:16:09.273663 13377 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:09.207930 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:09.282598 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 251954us
W20260709 13:16:09.291576 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.279709 13498 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:09.374032 10242 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:09.373522 11001 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
W20260709 13:16:09.377082 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 84479.4us
I20260709 13:16:09.257004 13470 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:09.282999 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.250303 13499 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.407336 13073 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.411093 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2069) took 1054 ms. Trace:
W20260709 13:16:09.411803 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.411561 10396 rpcz_store.cc:276] 0709 13:16:08.356463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.615520 (+259057us) service_pool.cc:224] Handling call
0709 13:16:08.615961 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.616374 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.616415 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.616938 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.017389 (+400451us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:09.017427 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.017509 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.410863 (+393354us) raft_consensus.cc:1685] finished
0709 13:16:09.410885 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.411028 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3190,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":400079,"threads_started":1,"wal-append.queue_time_us":476231}
I20260709 13:16:09.412495 13387 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.383545 13377 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:09.413873 13293 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.414009 13377 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.414429 13293 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.384775 13283 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:09.384491 13481 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.416425 13293 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:09.416419 13377 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:09.383737 13480 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:09.423044 13480 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:09.424630 13470 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:09.424216 13480 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.381919 13364 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:09.426896 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 219073us
I20260709 13:16:09.432575 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.396833 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.397485 13109 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.398398 13306 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.397984 13509 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:09.398981 13401 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:09.398873 13505 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.403700 13423 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.404476 13100 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:09.405084 13510 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:09.282752 13502 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:09.431496 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 44449.8us
W20260709 13:16:09.391201 10213 leader_election.cc:336] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.500s (SENT)
I20260709 13:16:09.475289 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:09.478997 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 87825.9us
I20260709 13:16:09.479140 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.320555 13355 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:09.444819 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.427098 13445 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.453081 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.454298 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.376637 10248 rpcz_store.cc:276] 0709 13:16:07.563671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.564931 (+  1260us) service_pool.cc:224] Handling call
0709 13:16:07.565225 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.568593 (+  3368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.568629 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.570906 (+  2277us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.342043 (+771137us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18002f6560. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:08.949281 (+607238us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:08.949320 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.949388 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.271592 (+322204us) raft_consensus.cc:1685] finished
0709 13:16:09.271619 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.271845 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":528,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":5415168,"thread_start_us":607058,"threads_started":1,"wal-append.queue_time_us":1109129}
I20260709 13:16:09.488296 10391 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:09.425978 13480 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.466249 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.490119 10394 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
W20260709 13:16:09.469575 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 72835us
I20260709 13:16:09.476137 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.441249 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.492947 10290 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.482146 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.463578 13283 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.382387 13285 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:09.484115 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.485080 10390 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:09.498417 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.455662 13163 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:09.458575 13376 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.486414 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:09.495483 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 54323.6us
I20260709 13:16:09.461642 13401 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:09.452000 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.430318 13446 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.503594 11002 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:16:09.509835 10997 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:09.504407 10393 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:16:09.502580 10362 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6.
I20260709 13:16:09.501993 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:09.513829 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.515704 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.469863 13508 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:09.546977 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:09.495875 13443 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.504514 13285 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:09.520287 10995 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:09.512936 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 120448us
I20260709 13:16:09.517077 13381 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.522845 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.495806 13507 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.530750 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.557365 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.531769 13510 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.501268 13163 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.534569 13355 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.537045 13502 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.537951 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.540697 10996 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:16:09.604301 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 76471us
I20260709 13:16:09.541103 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:09.500445 13511 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:09.545763 13445 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.546913 13446 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:09.426173 13498 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.626093 13387 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:09.518255 10364 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.629856 13511 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:09.630062 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 111887us
I20260709 13:16:09.631479 13511 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.631963 10364 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.632387 13511 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:09.632845 13511 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:09.538534 13470 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.519908 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.634507 13501 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.633872 13511 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.637430 10395 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:16:09.594744 13431 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:09.639170 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 137192us
I20260709 13:16:09.641993 10290 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:09.643599 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:09.646368 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:09.649461 10398 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:09.647236 10248 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:09.651973 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:09.652705 10996 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.558476 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:09.586073 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 106167us
I20260709 13:16:09.549787 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:09.655674 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 105965us
I20260709 13:16:09.541433 13440 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:09.596853 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 43858.4us
I20260709 13:16:09.656906 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.596022 13508 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:09.594467 13514 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.657686 13504 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.599851 13443 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:09.657742 13508 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.659092 13508 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.659477 13482 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:09.601143 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.660913 10399 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:09.662384 10399 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:09.549741 13509 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:09.503223 13306 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.606518 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.609543 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.658023 13514 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.620193 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.502503 13283 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.666985 13283 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:09.621289 11002 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:09.621388 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:09.668423 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 47108.2us
I20260709 13:16:09.668987 10397 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:09.669111 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:09.594427 13439 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:09.670470 13439 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:09.671082 10397 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:09.625188 13445 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:09.671468 13439 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.672814 13439 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.673390 13501 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.673847 13501 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:09.674270 13501 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.658787 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:09.676581 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.669968 13293 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:09.508029 13448 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.678644 13293 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.679136 13293 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.683409 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:09.684556 13445 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.670089 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:09.688410 13515 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.688899 13515 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.689282 13515 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.690151 13512 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:09.691126 13512 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:09.691449 13512 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:09.695730 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.696105 10396 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:09.699559 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 57854.4us
I20260709 13:16:09.714465 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:09.648919 13366 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.002s
I20260709 13:16:09.725988 10249 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:09.726871 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:09.727622 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:09.689210 13456 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:09.732565 10390 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:16:09.732837 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75313.7us
I20260709 13:16:09.739354 10997 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:09.726991 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:09.748127 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:09.749387 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:09.649272 13431 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:09.693817 13513 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:09.751919 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:09.755196 11002 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:09.755470 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:09.756269 10247 raft_consensus.cc:2393] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:09.756984 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:09.757648 11002 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.758605 10997 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:09.759454 10399 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:09.760705 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:09.761404 10242 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:09.762528 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:09.692333 13512 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.700645 13509 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:09.724908 13440 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:09.724364 13511 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.767165 10996 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:09.624485 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:16:09.784418 10392 raft_consensus.cc:606] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:09.784859 10392 raft_consensus.cc:614] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:09.714334 13283 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:09.772285 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.770776 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:09.763028 13424 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:09.621114 13523 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:16:09.744750 13456 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.758669 13498 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:09.786444 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:09.797626 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.635681 13516 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:16:09.779235 13347 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:09.780131 13520 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:16:09.808653 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:09.761875 13366 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:09.849155 11002 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:09.800968 13424 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:09.879048 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.884881 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.885756 10390 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.808001 13100 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:09.805147 13443 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.837222 13163 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:09.809343 13456 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.813195 13073 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:09.808923 13512 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.891062 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.899438 10394 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.899964 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.878423 13293 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:09.902418 13525 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:09.903712 13293 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:09.904821 13530 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:16:09.897161 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:09.764284 13285 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.906090 13424 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.907627 13424 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:09.815500 13347 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.766208 13528 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:09.816866 13517 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.893949 10395 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:09.816501 13518 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 13:16:09.911909 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.912851 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 198509us
I20260709 13:16:09.927065 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:09.920632 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 109051us
I20260709 13:16:09.895076 13443 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.877362 13366 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.802389 13283 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:09.928781 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:09.897382 13504 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.932591 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:09.898998 13073 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:09.808497 13431 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:09.912496 13347 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.938163 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:09.935096 13163 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.897583 13505 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:16:10.032591 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69237.1us
I20260709 13:16:09.930894 13366 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:10.034323 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.932400 13443 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.938637 13516 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.935338 13306 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.037413 11001 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:10.038555 10325 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:10.041508 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:10.043241 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.942852 13439 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:10.045476 11002 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.045970 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:09.959784 13510 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.958465 13377 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.941902 13293 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:16:09.964586 13011 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.051919 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:09.959688 13440 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:10.056357 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.056967 11002 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:10.057034 10316 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.057721 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.058312 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:10.059484 13513 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:10.060468 13513 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.067219 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.068099 10993 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:10.068467 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.068584 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.068166 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.073271 10316 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:09.897149 13509 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.067894 10325 raft_consensus.cc:2376] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6. Re-sending same reply.
I20260709 13:16:10.069329 10321 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:10.067880 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.069306 10317 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
I20260709 13:16:10.043756 13516 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:09.940039 13508 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.089121 10394 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
W20260709 13:16:10.097229 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 161599us
I20260709 13:16:10.100908 13283 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:10.067915 13377 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:10.102679 13532 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:16:10.103190 13534 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:16:10.103765 13377 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:10.104247 13537 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:16:10.066788 13501 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.104996 13515 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.106413 13528 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.106709 13501 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.106921 13528 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.107431 13501 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:10.047561 13100 consensus_queue.cc:1175] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:10.108119 13501 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:10.066751 13510 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.109194 13528 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.109112 13501 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.079089 13439 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:10.110340 13510 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:10.110555 13535 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:16:10.111534 10322 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:10.077328 13381 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:10.135582 10390 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:10.090996 13516 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.090669 13481 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.142452 10324 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.053274 13306 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.139534 10995 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:10.151562 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:10.160527 11002 raft_consensus.cc:2368] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:16:10.151889 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:10.152714 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:10.153185 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:10.161778 10996 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:10.153347 13100 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.165453 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:10.166219 10396 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:10.153900 13545 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:10.154646 13283 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:10.156351 10395 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:10.156747 10392 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:10.158658 10394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:16:10.158931 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.159057 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:10.189402 10394 raft_consensus.cc:606] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:10.189647 10997 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.069454 13011 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:10.168378 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.119402 13547 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:10.107434 13515 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.174743 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.176265 13513 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:10.177711 13533 log.cc:927] Time spent T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:16:10.177296 13100 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.179564 13548 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.147745 13541 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.066027 13073 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.191890 13440 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.192982 13523 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:10.194585 13381 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:10.195153 13011 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:10.195493 13447 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.059s	user 0.009s	sys 0.002s
I20260709 13:16:10.196081 10321 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:10.191045 10325 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:10.198621 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:10.229187 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:10.148607 13364 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.183881 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:10.198987 13538 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:16:10.120474 13518 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 13:16:10.189869 13499 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.000s
I20260709 13:16:10.177079 13285 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.170135 13439 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:10.233086 10324 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:10.167255 13481 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.211315 13424 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:10.218029 13523 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:10.222275 13381 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.198964 13401 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.203586 13513 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.277556 10391 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:10.286556 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:10.217679 13541 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.293901 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:10.252202 10322 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:10.235323 13283 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:10.258451 13376 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
W20260709 13:16:10.302282 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 71313.4us
I20260709 13:16:10.302717 10394 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:10.259279 13544 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:16:10.259392 13100 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.260067 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.262084 13540 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:10.263502 13401 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:10.263832 13481 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:10.236882 13545 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:10.232666 13447 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.249747 13515 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:10.304026 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.304672 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:10.332321 10325 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:10.332594 10993 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:10.298763 13283 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:10.305310 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:10.312935 10324 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 4.
W20260709 13:16:10.322273 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:10.334326 13283 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.337567 13514 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:10.339570 13443 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.341830 13443 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:10.210423 13548 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.344369 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:10.202195 13547 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.329850 10997 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:10.318594 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:10.346094 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:10.347761 10996 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
I20260709 13:16:10.248535 13285 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.354753 10213 leader_election.cc:400] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:16:10.246052 13499 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.354918 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:10.355815 10394 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:10.356937 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:10.357743 10394 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.312315 13376 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.315379 13250 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.361223 10248 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.272796 13424 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.365656 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:10.444128 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.445436 10994 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:10.350948 13545 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:10.446558 13512 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:16:10.447257 10391 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:10.354408 13518 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:10.460911 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 99427.6us
I20260709 13:16:10.344163 13504 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:16:10.361979 13011 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:10.343302 13364 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:16:10.476828 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.477674 10323 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:10.474282 10998 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:10.342473 13381 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.478654 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.446018 13109 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:10.485296 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.347790 13456 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.489585 10319 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:16:10.348464 13515 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.499020 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.448882 13545 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.459688 13376 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:10.455075 13508 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:10.345607 13540 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.465726 13518 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:10.354122 13439 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.444160 13510 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:16:10.701121 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:10.599023 10362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.542s (SENT) [suppressed 27 similar messages]
I20260709 13:16:10.704813 10324 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:10.701264 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 345388us
I20260709 13:16:10.589968 10394 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:10.536604 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.511797 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.707237 10318 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.707544 10323 raft_consensus.cc:2376] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10. Re-sending same reply.
W20260709 13:16:10.702867 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 397752us
I20260709 13:16:10.709486 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:10.703579 10322 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:10.702551 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.711097 10319 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:10.652632 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 190695us
I20260709 13:16:10.490985 13306 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.715849 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.719622 10318 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:10.722029 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:10.722111 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:10.724188 13531 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.468s	user 0.000s	sys 0.002s
I20260709 13:16:10.724500 13498 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:10.724938 13498 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:10.728372 10394 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:10.727945 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:10.731086 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:10.732867 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:10.733533 10998 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
W20260709 13:16:10.583472 13562 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:10.739782 10319 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:10.440858 13523 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.740912 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.601598 13364 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.572256 13376 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:10.708586 13518 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.604063 13424 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.746408 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:10.732060 13560 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:10.700371 13549 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.395s
W20260709 13:16:10.757855 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.758529 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.759307 10319 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 4: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:10.726833 13109 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:10.760807 13566 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.760430 13560 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.761381 13566 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.763504 13560 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.763655 13566 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:10.768736 13547 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:10.700162 13553 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.279s
I20260709 13:16:10.768989 13376 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.770602 13523 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.602689 13557 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.411s
I20260709 13:16:10.740360 13250 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:10.775486 13456 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:10.755151 13364 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.781558 13364 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.781698 13541 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.725848 13498 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:10.784672 13480 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.287s	user 0.008s	sys 0.003s
W20260709 13:16:10.785140 13507 consensus_meta.cc:287] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.188s	user 0.009s	sys 0.000s
I20260709 13:16:10.785567 13507 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.786578 13498 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:10.760869 13445 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.076s	user 0.012s	sys 0.000s
I20260709 13:16:10.787957 13445 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:10.789661 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.790738 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:10.792409 11000 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:10.793507 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 762) took 1282 ms. Trace:
I20260709 13:16:10.793854 11000 rpcz_store.cc:276] 0709 13:16:09.512339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.514327 (+  1988us) service_pool.cc:224] Handling call
0709 13:16:10.793340 (+1279013us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54006108d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:10.793446 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713935104}
I20260709 13:16:10.733692 13283 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:10.781927 13366 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.730s	user 0.005s	sys 0.002s
I20260709 13:16:10.795305 13515 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:10.796622 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50298.1us
I20260709 13:16:10.734998 13508 raft_consensus.cc:2764] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:16:10.808137 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:10.781252 13347 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.000s
I20260709 13:16:10.754541 13513 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:10.805971 13250 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.767907 13109 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:10.823531 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:10.808531 13306 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:10.742368 13011 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:10.835109 13283 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:10.835263 13011 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:10.836215 13381 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:10.828029 13499 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:10.805032 13366 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:11.138830 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.843535 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:11.585264 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.524968 10362 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.009s	sys 0.000s
I20260709 13:16:10.844173 11000 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:11.606562 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 518) took 1505 ms. Trace:
W20260709 13:16:10.985926 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.331066 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.173185 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.905879 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2077) took 1391 ms. Trace:
I20260709 13:16:10.847086 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 791) took 1111 ms. Trace:
W20260709 13:16:11.256724 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 212284us
W20260709 13:16:11.616596 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.616350 10393 rpcz_store.cc:276] 0709 13:16:09.513968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.606098 (+ 92130us) service_pool.cc:224] Handling call
0709 13:16:10.905616 (+1299518us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54002dda54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:10.905794 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087233792}
I20260709 13:16:10.814788 13509 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.314877 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:11.613919 10362 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.010s	sys 0.000s
W20260709 13:16:11.328819 10965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.011s	sys 0.018s
I20260709 13:16:11.621147 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:11.630849 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 1.03179e+06us
W20260709 13:16:11.631875 10965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.015s	sys 0.021s
W20260709 13:16:11.637698 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 906662us
W20260709 13:16:11.328500 13470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.008s	sys 0.032s
I20260709 13:16:11.632150 11001 rpcz_store.cc:276] 0709 13:16:09.735381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.735530 (+   149us) service_pool.cc:224] Handling call
0709 13:16:09.736067 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.059284 (+323217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.846842 (+787558us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400763ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:10.847031 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529838464}
I20260709 13:16:11.614502 10317 rpcz_store.cc:276] 0709 13:16:10.095991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.096129 (+   138us) service_pool.cc:224] Handling call
0709 13:16:10.096514 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.123500 (+ 26986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.123549 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.141101 (+ 17552us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.296630 (+155529us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:10.459139 (+162509us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.601319 (+1142180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.601436 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.601511 (+    75us) raft_consensus.cc:1685] finished
0709 13:16:11.601530 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.601716 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163458,"prepare.queue_time_us":415626,"raft.queue_time_us":125356,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":46698,"spinlock_wait_cycles":8660352,"thread_start_us":628255,"threads_started":3,"wal-append.queue_time_us":137261}
W20260709 13:16:11.368363 13523 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.001s
W20260709 13:16:10.850956 13511 consensus_meta.cc:287] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.066s	user 0.012s	sys 0.000s
W20260709 13:16:11.637409 10362 connection.cc:256] RPC call timeout handler was delayed by -1.0146953020000637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:16:10.842860 13548 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:11.642069 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:11.594302 13513 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.611063 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:11.258252 13567 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:11.585618 13424 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:11.645223 10393 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:16:11.646713 13516 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.471s	user 0.011s	sys 0.002s
I20260709 13:16:11.656427 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:11.728641 13447 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:11.664398 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1511) took 1926 ms. Trace:
I20260709 13:16:11.667645 13293 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.687001 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 525) took 1458 ms. Trace:
I20260709 13:16:11.961716 10325 rpcz_store.cc:276] 0709 13:16:10.229029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.229237 (+   208us) service_pool.cc:224] Handling call
0709 13:16:10.229535 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.332824 (+103289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.686701 (+1353877us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000cc454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:11.686931 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235585280}
I20260709 13:16:11.670426 10399 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:11.681914 13448 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.661727 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:11.964723 10323 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:11.753588 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:11.682354 13051 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.845978 13507 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.258073 13381 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.630775 13540 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:11.255738 13283 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:11.639624 13481 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.003s	sys 0.008s
I20260709 13:16:10.825228 13347 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:11.640146 13470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.009s	sys 0.039s
I20260709 13:16:10.830169 13306 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.844707 13545 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:10.843904 13518 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:11.755704 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1628) took 1427 ms. Trace:
W20260709 13:16:11.760232 10321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 520) took 1632 ms (client timeout 2127 ms). Trace:
I20260709 13:16:12.020840 10394 rpcz_store.cc:276] 0709 13:16:10.328727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.729260 (+400533us) service_pool.cc:224] Handling call
0709 13:16:10.729532 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.735364 (+  5832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.735396 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.737098 (+  1702us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:10.737187 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.755343 (+1018156us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b5400102054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:11.755409 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.755619 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12934528}
I20260709 13:16:11.773371 13511 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.967491 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1635) took 1125 ms. Trace:
I20260709 13:16:11.977906 13482 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:12.025961 10399 rpcz_store.cc:276] 0709 13:16:10.842431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.664894 (+822463us) service_pool.cc:224] Handling call
0709 13:16:11.665315 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.967133 (+301818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.967415 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.684109 13517 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:11.762406 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 115597us
I20260709 13:16:11.692662 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:11.785552 10324 raft_consensus.cc:2368] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8.
W20260709 13:16:11.761464 10391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1625) took 1477 ms (client timeout 1902 ms). Trace:
W20260709 13:16:11.686193 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 763) took 2173 ms (client timeout 1766 ms). Trace:
W20260709 13:16:11.693718 10995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 660) took 2074 ms (client timeout 2645 ms). Trace:
I20260709 13:16:11.973991 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:11.981900 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:12.035179 11001 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.711835 13440 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.739639 13364 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.709178 13499 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:11.707535 13431 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:11.775276 13498 consensus_meta.cc:287] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.988s	user 0.011s	sys 0.000s
I20260709 13:16:11.738188 13285 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.015111 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:11.703477 13423 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:11.636981 13509 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:11.998437 13481 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.003s	sys 0.008s
I20260709 13:16:11.783031 13366 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:11.763365 10398 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:11.993302 13051 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:11.786027 10248 rpcz_store.cc:276] 0709 13:16:09.737585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.737725 (+   140us) service_pool.cc:224] Handling call
0709 13:16:09.762916 (+ 25191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.444821 (+681905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.664044 (+1219223us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400369cd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:11.664308 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375541632}
W20260709 13:16:12.020110 10321 rpcz_store.cc:269] 0709 13:16:10.127534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.127720 (+   186us) service_pool.cc:224] Handling call
0709 13:16:11.759950 (+1632230us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b5400113d54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:11.760147 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15056256}
I20260709 13:16:11.965796 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2214) took 1210 ms. Trace:
W20260709 13:16:12.036238 10995 rpcz_store.cc:269] 0709 13:16:09.619782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.619921 (+   139us) service_pool.cc:224] Handling call
0709 13:16:11.693431 (+2073510us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54001b8354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:11.693632 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092338560}
W20260709 13:16:12.037076 10994 rpcz_store.cc:269] 0709 13:16:09.512693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.513480 (+   787us) service_pool.cc:224] Handling call
0709 13:16:11.685925 (+2172445us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400750154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:11.686097 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140410752}
I20260709 13:16:11.997864 13381 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:11.701561 13109 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.039105 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:12.028066 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 407037us
W20260709 13:16:12.041416 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.074862 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:12.018623 13306 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:12.069435 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.105581 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.073623 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:12.078323 10289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.051s	sys 0.084s
W20260709 13:16:12.106495 10289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.051s	sys 0.084s
W20260709 13:16:12.107396 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.069197 13499 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:12.079648 10324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2206) took 1599 ms (client timeout 1769 ms). Trace:
I20260709 13:16:12.090591 13540 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.112614 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:12.113227 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:12.113698 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2156) took 1636 ms. Trace:
I20260709 13:16:12.113979 10321 rpcz_store.cc:276] 0709 13:16:10.477483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.102681 (+1625198us) service_pool.cc:224] Handling call
0709 13:16:12.113642 (+ 10961us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:12.114308 10291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.038s	sys 0.070s
W20260709 13:16:12.114777 10291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.039s	sys 0.070s
I20260709 13:16:11.959815 13516 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:11.974997 13293 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:11.775002 13513 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:11.777760 13424 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.093539 13528 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:16:12.094594 10398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1631) took 1253 ms (client timeout 1523 ms). Trace:
I20260709 13:16:12.070547 13482 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.095260 11001 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:11.993108 13507 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.098174 10318 rpcz_store.cc:276] 0709 13:16:10.755980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.753195 (+997215us) service_pool.cc:224] Handling call
0709 13:16:11.965732 (+212537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.777604 13567 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:12.037788 10391 rpcz_store.cc:269] 0709 13:16:10.283947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.286276 (+  2329us) service_pool.cc:224] Handling call
0709 13:16:11.761280 (+1475004us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540013fe54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:11.761393 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367944064}
I20260709 13:16:12.015954 13283 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.068804 13570 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.103929 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:12.107885 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 74440.7us
I20260709 13:16:12.074155 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 528) took 1328 ms. Trace:
W20260709 13:16:12.110621 10324 rpcz_store.cc:269] 0709 13:16:10.480351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.656071 (+1175720us) service_pool.cc:224] Handling call
0709 13:16:12.079553 (+423482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.031802 13447 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.106640 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2215) took 1297 ms. Trace:
I20260709 13:16:12.155529 10322 rpcz_store.cc:276] 0709 13:16:10.809707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.074592 (+1264885us) service_pool.cc:224] Handling call
0709 13:16:12.106581 (+ 31989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.156473 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:12.157045 10322 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:12.157858 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:12.160410 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:12.161077 10324 raft_consensus.cc:2376] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8. Re-sending same reply.
W20260709 13:16:12.161505 10362 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.584s (SENT)
I20260709 13:16:12.121946 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:12.115509 10399 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:12.115653 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:12.118628 10392 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:12.115447 10213 leader_election.cc:336] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.505s (SENT)
I20260709 13:16:12.162839 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:12.117106 10394 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:12.102169 13377 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.165328 10322 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:12.038846 13511 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.115643 13499 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:12.108825 13366 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:12.142172 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:12.092554 10323 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:16:12.189577 10323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2208) took 1703 ms (client timeout 1931 ms). Trace:
W20260709 13:16:12.190004 10323 rpcz_store.cc:269] 0709 13:16:10.486436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.661312 (+1174876us) service_pool.cc:224] Handling call
0709 13:16:12.189519 (+528207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.109733 13539 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.083711 13572 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
W20260709 13:16:12.145638 10398 rpcz_store.cc:269] 0709 13:16:10.841207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.870665 (+ 29458us) service_pool.cc:224] Handling call
0709 13:16:12.094509 (+1223844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.777568 13548 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:12.112239 13109 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.075747 13440 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.114897 13376 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:12.084853 13364 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.217893 10324 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:12.080487 13517 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.223946 13509 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.224653 13517 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.225203 13517 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:12.225306 13051 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.225906 13051 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:12.225703 13517 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.226465 13051 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.228071 13517 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.228616 13517 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:12.228631 13051 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.172400 13447 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.231491 13283 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.231940 13447 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.232443 13518 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.189045 13377 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.233268 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.234301 13377 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.234426 13381 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:12.122658 13498 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.153771 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:12.122867 13553 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:12.154536 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:12.122328 13423 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:12.165266 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 49846.8us
W20260709 13:16:12.250608 10213 leader_election.cc:336] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.509s (SENT)
I20260709 13:16:12.251159 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:12.135246 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.171029 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:12.253480 10994 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:12.253696 13518 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.254014 10997 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:12.254618 13250 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:12.255115 13250 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:12.255563 13250 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.258682 13511 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.260478 13567 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.235798 13293 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:12.262293 13516 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.262768 13293 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:12.170888 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:12.190361 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:12.265137 10394 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.206025 13523 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.168097 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:12.198208 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 82621.6us
I20260709 13:16:12.275275 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:12.276732 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:12.200562 10323 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:12.278393 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2204) took 1798 ms. Trace:
I20260709 13:16:12.205775 13576 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.278745 10323 rpcz_store.cc:276] 0709 13:16:10.479734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.200056 (+1720322us) service_pool.cc:224] Handling call
0709 13:16:12.200372 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.278125 (+ 77753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.278339 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:12.167816 13501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.009s	sys 0.017s
I20260709 13:16:12.206588 10322 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:12.280325 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2209) took 1793 ms. Trace:
I20260709 13:16:12.280648 10322 rpcz_store.cc:276] 0709 13:16:10.486726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.200895 (+1714169us) service_pool.cc:224] Handling call
0709 13:16:12.201198 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.280079 (+ 78881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.280274 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.206950 10995 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:12.208421 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:12.282476 10248 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:12.212718 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:12.214457 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.215067 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.282943 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 803) took 1439 ms. Trace:
I20260709 13:16:12.283547 10244 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:12.126184 13540 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.215550 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:12.220908 11001 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:12.221472 13571 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:16:12.221845 13440 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.214609 13376 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.153231 10325 rpcz_store.cc:276] 0709 13:16:10.746088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.973699 (+1227611us) service_pool.cc:224] Handling call
0709 13:16:12.074084 (+100385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.236368 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.244868 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:12.330797 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:12.246275 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 92549.4us
I20260709 13:16:12.165570 13570 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.209764 13366 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.191766 10319 raft_consensus.cc:2376] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
W20260709 13:16:12.154670 13401 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.836s	user 0.010s	sys 0.004s
I20260709 13:16:12.208884 13583 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.263438 10392 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:16:12.388447 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:12.283771 10993 rpcz_store.cc:276] 0709 13:16:10.843449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.844355 (+   906us) service_pool.cc:224] Handling call
0709 13:16:10.844674 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.634611 (+789937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.634644 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.640392 (+  5748us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.129115 (+488723us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:12.129164 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.129249 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.282324 (+153075us) raft_consensus.cc:1685] finished
0709 13:16:12.282391 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.282791 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":794238,"raft.queue_time_us":793687,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1842,"thread_start_us":347751,"threads_started":1,"wal-append.queue_time_us":414194}
W20260709 13:16:12.174546 10362 leader_election.cc:336] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.588s (SENT)
I20260709 13:16:12.389551 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:12.285260 10246 raft_consensus.cc:2368] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
W20260709 13:16:12.390980 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 216482us
I20260709 13:16:12.294390 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.392328 10248 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:12.392730 10362 leader_election.cc:336] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.769s (SENT)
I20260709 13:16:12.393211 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:12.393482 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.301208 10245 raft_consensus.cc:2393] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:12.331840 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:12.254523 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.395226 10250 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:12.332778 10243 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:12.332763 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:12.203249 13502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.239s	user 0.009s	sys 0.016s
W20260709 13:16:12.290675 13501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.577s	user 0.010s	sys 0.018s
I20260709 13:16:12.254516 13482 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:12.205430 13539 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.338529 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:12.339550 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2211) took 1737 ms. Trace:
I20260709 13:16:12.350540 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:12.215047 13548 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:12.374379 10390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.026s	sys 0.038s
W20260709 13:16:12.471630 10390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.027s	sys 0.039s
I20260709 13:16:12.302858 13447 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.301105 13051 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:12.426219 13381 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:12.340106 13283 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:16:12.399583 10394 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
W20260709 13:16:12.400064 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 67118us
I20260709 13:16:12.337288 13376 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.394202 10248 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:12.379043 13293 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.296821 13518 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:16:12.381055 13567 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.272302 13498 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.352388 13347 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.291850 13523 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.337680 13470 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:12.471184 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 78542.5us
W20260709 13:16:12.548491 10362 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.772s (SENT)
I20260709 13:16:12.515569 13505 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:12.475198 10999 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:16:12.279906 13423 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:12.398216 13502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.493s	user 0.010s	sys 0.017s
I20260709 13:16:12.391822 13545 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:12.387084 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.477788 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:12.397358 10249 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:12.477628 10396 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:12.399945 13576 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:12.523885 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:12.528043 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.528729 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.541839 13051 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:12.532804 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 428906us
I20260709 13:16:12.400123 13517 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.542546 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.477039 13519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.520s	user 0.011s	sys 0.021s
W20260709 13:16:12.606210 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 82423.9us
I20260709 13:16:12.550424 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:12.517963 13377 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.517654 13381 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.472293 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 140505us
I20260709 13:16:12.532284 13501 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.528505 13581 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:12.777091 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:12.670055 13519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.745s	user 0.017s	sys 0.026s
I20260709 13:16:12.401961 13584 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:12.595845 10246 raft_consensus.cc:2410] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:12.594794 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.594098 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:12.600706 10967 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:12.530895 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.405417 13583 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.545710 13569 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.666374 10395 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:12.504031 13073 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:12.672310 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:12.677902 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.754540 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 92861.1us
I20260709 13:16:12.855700 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:12.557392 13505 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:12.864780 13505 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:12.865022 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.769275 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 218879us
I20260709 13:16:12.595666 10248 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:12.866804 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:12.867622 10248 raft_consensus.cc:2410] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:16:12.635439 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.867789 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:12.588366 10244 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:12.870800 13586 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.468s	user 0.000s	sys 0.005s
I20260709 13:16:12.872093 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1515) took 3132 ms. Trace:
W20260709 13:16:12.872524 13587 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:16:12.873834 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2083) took 3167 ms. Trace:
I20260709 13:16:12.874250 10397 rpcz_store.cc:276] 0709 13:16:09.706502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.706676 (+   174us) service_pool.cc:224] Handling call
0709 13:16:09.751143 (+ 44467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.753890 (+  2747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.753919 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.777940 (+ 24021us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.662707 (+1884767us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b1800460780. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:12.128708 (+466001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:12.128764 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.128874 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.873549 (+744675us) raft_consensus.cc:1685] finished
0709 13:16:12.873571 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.873772 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2355,"raft.queue_time_us":44047,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":6893,"spinlock_wait_cycles":9950976,"thread_start_us":465773,"threads_started":1,"wal-append.queue_time_us":2650361}
I20260709 13:16:12.877099 13528 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:12.877537 13528 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.877853 13528 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.878310 13482 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:12.878711 13482 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.879047 13482 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.590489 13601 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:12.880874 13601 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.883061 13601 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:12.847211 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 246797us
I20260709 13:16:12.884578 10248 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:16:12.884969 10248 pending_rounds.cc:85] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:16:12.885195 10248 pending_rounds.cc:107] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:12.885401 10248 raft_consensus.cc:2889] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.886006 13570 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.886821 13600 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:12.887615 10244 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:12.550740 13567 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.759757 13051 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.757421 13553 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:12.596143 13347 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:12.930744 13347 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:12.863420 13481 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.901486 13447 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:12.864115 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:12.604370 10319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2216) took 1779 ms (client timeout 1584 ms). Trace:
I20260709 13:16:12.872471 10247 rpcz_store.cc:276] 0709 13:16:09.740018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.815350 (+ 75332us) service_pool.cc:224] Handling call
0709 13:16:09.892899 (+ 77549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.036879 (+143980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.036909 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.659411 (+1622502us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b2c000014c8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c23e1a11 00007f58c23f1372 00007f58c3b23a01 00007f58c3ae843a 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2
0709 13:16:11.659944 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.116253 (+456309us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.382462 (+266209us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.386935 (+  4473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.387016 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.871781 (+484765us) raft_consensus.cc:1685] finished
0709 13:16:12.871899 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.872033 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27417,"prepare.queue_time_us":414776,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":309637,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":22058,"spinlock_wait_cycles":24064256,"thread_start_us":812857,"threads_started":3,"wal-append.queue_time_us":611039}
I20260709 13:16:12.542986 13293 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.563184 13470 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.906343 10364 leader_election.cc:400] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
I20260709 13:16:12.604231 13513 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.775364 13502 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:12.775660 13516 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:12.980592 13516 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.589730 13424 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:12.985826 13306 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.871s	user 0.005s	sys 0.005s
I20260709 13:16:12.930078 13607 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:12.932775 13608 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.862447 10323 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:12.941394 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 268922us
I20260709 13:16:12.863513 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:12.945597 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.949539 10319 rpcz_store.cc:269] 0709 13:16:10.824936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.827597 (+  2661us) service_pool.cc:224] Handling call
0709 13:16:12.604161 (+1776564us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b540022ced4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:12.604279 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288938880}
I20260709 13:16:12.964017 10364 leader_election.cc:403] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:13.003012 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 107990us
I20260709 13:16:13.004374 10364 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:12.594640 13576 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.973757 10250 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:12.470450 10318 rpcz_store.cc:276] 0709 13:16:10.602116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.263680 (+1661564us) service_pool.cc:224] Handling call
0709 13:16:12.263990 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.339159 (+ 75169us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:12.339195 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.339253 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:12.339290 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.339362 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.339492 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74801,"raft.queue_time_us":117358,"raft.run_cpu_time_us":1962,"raft.run_wall_time_us":68819}
I20260709 13:16:12.930925 13610 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.844731 13581 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:12.987016 13431 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.902s	user 0.001s	sys 0.009s
I20260709 13:16:12.987823 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:12.991752 13583 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:12.992456 13590 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.616s	user 0.000s	sys 0.003s
I20260709 13:16:12.775794 13377 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.021538 13423 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.009711 13366 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:12.993109 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1623) took 2710 ms. Trace:
I20260709 13:16:12.991812 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:13.023180 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:13.023524 10243 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:12.994539 13548 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:12.993148 13447 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.996130 13347 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.029273 13347 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.013336 13608 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.941274 13596 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:13.010164 13513 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
I20260709 13:16:13.001756 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:13.014372 13502 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.857254 13517 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:12.779906 13381 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:12.943768 13553 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:13.008081 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.124195 10246 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:13.010365 10248 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:16:13.125597 10248 pending_rounds.cc:85] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:16:13.125934 10248 pending_rounds.cc:107] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:16:13.126307 10248 raft_consensus.cc:2889] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.011059 10247 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:12.986508 13509 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:12.938117 13401 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:16:13.012948 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 110784us
I20260709 13:16:13.136214 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:13.016047 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:13.138091 10318 raft_consensus.cc:2376] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10. Re-sending same reply.
I20260709 13:16:12.969437 13592 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.019148 10241 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:16:13.139184 10241 pending_rounds.cc:85] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:16:13.139514 10241 pending_rounds.cc:107] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:16:13.139765 10241 raft_consensus.cc:2889] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.934341 13594 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 13:16:13.023012 10396 rpcz_store.cc:276] 0709 13:16:10.283196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.284262 (+  1066us) service_pool.cc:224] Handling call
0709 13:16:10.284805 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.599314 (+2314509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.992818 (+393504us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54002dd554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:12.993049 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5042307456}
I20260709 13:16:13.025592 10323 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:16:13.013046 13250 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.750s	user 0.006s	sys 0.004s
I20260709 13:16:13.000604 13540 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.033337 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:13.009485 13073 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.010327 13376 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.013621 13424 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:12.784075 13501 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.010758 13558 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.892722 13569 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.006335 13306 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.044268 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 517) took 2985 ms. Trace:
W20260709 13:16:13.072325 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 70696.1us
I20260709 13:16:12.951470 13481 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.026131 13572 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.019799 10391 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:13.037333 13293 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:13.040692 13109 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.000s
W20260709 13:16:13.146883 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.165064 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.188719 10249 raft_consensus.cc:2393] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 3: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:13.219980 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:13.218669 10320 rpcz_store.cc:276] 0709 13:16:10.059038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.059185 (+   147us) service_pool.cc:224] Handling call
0709 13:16:10.059542 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.095168 (+ 35626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.095197 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.113781 (+ 18584us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.721511 (+1607730us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b18000e7dc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:12.168302 (+446791us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.168342 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.168412 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.025886 (+857474us) raft_consensus.cc:1685] finished
0709 13:16:13.025901 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.044174 (+ 18273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26411,"raft.queue_time_us":51067,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":23626,"spinlock_wait_cycles":12840192,"thread_start_us":481775,"threads_started":2,"wal-append.queue_time_us":2096623}
I20260709 13:16:13.221724 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:13.218708 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2094) took 1073 ms. Trace:
I20260709 13:16:13.223480 10391 rpcz_store.cc:276] 0709 13:16:12.145188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.149784 (+  4596us) service_pool.cc:224] Handling call
0709 13:16:12.987756 (+837972us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5c0006548c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c7452161 00007f58c75f3a79 00007f58c8aad9b6 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:13.218638 (+230882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43758848}
I20260709 13:16:13.180428 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:13.180724 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:13.182215 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:13.069887 13499 consensus_meta.cc:287] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.000s
I20260709 13:16:13.048554 13596 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:13.035777 13608 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:13.177207 13605 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:13.185851 13250 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.140699 13283 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.019582 13610 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.139230 13509 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:13.124991 13502 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.251627 10323 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
W20260709 13:16:13.336648 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.311098 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.441632 10318 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:13.427827 10321 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:13.286672 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 65005.9us
I20260709 13:16:13.473536 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:13.549598 10249 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:13.546778 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2169) took 1210 ms. Trace:
I20260709 13:16:13.524551 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:13.550987 10318 rpcz_store.cc:276] 0709 13:16:12.336711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.180091 (+843380us) service_pool.cc:224] Handling call
0709 13:16:13.546707 (+366616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.552282 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:13.546347 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 408711us
I20260709 13:16:13.546836 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2170) took 1209 ms. Trace:
W20260709 13:16:13.206713 13588 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:16:13.559187 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:13.509155 13505 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 13:16:13.553162 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2227) took 1253 ms. Trace:
I20260709 13:16:13.748988 10318 rpcz_store.cc:276] 0709 13:16:12.299472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.552022 (+1252550us) service_pool.cc:224] Handling call
0709 13:16:13.553102 (+  1080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.491189 13565 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.184664 13513 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:13.555011 10323 rpcz_store.cc:276] 0709 13:16:12.336871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.180427 (+843556us) service_pool.cc:224] Handling call
0709 13:16:13.546779 (+366352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.754567 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:13.286931 13470 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.768051 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:13.429931 13504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.000s	sys 0.013s
I20260709 13:16:13.473361 13306 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.474565 13381 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.222762 13424 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:13.655107 13051 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.003s
I20260709 13:16:13.507295 13109 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.768437 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:13.552933 13596 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.205245 13377 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:13.829646 10318 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:16:13.909759 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2164) took 1574 ms (client timeout 1946 ms). Trace:
W20260709 13:16:13.910279 10318 rpcz_store.cc:269] 0709 13:16:12.335487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.767694 (+1432207us) service_pool.cc:224] Handling call
0709 13:16:13.909671 (+141977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.911612 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:13.401332 13579 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:13.546779 13605 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.366015 13293 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.916476 13293 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.918493 13581 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.919189 13293 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.365703 13572 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.184818 13592 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.402797 13011 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.424s
I20260709 13:16:13.841809 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 613) took 3701 ms. Trace:
I20260709 13:16:13.944885 10390 rpcz_store.cc:276] 0709 13:16:10.140517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.141766 (+  1249us) service_pool.cc:224] Handling call
0709 13:16:10.142297 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.145145 (+  2848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.145193 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.696632 (+1551439us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b2c00108708. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c23e1a11 00007f58c23f1372 00007f58c3b23a01 00007f58c3ae843a 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2
0709 13:16:11.697198 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.472028 (+774830us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.472068 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.472137 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.841362 (+1369225us) raft_consensus.cc:1685] finished
0709 13:16:13.841396 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.841724 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2298,"raft.queue_time_us":35783,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":209,"spinlock_wait_cycles":15721216,"thread_start_us":774369,"threads_started":1,"wal-append.queue_time_us":1099842}
W20260709 13:16:13.841887 13609 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.658s	user 0.001s	sys 0.000s
I20260709 13:16:13.864185 13250 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:13.873759 13498 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.875828 13502 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:13.286513 13558 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.220772 13073 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.659588 13553 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.915935 13605 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.207480 13540 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:13.837044 13504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.711s	user 0.008s	sys 0.021s
I20260709 13:16:13.654304 13376 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:13.928121 13581 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.928746 13293 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.553916 13499 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.553838 13283 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.833828 13569 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:13.895757 13424 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.878087 13610 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:13.948963 13109 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.890560 13594 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:13.920233 13579 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:13.935672 13501 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:13.830643 13565 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.913112 13509 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.922012 13051 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:13.906553 10247 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
W20260709 13:16:13.927243 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2179) took 1378 ms (client timeout 1824 ms). Trace:
I20260709 13:16:13.928272 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:14.746377 10318 rpcz_store.cc:269] 0709 13:16:12.548832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.911190 (+1362358us) service_pool.cc:224] Handling call
0709 13:16:13.927156 (+ 15966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.094846 13540 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:14.748232 13509 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:14.269953 13528 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.364s	user 0.009s	sys 0.000s
I20260709 13:16:14.883746 13528 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:14.749704 13293 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:14.274081 13572 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:14.258422 13513 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:14.890136 13540 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:14.690030 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.048552 13448 consensus_meta.cc:287] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 2.070s	user 0.005s	sys 0.009s
I20260709 13:16:14.759721 10323 raft_consensus.cc:2376] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10. Re-sending same reply.
W20260709 13:16:14.683604 10213 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.006s	sys 0.005s
I20260709 13:16:14.739328 13073 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:14.761473 13109 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:14.728348 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.025s	sys 0.036s
W20260709 13:16:14.169081 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.256464 10967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.002s	sys 0.007s
I20260709 13:16:14.772471 13579 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:14.323177 13447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.002s	sys 0.008s
I20260709 13:16:14.753820 13565 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:14.381592 13596 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:14.876816 13581 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:13.772962 13505 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:14.297022 13482 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.418s	user 0.007s	sys 0.004s
W20260709 13:16:14.271854 13347 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.242s	user 0.009s	sys 0.000s
W20260709 13:16:14.901532 10250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2345) took 1892 ms (client timeout 2194 ms). Trace:
W20260709 13:16:14.923362 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.373s	user 0.026s	sys 0.037s
W20260709 13:16:14.917352 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.905684 13513 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:14.918022 10247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2348) took 1873 ms (client timeout 2147 ms). Trace:
I20260709 13:16:14.918557 13499 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:14.895597 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2171) took 2497 ms (client timeout 1977 ms). Trace:
I20260709 13:16:14.887869 13051 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:14.923811 10213 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.006s	sys 0.014s
W20260709 13:16:14.927696 10250 rpcz_store.cc:269] 0709 13:16:13.008981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.927964 (+918983us) service_pool.cc:224] Handling call
0709 13:16:14.901116 (+973152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.935631 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:14.936678 10250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2351) took 1891 ms (client timeout 2230 ms). Trace:
W20260709 13:16:14.937119 10250 rpcz_store.cc:269] 0709 13:16:13.045711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.935002 (+1889291us) service_pool.cc:224] Handling call
0709 13:16:14.936589 (+  1587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.067075 13481 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:14.906343 13293 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:14.928320 10247 rpcz_store.cc:269] 0709 13:16:13.044835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.554698 (+509863us) service_pool.cc:224] Handling call
0709 13:16:14.913505 (+1358807us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:14.929468 10318 rpcz_store.cc:269] 0709 13:16:12.398797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.895180 (+2496383us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:14.895435 (+   255us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:14.895511 13502 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.922144 13517 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.013087 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:14.272974 13592 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:15.027832 10362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.011s	sys 0.027s
W20260709 13:16:15.028335 10362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.011s	sys 0.027s
W20260709 13:16:15.029656 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 1.47046e+06us
W20260709 13:16:15.030340 13447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.009s	sys 0.009s
W20260709 13:16:15.031154 10967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.004s	sys 0.013s
I20260709 13:16:15.030499 13502 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:15.031605 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 1.6019e+06us
I20260709 13:16:15.034335 13482 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.040372 13505 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:15.042510 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 1.44024e+06us
I20260709 13:16:14.891748 13594 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:14.395637 13605 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:15.015125 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 1.39697e+06us
I20260709 13:16:15.037858 13482 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.058286 13549 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.059027 13549 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.066445 13565 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:15.069262 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2232) took 2768 ms (client timeout 2104 ms). Trace:
W20260709 13:16:15.069738 10318 rpcz_store.cc:269] 0709 13:16:12.300707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.068982 (+2768275us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.069160 (+   178us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:15.070715 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2168) took 2734 ms (client timeout 2112 ms). Trace:
W20260709 13:16:15.071079 10318 rpcz_store.cc:269] 0709 13:16:12.336453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.070511 (+2734058us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.070643 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:15.071885 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2178) took 2523 ms (client timeout 1915 ms). Trace:
W20260709 13:16:15.072214 10318 rpcz_store.cc:269] 0709 13:16:12.548589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.071720 (+2523131us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.071830 (+   110us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:15.073040 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2226) took 2774 ms (client timeout 2197 ms). Trace:
W20260709 13:16:15.073396 10318 rpcz_store.cc:269] 0709 13:16:12.299159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.072863 (+2773704us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.072993 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.074712 10250 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:15.075299 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2353) took 1778 ms. Trace:
I20260709 13:16:15.075624 10250 rpcz_store.cc:276] 0709 13:16:13.296549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.937925 (+1641376us) service_pool.cc:224] Handling call
0709 13:16:15.075222 (+137297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.088186 10247 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:15.088927 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1525) took 2614 ms. Trace:
I20260709 13:16:15.089303 10247 rpcz_store.cc:276] 0709 13:16:12.474688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.048320 (+2573632us) service_pool.cc:224] Handling call
0709 13:16:15.087677 (+ 39357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.088631 (+   954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.088847 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.092206 13528 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.094990 13596 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.097620 13605 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.104607 13424 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:15.109176 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 56754.1us
I20260709 13:16:15.034073 13502 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.112270 13594 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.114145 13581 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.116096 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.168354 13306 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:15.168700 10319 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:15.168936 13306 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:15.169566 10319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2181) took 2586 ms (client timeout 1665 ms). Trace:
W20260709 13:16:15.170077 10319 rpcz_store.cc:269] 0709 13:16:12.583491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.365867 (+782376us) service_pool.cc:224] Handling call
0709 13:16:15.115793 (+1749926us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3eee 0000000000375939 00007f58c8a371e0 00007f58c8b000c4 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:16:15.169451 (+ 53658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4708224}
W20260709 13:16:15.171336 10319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2176) took 2623 ms (client timeout 1987 ms). Trace:
I20260709 13:16:15.117254 13528 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:15.171929 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34158 (request call id 90) took 4894 ms. Trace:
I20260709 13:16:15.172475 10316 rpcz_store.cc:276] 0709 13:16:10.277748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.278401 (+   653us) service_pool.cc:224] Handling call
0709 13:16:15.171315 (+4892914us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400187ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aee735 00007f58c3ae69fa 00007f58c8aae4c9 00007f58c202ac54 00007f58c202abe2 00007f58c202ab11 00007f58c202aa8c 00007f58c2029d42 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:15.171685 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3362628352}
I20260709 13:16:15.173144 13576 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:15.118489 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5030671600000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:16:15.174015 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4571671599999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:16:15.174485 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4571671599999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:16:15.125346 13567 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:15.174882 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4292671599998812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:16:15.130807 13364 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:15.175833 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3407627980000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:16:15.176261 10244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2341) took 2920 ms (client timeout 1726 ms). Trace:
I20260709 13:16:15.131132 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:15.176828 10244 rpcz_store.cc:269] 0709 13:16:12.255511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.293517 (+ 38006us) service_pool.cc:224] Handling call
0709 13:16:15.175801 (+2882284us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b54000a8a54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.176033 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221404032}
W20260709 13:16:15.173899 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2172) took 2707 ms (client timeout 2128 ms). Trace:
I20260709 13:16:15.138553 10247 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:15.178428 10316 rpcz_store.cc:269] 0709 13:16:12.466414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.173670 (+2707256us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.173834 (+   164us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.142477 13605 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:15.142655 13523 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.179937 13293 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:15.178395 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 47415.1us
W20260709 13:16:15.184496 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2182) took 2588 ms (client timeout 2041 ms). Trace:
W20260709 13:16:15.185101 10316 rpcz_store.cc:269] 0709 13:16:12.590901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.179253 (+2588352us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.179429 (+   176us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.184157 13306 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:15.187242 10321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2210) took 4651 ms (client timeout 2645 ms). Trace:
W20260709 13:16:15.187750 10321 rpcz_store.cc:269] 0709 13:16:10.536143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.114675 (+1578532us) service_pool.cc:224] Handling call
0709 13:16:15.186722 (+3072047us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400113d54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.186993 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791725312}
I20260709 13:16:15.188331 13306 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.188858 13592 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:15.189127 10321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2186) took 2434 ms (client timeout 1959 ms). Trace:
I20260709 13:16:15.189354 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.190605 10999 raft_consensus.cc:2410] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:15.178922 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 701) took 2671 ms. Trace:
I20260709 13:16:15.191061 10247 rpcz_store.cc:276] 0709 13:16:12.507620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.137755 (+2630135us) service_pool.cc:224] Handling call
0709 13:16:15.138218 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.178670 (+ 40452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.178870 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.192427 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:15.147958 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2334) took 2934 ms. Trace:
I20260709 13:16:15.189812 13592 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:15.152390 10246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1527) took 2602 ms (client timeout 2891 ms). Trace:
I20260709 13:16:15.193795 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2335) took 2974 ms. Trace:
I20260709 13:16:15.159372 13618 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:15.160635 13387 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:15.202477 10317 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.685s	user 0.010s	sys 0.010s
I20260709 13:16:15.203162 10244 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:15.133531 13511 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:15.203565 13387 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.204064 13387 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:15.202564 10241 rpcz_store.cc:276] 0709 13:16:12.218947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.219098 (+   151us) service_pool.cc:224] Handling call
0709 13:16:12.219404 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.140236 (+920832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.193321 (+2053085us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540006ead4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:15.193620 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838404992}
I20260709 13:16:15.205222 13387 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:15.150024 10322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2174) took 2618 ms (client timeout 2000 ms). Trace:
W20260709 13:16:15.206266 13597 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 2.283s	user 0.006s	sys 0.037s
W20260709 13:16:15.206377 10322 rpcz_store.cc:269] 0709 13:16:12.531878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.149575 (+2617697us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.149777 (+   202us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:15.207530 10322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2177) took 2659 ms (client timeout 2312 ms). Trace:
I20260709 13:16:15.137972 10248 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:15.208182 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2349) took 2163 ms. Trace:
I20260709 13:16:15.208441 10248 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:15.208629 10244 rpcz_store.cc:276] 0709 13:16:13.045169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.177732 (+2132563us) service_pool.cc:224] Handling call
0709 13:16:15.202856 (+ 25124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.207840 (+  4984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.208094 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:15.207960 10322 rpcz_store.cc:269] 0709 13:16:12.548322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.207291 (+2658969us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.207455 (+   164us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.209766 10248 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.211105 13581 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:15.211833 13581 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:15.213342 13387 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.213182 13581 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:15.194341 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2175) took 2646 ms (client timeout 2143 ms). Trace:
W20260709 13:16:15.214318 10316 rpcz_store.cc:269] 0709 13:16:12.547740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.185995 (+2638255us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.186207 (+   212us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:15.193940 10246 rpcz_store.cc:269] 0709 13:16:12.549641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.863200 (+313559us) service_pool.cc:224] Handling call
0709 13:16:15.151897 (+2288697us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540006ccd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.152145 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280334080}
I20260709 13:16:15.192637 10247 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:15.188432 13481 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.108445 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2180) took 2519 ms (client timeout 1957 ms). Trace:
I20260709 13:16:15.193034 10242 rpcz_store.cc:276] 0709 13:16:12.213506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.215264 (+  1758us) service_pool.cc:224] Handling call
0709 13:16:12.223041 (+  7777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.458051 (+235010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.458081 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.458119 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.458148 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.147312 (+2689164us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540006e0d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:15.147392 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.147719 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412873088}
W20260709 13:16:15.195271 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.144441 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:15.197973 13592 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:15.176280 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3407627980000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:16:15.199054 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.201282 10250 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:15.217708 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3257671599999412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
I20260709 13:16:15.203089 10317 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:16:15.210331 10322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2166) took 2874 ms (client timeout 2727 ms). Trace:
W20260709 13:16:15.219033 10322 rpcz_store.cc:269] 0709 13:16:12.335954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.210127 (+2874173us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.210270 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.211131 10248 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:15.189683 10321 rpcz_store.cc:269] 0709 13:16:12.755149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.188878 (+2433729us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.189060 (+   182us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:15.171721 10319 rpcz_store.cc:269] 0709 13:16:12.548067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.171098 (+2623031us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.171260 (+   162us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.163755 13424 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:15.215675 10318 rpcz_store.cc:269] 0709 13:16:12.554764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.074060 (+2519296us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:15.074189 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:15.195008 10999 raft_consensus.cc:2368] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
W20260709 13:16:15.218079 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3257671599999412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 13:16:15.221999 10213 connection.cc:256] RPC call timeout handler was delayed by -1.319467159999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:16:15.218712 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2350) took 2173 ms. Trace:
W20260709 13:16:15.223434 10213 connection.cc:256] RPC call timeout handler was delayed by -1.319467159999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:16:15.223171 10247 rpcz_store.cc:276] 0709 13:16:13.045438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.191829 (+2146391us) service_pool.cc:224] Handling call
0709 13:16:15.192277 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.218483 (+ 26206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.218669 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:15.223927 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3083627979999619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:16:15.224324 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3083627979999619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:16:15.224571 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2672671599998466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:16:15.224810 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2672671599998466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:16:15.225121 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2672671599998466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:16:15.225356 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2393671600000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 13:16:15.225602 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2303671600000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:16:15.225836 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2303671600000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:16:15.227602 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.229637 13447 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.229900 13595 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.230304 13447 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.230762 13595 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.231377 10321 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:15.232080 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2225) took 2954 ms. Trace:
I20260709 13:16:15.232390 10321 rpcz_store.cc:276] 0709 13:16:12.298809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.230418 (+2931609us) service_pool.cc:224] Handling call
0709 13:16:15.230918 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.231772 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.231983 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.233002 13447 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.233220 13595 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.234253 10318 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:15.234856 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2231) took 2934 ms. Trace:
I20260709 13:16:15.235173 10318 rpcz_store.cc:276] 0709 13:16:12.300451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.226902 (+2926451us) service_pool.cc:224] Handling call
0709 13:16:15.233626 (+  6724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.234618 (+   992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.234800 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.235411 13481 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.236950 10318 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:16:15.237601 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2167) took 2901 ms. Trace:
W20260709 13:16:15.238098 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2186671599999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 13:16:15.237897 10318 rpcz_store.cc:276] 0709 13:16:12.336179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.236237 (+2900058us) service_pool.cc:224] Handling call
0709 13:16:15.236638 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.237321 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.237529 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:15.238776 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2111627980000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:16:15.239233 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1976627980000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 13:16:15.239486 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1976627980000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 13:16:15.239734 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1871671599999445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:16:15.239975 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1856830839999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:16:15.240212 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1517007900001772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:16:15.240443 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1178671600000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:16:15.240693 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1178671600000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:16:15.240933 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1157627979998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:16:15.241169 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1157627979998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:16:15.241402 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1034671600000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:16:15.241647 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0899671600000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 13:16:15.241882 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0896627979998357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:16:15.242125 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0896627979998357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:16:15.242478 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0779627980000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:16:15.242743 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0779627980000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:16:15.243058 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0023627979999219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:16:15.242741 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2162) took 2907 ms. Trace:
I20260709 13:16:15.243670 10321 rpcz_store.cc:276] 0709 13:16:12.334913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.233279 (+2898366us) service_pool.cc:224] Handling call
0709 13:16:15.233748 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.234100 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.234124 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.234185 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:15.242360 (+  8175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.242487 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.242666 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:15.247905 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 103647us
I20260709 13:16:15.216745 13502 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.251760 13502 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:15.254928 10395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2092) took 3133 ms (client timeout 1946 ms). Trace:
W20260709 13:16:15.255434 10395 rpcz_store.cc:269] 0709 13:16:12.121546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.121690 (+   144us) service_pool.cc:224] Handling call
0709 13:16:15.254482 (+3132792us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540010c054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.254672 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158557440}
I20260709 13:16:15.266975 10320 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:15.267439 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2151) took 4791 ms. Trace:
I20260709 13:16:15.267736 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2165) took 2932 ms. Trace:
I20260709 13:16:15.267835 10324 rpcz_store.cc:276] 0709 13:16:10.476259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.161704 (+1685445us) service_pool.cc:224] Handling call
0709 13:16:12.161978 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.218360 (+ 56382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.266927 (+3048567us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b540020ab54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:15.267231 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128181632}
I20260709 13:16:15.268178 10320 rpcz_store.cc:276] 0709 13:16:12.335719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.233599 (+2897880us) service_pool.cc:224] Handling call
0709 13:16:15.234130 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.267459 (+ 33329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.267663 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.250910 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.251187 10249 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:15.257277 10322 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:16:15.269987 10249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2344) took 2261 ms (client timeout 2091 ms). Trace:
I20260709 13:16:15.258662 10319 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:16:15.270395 10249 rpcz_store.cc:269] 0709 13:16:13.008708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.550481 (+541773us) service_pool.cc:224] Handling call
0709 13:16:15.198726 (+1648245us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5800002a98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:16:15.269917 (+ 71191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57026304}
I20260709 13:16:15.270961 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2223) took 2993 ms. Trace:
I20260709 13:16:15.271153 13549 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.254928 10318 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:15.260098 13293 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.271921 10318 pending_rounds.cc:85] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 4
I20260709 13:16:15.272277 10318 pending_rounds.cc:107] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:15.250458 13618 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:15.272481 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2222) took 3270 ms. Trace:
I20260709 13:16:15.273101 13618 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.264688 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.273736 13618 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.274573 10316 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:15.275171 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2224) took 2997 ms (client timeout 3163 ms). Trace:
I20260709 13:16:15.275290 13578 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.275849 13578 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:15.275657 10316 rpcz_store.cc:269] 0709 13:16:12.277666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.218451 (+2940785us) service_pool.cc:224] Handling call
0709 13:16:15.275069 (+ 56618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.257330 13516 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.271489 10319 rpcz_store.cc:276] 0709 13:16:12.277393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.224970 (+2947577us) service_pool.cc:224] Handling call
0709 13:16:15.258319 (+ 33349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.270646 (+ 12327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.270895 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.277237 13578 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.272608 10318 raft_consensus.cc:2889] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.281155 13539 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.281435 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2183) took 2683 ms. Trace:
I20260709 13:16:15.281948 10318 rpcz_store.cc:276] 0709 13:16:12.598069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.246527 (+2648458us) service_pool.cc:224] Handling call
0709 13:16:15.254426 (+  7899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.281081 (+ 26655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.281357 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.282585 13481 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.284483 13507 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.285463 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1526) took 2810 ms. Trace:
I20260709 13:16:15.224715 13579 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:15.287489 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.288833 13579 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.285988 10250 rpcz_store.cc:276] 0709 13:16:12.474966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.076296 (+2601330us) service_pool.cc:224] Handling call
0709 13:16:15.200935 (+124639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.220374 (+ 19439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.285180 (+ 64806us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000a8a50. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.285369 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285375360}
I20260709 13:16:15.290160 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.291038 10246 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:16:15.293290 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 2.29011e+06us
I20260709 13:16:15.273140 10322 rpcz_store.cc:276] 0709 13:16:12.002544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.219721 (+3217177us) service_pool.cc:224] Handling call
0709 13:16:15.221997 (+  2276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.269971 (+ 47974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.272390 (+  2419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.294840 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:15.295596 10245 raft_consensus.cc:2376] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
I20260709 13:16:15.295943 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:15.297076 10317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2212) took 4694 ms (client timeout 2214 ms). Trace:
W20260709 13:16:15.297492 10317 rpcz_store.cc:269] 0709 13:16:10.602540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.641780 (+1039240us) service_pool.cc:224] Handling call
0709 13:16:15.296821 (+3655041us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000cbf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.296982 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3739014528}
W20260709 13:16:15.299119 10323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2185) took 2637 ms (client timeout 1699 ms). Trace:
I20260709 13:16:15.299289 13578 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:15.299602 10323 rpcz_store.cc:269] 0709 13:16:12.661786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.754305 (+1092519us) service_pool.cc:224] Handling call
0709 13:16:15.298890 (+1544585us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002c74d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:15.299036 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308965632}
I20260709 13:16:15.304457 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:15.305295 10242 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.308573 13502 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.310652 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.311416 10246 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:15.311805 13283 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.312640 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.313460 10249 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:15.314119 13593 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:15.314548 13593 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:15.314558 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.334437 10242 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:15.335707 10248 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:16:15.336138 10248 pending_rounds.cc:85] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:16:15.343837 10248 pending_rounds.cc:107] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:16:15.345932 10248 raft_consensus.cc:2889] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.340853 13507 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:15.341564 13502 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:15.315645 13593 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.363735 13502 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.364436 13593 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.349071 13558 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.367187 10321 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:15.368000 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2184) took 2763 ms. Trace:
I20260709 13:16:15.368376 10321 rpcz_store.cc:276] 0709 13:16:12.604696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.317735 (+2713039us) service_pool.cc:224] Handling call
0709 13:16:15.345429 (+ 27694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.367704 (+ 22275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.367909 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:15.352165 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 2.57102e+06us
I20260709 13:16:15.371284 13504 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:15.374456 13502 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.378604 13481 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.379526 13481 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.356221 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.383275 10247 raft_consensus.cc:2410] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:15.360661 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:15.384166 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.385167 10993 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:15.386359 13558 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:15.386435 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:15.387017 13558 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.387493 13547 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:15.387790 13470 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:15.388556 13481 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.388279 13547 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.389508 13470 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:15.390632 13381 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.390669 10364 leader_election.cc:336] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.523s (SENT)
I20260709 13:16:15.391047 13547 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.391439 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1530) took 2454 ms. Trace:
I20260709 13:16:15.391275 13381 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.355453 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.391893 10248 rpcz_store.cc:276] 0709 13:16:12.936843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.136784 (+2199941us) service_pool.cc:224] Handling call
0709 13:16:15.137501 (+   717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.355931 (+218430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.391366 (+ 35435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.392637 10242 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:15.393842 13381 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.393646 13618 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.387542 13440 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:16:15.397922 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:15.408643 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.420001 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.420418 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:15.421020 10242 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.421236 10248 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:15.421444 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:15.407877 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.403342 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.387636 13558 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:15.425263 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.429000 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.437727 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.420038 13618 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:15.457858 10145 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 207) took 14418 ms (client timeout 15000 ms). Trace:
I20260709 13:16:15.465276 10999 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:15.475971 10395 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.473821 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:15.477088 10249 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.452975 10247 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:16:15.493273 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 79074.8us
I20260709 13:16:15.501631 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.503952 10390 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.505261 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.501698 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:15.510210 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.510769 10243 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:15.492503 13440 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:15.514547 13440 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.515148 13440 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.514417 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.522116 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.527087 10395 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:15.528172 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.528852 10391 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:15.529081 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.529847 11001 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:15.530521 10995 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:15.531111 10396 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:15.533550 10242 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:15.535351 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.525811 10997 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:15.528879 10247 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:15.545730 10250 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:15.549330 13618 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:15.556849 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.557665 10247 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:16:15.565274 11001 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:15.474529 10145 rpcz_store.cc:269] 0709 13:16:01.038755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.038927 (+   172us) service_pool.cc:224] Handling call
0709 13:16:15.457531 (+14418604us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:09.530829 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:09.531401 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:09.531441 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:16:09.531458 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:09.532661 (+  1203us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:09.532723 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:09.532752 (+    29us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:16:09.533878 (+  1126us) tablet.cc:701] Row locks acquired
0709 13:16:09.533895 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:16:09.534063 (+   168us) write_op.cc:270] Start()
0709 13:16:09.534196 (+   133us) write_op.cc:276] Timestamp: P: 1783602969534005 usec, L: 0
0709 13:16:09.534215 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:09.625488 (+ 91273us) log.cc:844] Serialized 5255 byte log entry
0709 13:16:11.397007 (+1771519us) op_driver.cc:464] REPLICATION: finished
0709 13:16:11.978873 (+581866us) write_op.cc:301] APPLY: starting
0709 13:16:11.992908 (+ 14035us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:12.093355 (+100447us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:12.104723 (+ 11368us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:12.996541 (+891818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:13.074939 (+ 78398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:16:13.135941 (+ 61002us) write_op.cc:312] APPLY: finished
0709 13:16:13.491836 (+355895us) log.cc:844] Serialized 95 byte log entry
0709 13:16:14.223821 (+731985us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:14.235108 (+ 11287us) write_op.cc:454] Released schema lock
0709 13:16:14.235163 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:14.235572 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:14.235600 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":164881,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":352523,"apply.run_cpu_time_us":38985,"apply.run_wall_time_us":2275034,"num_ops":13,"prepare.queue_time_us":292349,"prepare.run_cpu_time_us":17729,"prepare.run_wall_time_us":147945,"raft.queue_time_us":635003,"raft.run_cpu_time_us":9239,"raft.run_wall_time_us":272923,"replication_time_us":1844071,"thread_start_us":1133496,"threads_started":5,"wal-append.queue_time_us":1526786,"wal-append.run_cpu_time_us":38365,"wal-append.run_wall_time_us":2023757}]]}
I20260709 13:16:15.578989 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.579977 10247 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:15.581602 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:15.582351 10321 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.596530 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.595851 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:15.592761 10213 leader_election.cc:336] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.684s (SENT)
I20260709 13:16:15.597671 10247 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:15.595539 13581 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.603646 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.604493 10243 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:15.604261 13581 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.603713 13572 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.606423 13572 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:15.607404 13572 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.608882 13572 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.615396 13581 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.617492 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.619800 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.619685 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:15.620954 10362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.645s (SENT) [suppressed 32 similar messages]
W20260709 13:16:15.622059 10362 connection.cc:256] RPC call timeout handler was delayed by -1.4471417990000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 13:16:15.622530 10362 connection.cc:256] RPC call timeout handler was delayed by -1.3022417990000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:16:15.622840 10362 connection.cc:256] RPC call timeout handler was delayed by -1.2617417990002195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:16:15.623126 10362 connection.cc:256] RPC call timeout handler was delayed by -1.13214179900001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:16:15.623471 10362 connection.cc:256] RPC call timeout handler was delayed by -1.048441799000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 13:16:15.624823 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:16:15.625586 10391 raft_consensus.cc:606] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:15.625504 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.626083 10391 raft_consensus.cc:614] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:15.626363 10397 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.627152 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.627477 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.628235 10392 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:15.629628 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.630407 10393 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:15.631829 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.632817 10243 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:15.633064 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.633422 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.634073 10392 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:15.634130 13498 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:15.633775 10391 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
W20260709 13:16:15.634218 10213 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.699s (SENT)
I20260709 13:16:15.635179 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.636483 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.640532 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.644701 10321 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:15.641733 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.634773 13498 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.648522 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.649181 10398 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:15.635741 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.649102 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.649931 10394 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:15.650018 13498 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.651054 10391 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:15.651505 10397 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:15.653977 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.656051 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.657672 10393 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:15.658162 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.659085 11001 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:15.656859 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.722647 10997 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
W20260709 13:16:15.722713 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 80815.9us
I20260709 13:16:15.659489 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.660020 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.660307 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.661018 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.724081 10397 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:15.665753 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:15.677837 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.651787 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.674391 10392 raft_consensus.cc:2393] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:15.721232 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.721658 10243 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:15.726967 10249 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:15.728147 10391 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:15.728235 10393 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:15.738709 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.728646 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:15.763192 10399 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:15.725610 10323 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:15.743685 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:15.637260 13440 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.734536 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.737681 10247 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:15.770349 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.773031 10399 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:15.774461 10391 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:15.764195 10999 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:15.769110 10397 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.752417 10390 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:15.789403 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:15.792047 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:15.797479 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.800678 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.748153 10146 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 2 to 6, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.805620 10995 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:15.798285 10396 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:15.778726 13440 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.808568 10999 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:15.812424 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:15.811998 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.815315 10247 raft_consensus.cc:2410] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:15.812615 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.817013 13504 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.817374 10213 leader_election.cc:336] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.766s (SENT)
I20260709 13:16:15.817649 13504 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.818450 10392 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:15.821298 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:15.825011 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:15.825101 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:15.824906 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:15.825909 10322 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.826280 10995 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:15.809808 13592 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.828975 10321 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:15.831897 10317 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.811648 13618 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:15.836752 10391 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:15.840173 10318 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:16:15.828701 13440 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:15.843304 10321 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:15.832397 13481 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.837734 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.841813 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:15.847975 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.848459 10995 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:15.849606 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.846818 13618 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.850361 10319 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:15.851651 13618 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.834079 13592 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.854946 13558 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.855878 13592 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.856231 10323 raft_consensus.cc:2368] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:15.856571 13481 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.857839 13558 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.858805 13481 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:15.832685 13504 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:15.839640 10146 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:16:15.870406 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.876017 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.877151 10391 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:15.866878 13440 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.880541 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.881320 10398 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:15.882762 13440 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:15.883546 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.884222 10391 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:15.886900 10397 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:15.888279 10993 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:15.889755 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:15.890594 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.891521 10319 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:16:15.905676 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.905889 13498 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:15.906422 10397 raft_consensus.cc:2376] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10. Re-sending same reply.
I20260709 13:16:15.906809 13498 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:15.906831 13599 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:15.907331 13498 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:15.907670 10322 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:15.907982 13599 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:15.906427 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:15.908401 13599 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:15.908833 13381 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:15.909250 13381 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.908572 13498 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.909638 13381 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:15.909346 13599 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.911047 13599 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.918203 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:16:15.920576 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.922593 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.922801 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:15.923935 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.924906 10316 raft_consensus.cc:2410] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:15.923987 13504 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:16:15.925766 13593 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.926003 13504 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:15.926451 13504 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:15.926334 13593 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:15.931675 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.932525 10323 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:15.933975 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.927893 10146 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:15.927537 13581 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:15.940778 10321 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:15.940656 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.896520 13584 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:15.944119 10391 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:15.944306 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.945003 10392 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:15.942786 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.946686 10398 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:15.949100 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.941262 13498 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.941161 13504 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:15.956152 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.954504 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.960705 10391 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:15.961635 10146 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 6 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:15.962708 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.957614 10323 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:16:15.965013 10213 leader_election.cc:336] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.881s (SENT)
I20260709 13:16:15.957048 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.969154 10397 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:15.972129 10321 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:15.972946 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.973014 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.976893 10398 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:15.977198 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:15.982026 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:15.982892 10392 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:15.984139 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:15.984942 10396 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.979698 10316 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:15.973052 13599 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:15.997578 10323 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:15.989348 10146 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:16.011283 10317 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
W20260709 13:16:15.980496 10213 leader_election.cc:336] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.881s (SENT)
I20260709 13:16:16.013927 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.015846 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:15.990923 13599 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:16.021119 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:16.021642 13599 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.022733 13593 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.023687 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:16.026453 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.025265 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.020538 10317 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:16.019075 10146 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 7, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 7 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.035940 10390 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:16.018632 13481 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.043558 10965 connection.cc:256] RPC call timeout handler was delayed by -3.0776122760000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:16:16.044705 10323 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.045683 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.033872 13504 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.051775 10398 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:16.054654 10997 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:16.063406 10994 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 13:16:16.067624 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 87175.8us
I20260709 13:16:16.069798 13593 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.059940 10247 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:16.074915 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.075920 10316 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:16.049417 13481 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.087076 10998 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:16.088018 10396 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:16.094074 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.097901 10323 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
W20260709 13:16:16.098037 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.048877 13592 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:16.100754 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.101092 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.101490 10243 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:16.102512 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.108349 10247 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:16.109736 10323 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.110966 10997 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:16:16.116261 10213 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.888s (SENT)
W20260709 13:16:16.120455 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.124751 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.125248 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.126148 10316 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.126187 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:16.127491 10146 catalog_manager.cc:5697] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 1 to 5, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 5 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:16.131383 10213 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.888s (SENT)
I20260709 13:16:16.132059 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:16.119159 13581 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:16.150143 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.152981 10243 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:16.153134 10249 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:16.152773 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.152769 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.111217 13592 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.155798 10398 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:16:16.156203 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 233520us
I20260709 13:16:16.159587 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.162038 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.164942 10250 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:16.166467 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.165879 10146 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 5, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 5 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.167199 10317 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:16.168010 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.192298 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.195416 10993 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.197796 10323 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:16.199981 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:16.200424 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.200634 10398 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.202486 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.209721 10243 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:16.207158 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:16.219420 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 88083us
I20260709 13:16:16.222770 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.223037 11000 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:16.160629 13593 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.224077 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.232199 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.233561 13641 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:16.234576 10362 leader_election.cc:400] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
I20260709 13:16:16.234910 10362 leader_election.cc:403] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:16.234090 13481 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.155825 13381 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.243005 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.245186 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.254735 10317 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:16.254813 10249 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:16.245471 13581 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.243011 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.247416 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.247502 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.248389 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.263629 10246 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:16.264905 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.265615 10245 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:16.252804 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.249388 10967 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:16.265857 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.250671 10213 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.959s (SENT)
I20260709 13:16:16.251006 10146 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 5, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 5 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.252319 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.259259 10398 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:16.269217 10242 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.267038 10247 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:16.270982 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.274389 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:16.276163 10247 raft_consensus.cc:2410] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:16.278502 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.278879 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.279166 10243 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:16.280864 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.282944 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.280089 13481 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.290468 13481 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.290355 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.290933 13481 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.291159 10997 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:16.292248 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.293427 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:16.293931 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.294541 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.281622 10250 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:16.295351 10249 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:16.284412 10146 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 6 to 7, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:16.287220 10246 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:16:16.302038 10993 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:16.303962 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.305904 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:16.285857 13643 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:16.310550 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.311215 10243 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:16.312688 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.313355 10250 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:16.313000 10146 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 8 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:16.314388 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.315006 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.315302 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:16.315588 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64961.4us
I20260709 13:16:16.315886 10999 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:16.316884 10213 leader_election.cc:336] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.977s (SENT)
I20260709 13:16:16.317301 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:16.317946 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:16.318642 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.318950 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:16.319989 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:16.320622 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:16.308132 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.308924 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.321633 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.321754 10247 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:16.322201 11001 raft_consensus.cc:2376] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10. Re-sending same reply.
I20260709 13:16:16.323383 10994 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:16.315629 11000 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:16.324028 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:16.324645 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.327942 10316 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:16.323698 10998 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:16.321521 11002 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 3.
I20260709 13:16:16.330325 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.332824 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.331202 10998 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:16.332878 10146 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 6, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 6 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.299397 13498 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
I20260709 13:16:16.332185 13470 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.339393 13381 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:16.339622 13481 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.340291 13381 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.340703 13381 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:16.341070 13381 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.341615 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.320176 13599 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.342213 10994 raft_consensus.cc:2376] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7. Re-sending same reply.
I20260709 13:16:16.343217 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.343863 13599 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:16.344241 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.344497 13599 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:16.345000 10994 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:16.345853 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.345954 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.346557 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.345005 13599 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.347805 13599 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.342036 13481 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:16.354575 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.355319 10249 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:16.286008 13593 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:16.357007 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.357826 11002 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:16.347752 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:16.358351 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.358899 11000 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:16.359309 10245 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:16.361893 10247 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:16.363722 10242 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:16.357822 13599 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.364476 10999 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:16.384133 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.376156 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:16.378017 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.339454 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.386010 10245 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.361912 13584 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:16.331821 13618 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.331557 13641 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:16.373711 13470 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:16.388044 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 101270us
I20260709 13:16:16.389256 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.332005 13652 raft_consensus.cc:2764] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:16:16.387989 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 48619us
I20260709 13:16:16.394207 10398 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:16.395782 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:16.395921 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.399034 10390 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.396214 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.397162 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.402669 10247 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.396621 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:16.397214 10997 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:16.404724 10391 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:16.403959 13481 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:16:16.411867 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.412209 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.418849 10390 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:16.392143 13498 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:16.391876 13618 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.427408 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:16.428364 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 108413us
I20260709 13:16:16.429379 10364 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.426986 10996 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:16.435758 10249 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:16.393482 13470 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.439146 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:16.440389 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:16.440845 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:16.443423 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 126615us
I20260709 13:16:16.439858 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.444903 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.445511 10250 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:16.442539 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 83108.8us
I20260709 13:16:16.449236 10244 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:16.411773 13592 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:16.454062 10213 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.979s (SENT)
I20260709 13:16:16.458571 13584 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:16.459404 10213 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.000s (SENT)
I20260709 13:16:16.459832 13584 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:16.460549 10213 leader_election.cc:336] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 2.035s (SENT)
I20260709 13:16:16.461967 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:16.437757 13618 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.443131 13470 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.473630 13655 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:16.476420 13655 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:16.476827 13655 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:16.411725 13651 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:16:16.457372 13653 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:16.485903 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 56585.5us
I20260709 13:16:16.486205 13593 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:16.491247 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.491071 10364 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.485800 13653 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.486393 13657 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.487187 13481 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:16.477936 13592 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:16:16.527268 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.538766 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.539116 10316 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:16.539594 10321 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:16.539729 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.540467 10317 raft_consensus.cc:2368] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
I20260709 13:16:16.542308 13659 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.542866 13659 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.543306 13659 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.546487 13599 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:16.518608 13665 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:16.486138 13641 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.547224 13665 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:16.548606 13666 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:16.495963 13653 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.501062 13481 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.486883 13644 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:16:16.497785 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:16.514338 13660 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.549762 13440 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.571799 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 123071us
W20260709 13:16:16.567008 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 127226us
W20260709 13:16:16.571982 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 74489us
I20260709 13:16:16.574380 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.575278 13592 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:16.575419 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:16.575743 13592 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:16.571702 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 129983us
I20260709 13:16:16.560334 13481 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.571087 10321 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:16.577977 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.508709 13663 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:16:16.506640 13657 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.581979 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:16.586154 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.589216 10245 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:16.579035 13592 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.579557 13504 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:16.596562 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.599035 10321 raft_consensus.cc:2376] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
I20260709 13:16:16.578975 13440 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.590243 13642 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.597646 13670 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.580498 13660 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.618877 13663 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:16.629424 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.630857 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:16.636418 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 52967.3us
I20260709 13:16:16.636468 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:16.636245 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 145208us
I20260709 13:16:16.639808 13599 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.640064 10247 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:16.640385 13599 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.640875 13599 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:16.642607 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 65377.3us
I20260709 13:16:16.642855 13644 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:16.644179 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 61459us
W20260709 13:16:16.652575 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.632743 13663 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.656939 13663 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.657879 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:16.684819 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.651767 13644 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:16.692353 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:16.697108 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59367.2us
I20260709 13:16:16.697902 10967 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.704035 13678 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.704741 13678 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.705231 13678 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.705991 10967 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.709219 13684 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:16.710944 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:16.716465 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58668.3us
I20260709 13:16:16.716603 10316 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
W20260709 13:16:16.717382 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.723513 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:16.740989 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.645292 13670 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.710765 13671 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:16.755187 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.757493 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.758967 10323 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:16.759227 10316 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:16.752257 10321 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:16.714982 13684 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:16.764459 13673 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:16.769061 10250 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:16:16.772152 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66149.6us
I20260709 13:16:16.719208 13672 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.776000 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:16.780059 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 199199us
I20260709 13:16:16.778276 10967 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.758767 13671 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.724180 13651 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:16:16.785050 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.773504 13684 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:16.789320 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 72155us
I20260709 13:16:16.781518 13584 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:16.793242 10364 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:16.793849 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.795675 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.778376 13680 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.690472 13665 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.785765 13671 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.819366 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.819788 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:16.821076 10323 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:16.822082 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:16.779379 13504 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:16:16.822486 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.795540 13593 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.824509 13667 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:16.824244 13661 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:16:16.825448 13677 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:16.826028 13677 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:16.826519 13677 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.831399 13670 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.798964 13659 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.812075 13652 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:16.835808 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.798434 13498 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:16.811295 13660 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.838550 10323 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:16.838768 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 45615.7us
W20260709 13:16:16.837895 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 50384.4us
I20260709 13:16:16.816356 13680 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.844352 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.844956 10246 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.820366 13440 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.846136 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:16.845288 13666 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.855135 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.823362 13470 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.841106 13593 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:16.851559 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.845971 13498 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:16.816043 13657 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.853096 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:16.853868 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.861819 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 250118us
W20260709 13:16:16.861241 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 144138us
I20260709 13:16:16.837004 13652 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:16.865316 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:16.865314 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.868207 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.869227 10247 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:16.872287 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.871752 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.845391 13685 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:16.872875 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.875056 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:16.876600 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.899012 10241 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:16.899099 10249 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.877154 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.900022 10243 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.878082 10244 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:16.900913 10244 pending_rounds.cc:85] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:16:16.901153 10244 pending_rounds.cc:107] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:16:16.901372 10244 raft_consensus.cc:2889] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.878577 13558 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:16.880868 13593 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:16.892721 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.784116 13644 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.912534 10247 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:16.912822 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:16.875819 13678 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.846071 13680 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.874204 13599 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:16.886698 13504 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.940143 13599 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:16.887002 13642 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:16.888345 13481 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:16.889182 13381 consensus_meta.cc:287] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.001s
I20260709 13:16:16.869905 13618 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.890044 13652 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.854421 13666 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:16.891628 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.896821 13663 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.891721 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.892009 13662 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:16.892688 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.970491 10321 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:16.892879 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.862090 13665 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.893330 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.893872 13657 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.894539 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.895291 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.895773 13668 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:16.896198 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.894819 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:16.864836 13440 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.996347 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.916183 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.998008 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:16.917697 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.999119 10242 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:16.923811 10250 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:16.925112 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:17.001005 10317 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:16.907393 13558 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.926626 13659 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:16.924146 13572 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.927771 13470 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:16.928799 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:16.931596 13592 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.932281 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.854620 13660 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:16.943833 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:16.907189 13655 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.946501 10249 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:16.950500 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:16.933722 13498 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:16.954700 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 156189us
W20260709 13:16:16.972890 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.031436 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:16.948256 13640 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.973641 10316 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:16.987931 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:16.988436 13618 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:16.988540 10322 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:16:16.987048 10318 raft_consensus.cc:2376] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6. Re-sending same reply.
I20260709 13:16:16.988978 13678 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:16.955714 13381 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:16.953466 13670 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:16.957902 13642 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:16.986187 13644 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.948058 13685 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:16.924358 13641 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:16:17.001950 13657 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.003975 10243 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
W20260709 13:16:17.005926 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.968817 13666 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.003126 10248 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.945468 10241 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:17.027032 10247 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:17.023479 10320 raft_consensus.cc:2376] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7. Re-sending same reply.
I20260709 13:16:17.023389 13593 raft_consensus.cc:2764] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:16.985069 13652 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.023955 13662 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:17.034757 10325 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:17.035408 10364 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:17.034164 10321 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:17.022368 13558 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.038362 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:17.039994 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:16.984993 13584 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:16:17.040693 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 90279.1us
I20260709 13:16:16.969008 13581 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:16:17.042522 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:17.116099 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:17.048938 13498 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:17.050734 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.065229 11000 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:17.021466 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 126716us
W20260709 13:16:17.084667 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51594.8us
I20260709 13:16:17.084712 13692 raft_consensus.cc:2764] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:17.120260 13685 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.052366 13470 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:17.120900 13675 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.121377 13470 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.121524 13675 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.121843 13470 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:17.107793 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 72510.5us
I20260709 13:16:17.051397 13642 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:17.112100 13662 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.081409 13699 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.070340 13640 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:17.117934 10996 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:17.108327 13653 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.005s
I20260709 13:16:17.119232 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:17.119992 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 69366.3us
I20260709 13:16:17.106434 10324 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:17.145304 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:17.192775 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 72667us
I20260709 13:16:17.193342 10241 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:17.174691 10248 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:17.158695 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.195171 10247 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.122121 13675 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:17.187204 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 66520us
I20260709 13:16:17.251240 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.209333 10246 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:17.233788 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:17.196710 13381 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:17.232913 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.250030 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.254803 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.198397 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:17.228972 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 108882us
I20260709 13:16:17.255779 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:17.256366 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58112.1us
W20260709 13:16:17.257746 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.257212 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:17.114475 13689 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.260170 10364 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:17.226043 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.267915 10967 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:17.269338 13504 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:17.122623 13691 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.137686 13440 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:17.154556 13481 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:17.156134 13657 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:17.272869 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.156338 13599 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:16:17.277421 13698 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.277500 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.275610 13440 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:17.275048 13498 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:17.278801 13660 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:17.279095 13440 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.279954 13660 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:17.280102 13440 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:17.280351 13660 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:17.280781 13558 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.281324 13660 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.270072 13584 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:17.194126 13699 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:17.270264 13581 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:17.283108 13699 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.285440 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.286772 13689 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:17.271836 13670 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:17.272491 13504 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:17.248884 13653 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.287882 13689 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.288296 13504 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.273991 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:17.290835 13653 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:17.291671 13498 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:17.292795 13498 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.232409 13671 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.294667 13584 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:17.296375 13671 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:17.296209 13584 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.297910 13440 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.298621 10995 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:17.286600 13618 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.300280 13640 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.301533 13680 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.271620 13702 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:17.302641 13659 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:17.303146 10362 leader_election.cc:400] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 4. Current term is 5.
I20260709 13:16:17.303258 13655 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:17.303727 13581 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:17.304678 13670 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:17.188609 13656 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:17.307123 13660 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.307849 13657 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:17.323132 10397 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:17.308501 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.299108 13558 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:17.314815 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.325591 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.325799 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.317930 10993 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:17.271330 13663 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:17.319365 10390 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:17.336540 10391 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:17.305212 13666 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.315371 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:17.322501 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.324021 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.332791 10248 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:17.332849 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.338100 10243 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.333683 13657 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:17.334002 10398 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:17.334410 10250 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:17.339926 10246 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:17.317265 13659 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:17.343585 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 224379us
I20260709 13:16:17.343672 10290 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.347888 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:17.350178 10247 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:17.348361 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:17.339502 13657 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.351589 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:17.319259 13702 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:17.356937 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.270915 13684 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.366138 13642 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.347157 13440 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:17.347404 13659 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.362438 13668 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:17.323395 13661 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:16:17.375093 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:17.388018 13668 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.391896 13668 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.391786 13702 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.393225 13675 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.389984 13669 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:17.389815 13695 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:16:17.348969 13651 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:17.390053 13705 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:16:17.352772 13657 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.400238 10999 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:17.356050 13572 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.367504 13655 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:17.350164 13653 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:17.360263 10243 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
W20260709 13:16:17.434477 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 98347.7us
W20260709 13:16:17.441789 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 86977.7us
W20260709 13:16:17.447782 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 58931.4us
I20260709 13:16:17.452157 10998 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:17.453190 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:17.453845 10995 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.454963 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:17.422129 13655 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:17.463101 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:17.463244 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.463860 10390 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:17.430150 13558 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:17.467808 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.470836 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.472060 10391 raft_consensus.cc:2410] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:17.473539 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.474717 10397 raft_consensus.cc:2410] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:17.475416 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.475870 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.477295 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.393225 13699 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.482264 10394 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:17.482831 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:17.484524 10393 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.490666 10398 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:17.465780 13669 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:17.491554 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:17.490511 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 79422us
I20260709 13:16:17.455672 13440 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:17.462913 13381 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.498395 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:17.521543 10243 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:17.522521 10245 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:17.528313 10996 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:17.530668 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:17.532140 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64382us
I20260709 13:16:17.533202 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:17.409878 13581 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:17.541987 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:17.543879 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:17.546864 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.549870 13712 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:16:17.551046 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:17.551949 10316 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:17.552374 10395 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:17.544564 10320 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
W20260709 13:16:17.537446 13677 consensus_meta.cc:287] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.710s	user 0.013s	sys 0.000s
I20260709 13:16:17.564834 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:17.530050 13644 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:17.566552 10318 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.545583 13680 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:17.550829 13618 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.571432 13666 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:17.598794 10213 leader_election.cc:336] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.128s (SENT)
I20260709 13:16:17.570580 13695 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.572494 13677 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:17.701083 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 159187us
I20260709 13:16:17.723134 10318 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
W20260709 13:16:17.749691 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 216593us
I20260709 13:16:17.751174 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:17.644387 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.598012 13618 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.711773 13642 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.763069 13618 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:17.765323 13695 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:17.766037 13695 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:17.769624 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 222861us
I20260709 13:16:17.771057 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.772083 13680 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.772637 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:17.773145 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.774406 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.775496 13698 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:17.775624 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 176854us
W20260709 13:16:17.776443 10213 leader_election.cc:336] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.143s (SENT)
I20260709 13:16:17.776893 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.777863 13698 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.582589 13718 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.804069 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 306015us
W20260709 13:16:17.719558 13721 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:16:17.720083 13717 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:16:17.704353 13652 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 13:16:17.815094 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:17.713874 13470 consensus_meta.cc:287] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:16:17.810940 13558 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:17.821722 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:17.822996 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48768.5us
I20260709 13:16:17.745606 13666 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:17.717200 13696 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.633693 13592 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:17.831781 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 81083.1us
I20260709 13:16:17.833336 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.723961 13691 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:17.652033 13684 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:17.828615 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:17.828755 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:17.650906 13719 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.829330 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:17.724705 13699 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:17.619956 13675 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:17.837988 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.840893 10995 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:17.843564 10398 raft_consensus.cc:2410] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:17.841172 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:17.857653 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.858163 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.709939 13668 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.828796 13666 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:17.898586 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.670392 13440 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.594725 13655 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:17.906211 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.907065 10245 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:17.916190 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82924.1us
I20260709 13:16:17.826363 13470 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:17.921345 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 80364.5us
I20260709 13:16:17.856099 13680 raft_consensus.cc:2764] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:17.941251 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:17.911075 13666 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.953584 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:17.955662 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.965092 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 186864us
I20260709 13:16:17.922942 13691 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.922538 13599 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:17.982147 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:17.995903 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:17.650862 13669 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:17.825189 13718 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:17.965503 13715 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 13:16:17.935475 13642 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:17.856245 13719 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.018985 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:18.027549 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 74072.9us
I20260709 13:16:18.028700 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:18.035326 10213 leader_election.cc:336] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.312s (SENT)
I20260709 13:16:18.040969 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:18.045152 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:17.975284 13584 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:18.006824 13651 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.003939 13684 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.007728 13672 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:18.035233 13592 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:18.046985 13710 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:18.025400 13644 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.111498 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 66456.1us
I20260709 13:16:18.046505 13599 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.049546 13691 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:18.147562 10393 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.657s	user 0.001s	sys 0.015s
I20260709 13:16:18.199512 10393 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:18.147992 13712 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:18.141031 13733 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:18.148859 13660 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.821s	user 0.001s	sys 0.017s
W20260709 13:16:18.118033 13665 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.118s	user 0.015s	sys 0.013s
I20260709 13:16:18.071127 13731 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.993480 13558 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.152643 13734 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:18.158594 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 138835us
W20260709 13:16:18.081084 13714 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:16:18.115906 13657 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.007s
I20260709 13:16:18.206733 13599 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.271862 13657 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.273885 13657 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.113348 13698 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:18.194855 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.198171 13670 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:18.222508 13732 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:16:18.229084 13733 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.205920 13726 raft_consensus.cc:2764] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:18.152652 13695 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:18.261204 13659 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.004s
W20260709 13:16:18.278187 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.223425 13666 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:18.226722 13730 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.243s	user 0.003s	sys 0.000s
I20260709 13:16:18.159296 13581 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.146528 13684 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:18.176534 13641 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.145260 13672 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:18.263712 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.024083 13642 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.200387 13644 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.291610 13733 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:18.286634 13670 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:18.325760 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.294633 13695 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.282074 13718 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.274204 13599 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.304201 13684 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:18.306363 13662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.004s
W20260709 13:16:18.327590 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 512557us
W20260709 13:16:18.326736 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 459467us
W20260709 13:16:18.340276 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 298567us
I20260709 13:16:18.303859 13668 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.295043 13659 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.346284 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:18.349340 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.265738 13731 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.285600 13698 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:18.329277 13592 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:18.279316 13756 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:16:18.352229 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.357232 10247 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.307302 13641 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.344637 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:18.355235 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 162573us
I20260709 13:16:18.345461 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.335947 13470 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.366024 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:18.343001 13662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.010s	sys 0.005s
I20260709 13:16:18.367812 10248 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:16:18.368853 10248 pending_rounds.cc:85] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:16:18.369215 10248 pending_rounds.cc:107] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:16:18.369505 10248 raft_consensus.cc:2889] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:18.370086 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.369910 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.348927 13757 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.371961 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.372036 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.379269 10246 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:18.379565 10249 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:18.340195 13702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.003s	sys 0.011s
I20260709 13:16:18.383769 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:18.356504 13718 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.387372 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.387367 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.388247 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.389019 10247 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:18.391093 10245 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.362875 13672 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.414788 13677 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.394076 13675 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:18.413857 13755 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:18.412849 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.432497 10393 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.414188 13760 raft_consensus.cc:2764] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:18.413342 13670 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.420292 10395 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:18.411168 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.431824 13755 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:18.394804 10399 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:18.419193 10394 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:18.419557 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:18.454010 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 81337.3us
I20260709 13:16:18.396508 10391 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:18.420624 13729 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 13:16:18.411991 13745 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:18.394586 13657 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:18.397135 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52577.4us
I20260709 13:16:18.384474 13668 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.471359 10245 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:18.427636 13641 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:18.421481 13659 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:18.468501 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:18.395859 10250 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:18.480999 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:18.471946 10394 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:18.474604 10393 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:18.394518 13718 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.413784 13731 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.423703 13642 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.481729 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.484622 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:18.513940 10397 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:18.485360 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:18.515106 10391 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.485957 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:18.518868 10241 raft_consensus.cc:2410] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:18.486029 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.487315 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:18.520104 10247 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:18.494767 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:18.495658 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 218133us
I20260709 13:16:18.502040 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:18.521708 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.521962 10246 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:18.422511 13644 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.390476 13752 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:18.452785 13670 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.506954 10995 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.560814 10390 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:18.509059 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.561642 10394 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.485582 13691 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.516440 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:18.527472 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:18.534176 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.560750 10995 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:18.563521 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.564515 10243 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:18.471593 13668 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:18.562522 10395 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.562647 10396 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:18.507898 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:18.477219 13672 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.571632 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:18.572937 10994 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:18.394150 13757 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.501569 13689 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.506629 13718 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.580489 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.503332 13641 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.570801 10995 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.504616 13760 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:18.583041 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.585276 10391 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:18.585711 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:18.560389 13712 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:18.596633 10397 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:18.567090 13381 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.414561 13592 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.582412 13572 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:18.608775 10995 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:18.512895 13739 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:16:18.594038 13769 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.627573 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.628587 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:18.628820 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:18.630263 10318 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.582394 13766 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.631186 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:18.612759 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.601821 13756 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:18.632781 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:18.633703 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:18.635433 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.636974 10395 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:18.638033 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.638033 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:18.644464 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:18.642131 11000 raft_consensus.cc:2376] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:16:18.487644 13755 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.648252 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.653055 10320 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:18.648818 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.622015 13731 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.650033 10995 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:18.651309 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:18.654851 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:18.652495 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2397) took 1246 ms. Trace:
I20260709 13:16:18.625882 13752 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.664196 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.662209 10995 pending_rounds.cc:85] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 7
I20260709 13:16:18.665997 10995 pending_rounds.cc:107] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:18.666505 10995 raft_consensus.cc:2889] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.599709 13642 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:16:18.631282 13470 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.671535 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.671965 10319 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:18.672649 10317 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:18.674023 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.595554 13689 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.663242 10244 rpcz_store.cc:276] 0709 13:16:17.398152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.409386 (+ 11234us) service_pool.cc:224] Handling call
0709 13:16:17.409785 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.422193 (+ 12408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.422248 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.443105 (+ 20857us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.572308 (+129203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:17.572350 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.572428 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.419834 (+847406us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:18.632600 (+212766us) raft_consensus.cc:1685] finished
0709 13:16:18.632622 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.644452 (+ 11830us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26,"raft.queue_time_us":9809,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":1742,"spinlock_wait_cycles":58362624,"thread_start_us":86836,"threads_started":1,"wal-append.queue_time_us":530864}
I20260709 13:16:18.688344 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.688485 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.689332 10325 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:18.693295 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:18.693550 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.694000 10244 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:18.695726 10246 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:18.695175 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:18.696583 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:18.697162 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 68702.1us
I20260709 13:16:18.694178 10318 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:18.621989 13572 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.702925 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.642534 13769 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.703140 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.674518 13755 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:18.704209 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 91569.5us
I20260709 13:16:18.697898 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:18.710044 10320 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:18.746759 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:18.711756 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.747373 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.747571 10322 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.740089 10319 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:18.734267 10318 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:18.665984 13641 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.664301 13699 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.672210 13756 raft_consensus.cc:2764] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:18.749836 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.745257 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:18.748796 10244 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:18.747689 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 92809.4us
I20260709 13:16:18.753098 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:18.703333 13709 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.015s	sys 0.016s
I20260709 13:16:18.670890 13731 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.755105 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:16:18.756076 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 58255.2us
I20260709 13:16:18.759032 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.762050 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:18.764442 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 135711us
I20260709 13:16:18.764900 10249 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:18.765172 13657 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:18.765666 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:18.767484 13764 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.767912 13764 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:18.768764 13764 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.770634 13764 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.771132 13696 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:18.777020 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.787443 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.791507 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.788537 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.792555 10319 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:18.703464 13776 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.738906 13702 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.642146 13668 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.746616 13762 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.798702 10213 leader_election.cc:400] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:18.799155 10213 leader_election.cc:403] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:18.760588 13709 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.015s	sys 0.017s
I20260709 13:16:18.692389 13470 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.802737 10324 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:18.813613 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:18.814478 10321 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:18.817565 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:18.814111 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 50940.6us
I20260709 13:16:18.818894 10322 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:18.821261 13786 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.821949 13572 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.821861 13786 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:18.823207 13782 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:18.824560 13786 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.825271 13786 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:18.826392 13777 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:18.827589 13777 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:18.827931 13777 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:18.828347 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:18.828945 13733 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:18.829741 13770 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.830158 10325 raft_consensus.cc:2368] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:18.830433 13756 raft_consensus.cc:2764] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:18.830470 13765 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:18.672457 13752 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.828794 13777 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:18.835387 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.806911 13642 raft_consensus.cc:2764] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:16:18.853514 13684 consensus_meta.cc:287] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 13:16:18.854362 13723 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:18.854794 13731 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:18.855055 13752 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:18.849838 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58357.4us
I20260709 13:16:18.855942 10316 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:18.856603 13470 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:18.858703 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:18.860392 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:18.862469 13695 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:18.863180 13695 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:18.864245 13695 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:18.866343 13687 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:16:18.871119 13781 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:16:18.847654 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:18.836323 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.919520 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.855001 13774 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.929214 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 72677.4us
I20260709 13:16:18.959914 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.831966 13668 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.963289 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 208268us
I20260709 13:16:18.967240 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:18.968932 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 121365us
I20260709 13:16:18.791141 13766 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:16:18.741266 13712 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.831228 13756 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:16:18.849344 13786 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.972764 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:18.893183 13739 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.820662 13760 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 13:16:18.850095 13641 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:18.875298 13440 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:18.984730 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:18.850052 13769 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:18.985913 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.957640 13731 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.853988 13684 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.831228 13765 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.978834 13642 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:18.963423 13723 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:18.981134 13572 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.009562 11001 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:18.876663 13702 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:16:18.968080 13752 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:16:18.836476 13776 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:18.992406 13470 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:18.992182 13662 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:19.004662 13652 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.007128 13786 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:19.010720 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.020001 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.115777 10397 raft_consensus.cc:2410] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:16:18.962822 13774 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.050132 10394 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:16:19.065141 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.092420 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.002827 13757 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.124307 13776 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:19.126464 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 159300us
I20260709 13:16:19.127699 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.129196 13498 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.129542 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.010906 13705 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:18.852564 13762 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.092270 13381 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.001533 13739 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.029250 13642 raft_consensus.cc:2764] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:16:19.106091 13655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.032s	sys 0.074s
W20260709 13:16:19.141430 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 281100us
I20260709 13:16:19.163493 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.017210 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:19.142976 13778 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:16:19.011538 13731 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.094717 13470 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.105716 13652 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:19.168004 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.131465 13726 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.100243 13662 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:19.172770 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 155480us
W20260709 13:16:19.161847 13655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.033s	sys 0.074s
I20260709 13:16:19.178573 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.182840 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.161319 13757 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.182916 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.185482 10397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:16:19.191542 10397 raft_consensus.cc:606] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.192029 10397 raft_consensus.cc:614] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:19.192647 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 433129us
I20260709 13:16:19.197835 13801 raft_consensus.cc:2764] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:16:19.184405 13662 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:19.198745 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.169938 13756 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.202808 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.203392 13661 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.203473 13655 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:19.204001 13801 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.234582 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:19.235375 11002 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:19.236519 13795 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.237007 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.238317 10998 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:19.238565 13795 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:19.208837 10250 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:19.210664 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:19.211916 13739 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:19.215518 13783 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:16:19.162714 13689 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.216193 10244 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:19.193984 13675 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:16:19.173902 13470 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.166570 13733 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:19.226078 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.281469 10322 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.174160 13652 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.180130 13705 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.227867 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.229212 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.291040 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:19.291075 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 65487.8us
I20260709 13:16:19.292344 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:19.241611 13795 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:19.229877 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.198681 13584 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:19.231995 13754 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:19.231824 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:19.183252 13723 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.232638 10319 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:19.233363 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.195482 13793 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.243028 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:19.245263 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:19.195302 13746 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:19.239807 10246 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
W20260709 13:16:19.251400 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 498337us
I20260709 13:16:19.248879 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:19.297170 10317 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:19.297437 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:19.299322 10997 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:19.235522 13752 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:16:19.275070 13661 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.225857 13771 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:16:19.329834 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.299086 13795 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.234814 13644 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:16:19.335384 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.315002 10321 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:19.316634 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 824) took 1861 ms. Trace:
I20260709 13:16:19.235699 13756 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.318161 10998 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:19.301442 13675 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:19.174300 13641 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.337199 10993 rpcz_store.cc:276] 0709 13:16:17.445966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.446153 (+   187us) service_pool.cc:224] Handling call
0709 13:16:17.446593 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.477672 (+ 31079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.477715 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.481180 (+  3465us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.392031 (+910851us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b180042fee0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:18.661756 (+269725us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:18.661797 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.661880 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.300997 (+639117us) raft_consensus.cc:1685] finished
0709 13:16:19.301018 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.307511 (+  6493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38351,"raft.queue_time_us":27104,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":12069,"spinlock_wait_cycles":10641664,"thread_start_us":269532,"threads_started":1,"wal-append.queue_time_us":1475457}
I20260709 13:16:19.272831 13786 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:19.354143 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 105313us
I20260709 13:16:19.354997 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.302315 13655 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:16:19.317473 13793 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:19.303999 13769 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:16:19.370795 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.372646 10322 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:19.333781 13746 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:19.339470 13687 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.381541 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.351816 13684 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:19.353801 13719 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:19.359037 13765 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.377779 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.382392 10322 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:19.353994 13760 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:19.369778 13793 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:19.381788 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87537.9us
I20260709 13:16:19.360992 13675 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:19.395968 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.396270 13665 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:19.389070 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.396955 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:19.397414 10394 raft_consensus.cc:2376] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:16:19.373514 13792 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.398510 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.399255 10394 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:19.389550 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.360201 13642 raft_consensus.cc:2764] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:16:19.381260 13776 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.340428 13661 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.401531 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.401877 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.402172 10397 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:19.443049 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:19.414148 10213 leader_election.cc:336] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.665s (SENT)
I20260709 13:16:19.443710 10393 raft_consensus.cc:2376] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6. Re-sending same reply.
I20260709 13:16:19.444034 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.444185 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.401585 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.446017 10398 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:19.445329 10390 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:19.442687 13774 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.450539 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.451431 10396 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:19.452714 13755 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.699s	user 0.004s	sys 0.006s
I20260709 13:16:19.452641 13790 consensus_queue.cc:1059] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:16:19.453156 13662 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.405409 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.457449 10322 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:16:19.457963 10213 leader_election.cc:336] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.701s (SENT)
W20260709 13:16:19.459223 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 57440.7us
W20260709 13:16:19.459370 10213 leader_election.cc:336] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.701s (SENT)
I20260709 13:16:19.459949 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.462100 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.462313 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:19.463393 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.394296 13791 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.469223 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:19.470736 10213 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.735s (SENT)
W20260709 13:16:19.454185 13794 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:16:19.469044 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.395998 13584 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:19.396407 13675 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.471585 10393 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:19.471575 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.485059 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.486923 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.486677 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.488296 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.458683 13792 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:19.495949 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.497138 10395 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:19.498993 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.501641 13661 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:19.503646 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.473620 13752 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:19.395159 13760 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.507074 13756 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:19.493044 13796 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 13:16:19.507251 13764 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:16:19.509105 13584 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.491008 10398 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.514744 13792 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:19.527238 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.401727 13684 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:16:19.403081 13787 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:19.529356 10213 leader_election.cc:336] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.809s (SENT)
I20260709 13:16:19.468976 13802 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.530401 10393 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:19.532038 10213 leader_election.cc:336] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.809s (SENT)
I20260709 13:16:19.532742 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:19.515286 13718 consensus_meta.cc:287] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.908s	user 0.011s	sys 0.000s
I20260709 13:16:19.536345 13718 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.477311 13642 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.505721 13652 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.540906 10396 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:19.543367 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 146470us
I20260709 13:16:19.565781 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:19.486976 13702 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.489814 13746 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.550951 10393 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:16:19.593556 13668 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.003s
I20260709 13:16:19.612540 13795 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.609652 13763 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:19.646567 13792 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:19.537590 13670 consensus_meta.cc:287] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.966s	user 0.011s	sys 0.001s
I20260709 13:16:19.648844 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.515671 13755 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.623056 13793 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.655052 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:19.655318 10362 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.197s (SENT)
I20260709 13:16:19.671288 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.579423 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:19.619910 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87900.5us
I20260709 13:16:19.505757 13752 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:19.663625 13672 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.088s	user 0.011s	sys 0.003s
I20260709 13:16:19.641175 13718 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:19.672755 10398 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.675132 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:19.672895 10213 leader_election.cc:336] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.824s (SENT)
I20260709 13:16:19.676409 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:19.677414 10213 leader_election.cc:336] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.915s (SENT)
I20260709 13:16:19.613513 13802 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.666571 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.683709 10393 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:19.678476 13786 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.684157 13662 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:19.684934 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.635890 13762 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.662576 13763 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:19.679628 13793 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:19.678290 10213 leader_election.cc:336] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.944s (SENT)
W20260709 13:16:19.687386 10213 leader_election.cc:336] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.944s (SENT)
I20260709 13:16:19.687923 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.689070 10390 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:19.689625 10390 pending_rounds.cc:85] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 3
I20260709 13:16:19.690084 10390 pending_rounds.cc:107] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:19.690424 10390 raft_consensus.cc:2889] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.559407 13760 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.694949 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.697379 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.702633 10393 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:19.663579 13702 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.707824 13814 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.708076 13470 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.701666 10398 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:16:19.706739 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51459.2us
I20260709 13:16:19.686529 13651 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.710327 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.709386 13702 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.689536 13763 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:19.711565 10213 leader_election.cc:336] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.946s (SENT)
I20260709 13:16:19.710830 13652 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:19.711418 10322 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:19.706763 13802 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.715794 13795 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.717368 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.708470 13814 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.718904 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.723332 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.729250 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:19.724639 13662 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:19.732023 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:19.733727 10213 leader_election.cc:336] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.946s (SENT)
I20260709 13:16:19.732197 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:19.735814 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:19.732553 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:19.737087 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:19.737784 10993 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:19.737577 10996 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
W20260709 13:16:19.739840 10213 leader_election.cc:336] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.957s (SENT)
W20260709 13:16:19.740464 10213 leader_election.cc:336] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.957s (SENT)
I20260709 13:16:19.720328 13763 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.720245 13787 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:19.740937 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.736526 13584 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:19.746275 10213 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.987s (SENT)
I20260709 13:16:19.738333 13793 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.736322 13665 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:19.750723 10996 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:19.751806 10213 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 2.041s (SENT)
I20260709 13:16:19.739090 13641 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.787592 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.742259 13659 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:19.792551 13814 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:19.793632 10213 leader_election.cc:336] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 2.112s (SENT)
I20260709 13:16:19.794749 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:19.794152 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:19.798725 13825 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:16:19.798734 13793 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.745234 13802 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.741113 13652 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:19.790378 13659 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.802491 10998 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:19.802212 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:19.807502 10993 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:19.814402 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.753902 13752 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.869560 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.817740 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.886716 10318 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.887039 10322 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:19.887743 10320 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:19.802500 13795 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.809494 13584 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:19.819024 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2269) took 1061 ms. Trace:
I20260709 13:16:19.814803 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.804031 13659 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.867729 13687 raft_consensus.cc:3055] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:19.898620 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 96903.3us
W20260709 13:16:19.901950 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.903563 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.900679 10325 rpcz_store.cc:276] 0709 13:16:18.758322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.758721 (+   399us) service_pool.cc:224] Handling call
0709 13:16:19.818768 (+1060047us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54002df354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:19.818943 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150307072}
W20260709 13:16:19.906472 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 91764.2us
W20260709 13:16:19.867513 13820 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:19.907224 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:19.910326 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.910800 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.911450 10322 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:19.914505 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:19.915148 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:19.920665 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.900354 13584 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:19.905658 13687 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:19.923957 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:19.945776 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.947470 10325 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.919716 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:19.909435 13641 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.947837 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:19.950491 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.955193 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.955339 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:19.917634 13802 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.961982 10322 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:19.922511 13760 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:19.925123 13777 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:19.917420 13779 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:19.918747 13662 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:19.974056 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:19.954644 13793 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:19.957720 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:19.965045 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.945153 13651 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.948426 13661 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.963714 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:19.917572 13652 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:16:19.996063 13652 consensus_queue.cc:1243] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:19.996783 13652 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:19.979292 13641 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:19.990994 13795 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.991086 13793 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.998612 13793 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.978503 13812 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:20.000759 13812 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.972848 13644 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.002516 13661 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.956517 13755 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:20.003638 13755 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.004191 13755 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.004703 13661 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.002529 13644 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.005714 13644 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.006160 13687 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.008610 13666 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:19.969869 13642 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:20.010427 13651 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:19.975349 13779 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.011617 13779 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.963029 13786 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:19.992092 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:19.995817 13756 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:19.969532 13668 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:19.986595 13584 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:19.988389 10320 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:19.964437 10318 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
W20260709 13:16:20.016712 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.048472 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56475.3us
I20260709 13:16:20.039189 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:20.049701 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:20.049762 10393 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:20.042126 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.024406 10325 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:20.052177 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:19.967995 13760 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.055569 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:20.025048 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1672) took 2561 ms. Trace:
W20260709 13:16:20.014521 13803 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.556s	user 0.004s	sys 0.000s
I20260709 13:16:20.057379 10399 rpcz_store.cc:276] 0709 13:16:17.454684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.455081 (+   397us) service_pool.cc:224] Handling call
0709 13:16:17.473122 (+ 18041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.451999 (+978877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.015296 (+1563297us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400102054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:20.015570 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115803392}
I20260709 13:16:20.059141 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:20.059914 10322 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:20.060564 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:20.061180 10318 raft_consensus.cc:2368] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8.
W20260709 13:16:20.063877 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.050801 13687 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.066243 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.066798 10322 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 13:16:19.992553 13802 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.068526 10322 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:20.069038 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:20.025583 13668 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:20.073617 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:20.071285 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 97256.7us
I20260709 13:16:20.014427 13786 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:20.014189 13756 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.071430 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:20.071218 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:20.058876 13760 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.075625 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:20.078118 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.062299 13642 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.070431 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:20.073086 10318 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:20.076678 10322 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:20.079455 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.084293 10993 raft_consensus.cc:2410] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:20.079594 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:20.054250 13652 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:20.076612 10325 raft_consensus.cc:2410] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:16:20.080996 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.081159 10320 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:20.063668 13672 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.065964 13746 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.074141 13668 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:20.098537 10393 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:20.073925 13584 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.073067 13651 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:20.090170 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.091181 10994 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:20.094358 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:20.085973 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:20.104738 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:20.075419 13691 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:20.106499 13691 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:20.070912 13763 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:16:20.109274 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.092743 10395 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:20.092319 10320 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:20.090576 10325 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:16:20.094745 13756 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:20.091434 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:20.075762 13786 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:20.102685 10392 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:20.101522 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.095714 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.082959 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:20.138538 10993 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:20.138652 10399 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:20.105258 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:20.100790 13795 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.114836 13652 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.116297 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.118085 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:20.118736 13691 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.121286 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:20.142927 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:20.088375 13792 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:20.076252 13802 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.155112 10320 pending_rounds.cc:85] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 7
I20260709 13:16:20.163391 10320 pending_rounds.cc:107] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:16:20.163529 10325 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:20.163848 10320 raft_consensus.cc:2889] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:20.157975 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:20.111454 13675 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:20.101495 13812 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.109310 13672 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:20.126178 13642 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.168861 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:20.130668 13756 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.165194 13751 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:20.240407 10325 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:20.157053 10999 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.092778 13644 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:20.155536 13803 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:20.166642 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:20.257033 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 90487.5us
I20260709 13:16:20.154258 13792 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.154385 13657 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:20.229549 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.230048 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 61294.3us
I20260709 13:16:20.236121 13786 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.245048 13833 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:20.174731 13723 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.261762 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:20.261008 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 148497us
I20260709 13:16:20.197171 13672 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.195915 13787 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.148948 13795 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.259990 13669 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:20.265480 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.270586 10320 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:20.246121 13756 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:20.280481 10391 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:20.254918 13652 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.281359 13786 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:20.269192 13642 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.261119 13657 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.260994 13792 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.168193 13668 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.302302 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2272) took 1080 ms. Trace:
I20260709 13:16:20.315533 10321 rpcz_store.cc:276] 0709 13:16:19.221954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.222349 (+   395us) service_pool.cc:224] Handling call
0709 13:16:20.302073 (+1079724us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b54002dee54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:20.302218 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55022464}
I20260709 13:16:20.302811 13739 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:20.310083 13657 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:20.320007 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.294839 13669 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.293416 13762 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.298884 13833 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:20.293237 13839 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.332237 10321 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:20.296443 13746 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.295219 13787 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.317663 13739 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:20.309827 13718 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:20.327648 13669 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.311744 13642 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:20.355207 13835 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.124s	user 0.000s	sys 0.005s
I20260709 13:16:20.352350 13381 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.404162 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:20.405891 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:20.339763 13839 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.413964 10321 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:20.415864 10248 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:20.358469 13838 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.342373 13684 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:16:20.428223 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:20.395543 13668 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.432482 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:20.430725 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.435221 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.437145 10246 raft_consensus.cc:2410] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:20.344797 13833 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.468703 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:20.420239 13381 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.469444 10242 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:20.471094 13381 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.472146 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:20.472913 10241 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:20.475358 13831 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:20.478677 10242 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:20.480043 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:20.480690 10242 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:20.483268 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.485978 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.520421 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.529876 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.415904 13751 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:20.416421 13839 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.541854 10245 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:20.358265 13746 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.542472 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:20.551286 10250 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:20.543511 10399 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:20.546520 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.556427 10997 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:20.558872 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:20.561431 10244 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 4.
I20260709 13:16:20.563076 10245 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:20.565923 10241 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:20.561074 13644 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.547542 13843 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.554853 13699 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:20.548225 13802 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.428722 13838 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:20.582207 13793 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:16:20.610344 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 560) took 1963 ms. Trace:
I20260709 13:16:20.610809 10316 rpcz_store.cc:276] 0709 13:16:18.628152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.637929 (+  9777us) service_pool.cc:224] Handling call
0709 13:16:18.638304 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.856434 (+218130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.591385 (+1734951us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002a9754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:20.591593 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499380992}
I20260709 13:16:20.581589 13853 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.633351 10290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.546s (SENT) [suppressed 35 similar messages]
I20260709 13:16:20.640060 10316 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:20.611778 13802 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.631495 13853 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.661550 13751 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:20.641091 13659 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.004s
I20260709 13:16:20.662688 13659 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.615751 13795 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:20.615061 13847 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:20.681732 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.589978 13843 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.590998 13699 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.615710 13793 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.688647 13850 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.697170 13795 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:20.692456 13833 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:20.720929 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 162184us
W20260709 13:16:20.722097 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.749728 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.678397 13802 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.690557 13847 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.727459 13642 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:20.766947 10242 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:20.736578 13795 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.778501 13662 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.779279 13853 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.779163 13662 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.735139 13659 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.784559 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1695) took 1323 ms. Trace:
I20260709 13:16:20.785009 13802 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.784965 10390 rpcz_store.cc:276] 0709 13:16:19.460732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.466215 (+  5483us) service_pool.cc:224] Handling call
0709 13:16:19.486572 (+ 20357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.691241 (+204669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.784266 (+1093025us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54002dda54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:20.784465 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459358976}
I20260709 13:16:20.788916 13844 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:20.788753 13657 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.789438 13844 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:20.790413 13746 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:20.771420 13852 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:20.783974 13847 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:20.784364 13662 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:20.789546 13684 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.792922 10318 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:20.793459 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 658) took 1053 ms. Trace:
I20260709 13:16:20.782445 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.849445 10997 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:16:20.792438 13755 consensus_meta.cc:287] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.000s
I20260709 13:16:20.850991 13755 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:20.852037 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.857879 13677 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.858480 13677 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:20.859431 13677 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.860764 13677 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.868311 13470 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:20.853760 13755 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:20.871614 13684 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.876341 13771 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:20.885533 10319 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
W20260709 13:16:20.886794 13856 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:16:20.891088 11001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 803) took 2257 ms (client timeout 2041 ms). Trace:
I20260709 13:16:20.891928 13791 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:20.892608 10320 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:20.778577 13795 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.848882 10393 rpcz_store.cc:276] 0709 13:16:19.740135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.102501 (+362366us) service_pool.cc:224] Handling call
0709 13:16:20.145655 (+ 43154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.152512 (+  6857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.152560 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.153027 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.616543 (+463516us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:20.616587 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.616673 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.793227 (+176554us) raft_consensus.cc:1685] finished
0709 13:16:20.793248 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.793399 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6457,"raft.queue_time_us":6579,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12583,"thread_start_us":386929,"threads_started":1,"wal-append.queue_time_us":562267}
W20260709 13:16:20.905205 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.905428 10324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2205) took 2247 ms (client timeout 1957 ms). Trace:
I20260709 13:16:20.918709 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:20.922205 10323 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:20.925786 10319 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:20.927521 10321 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:20.924085 11001 rpcz_store.cc:269] 0709 13:16:18.633383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.633486 (+   103us) service_pool.cc:224] Handling call
0709 13:16:20.890849 (+2257363us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54005d2fd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:20.890972 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358889344}
I20260709 13:16:20.926268 13755 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.935252 13787 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:20.937541 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:20.905053 13659 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.734701 13850 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:20.840224 13864 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:20.779165 13838 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:20.968212 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 806) took 1231 ms. Trace:
W20260709 13:16:20.945452 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.948796 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:20.951565 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:20.954130 10324 rpcz_store.cc:269] 0709 13:16:18.658133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.688808 (+ 30675us) service_pool.cc:224] Handling call
0709 13:16:20.905156 (+2216348us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b5400114c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:20.905322 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125615360}
I20260709 13:16:20.963075 10320 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:20.973558 11002 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:20.971451 10399 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:20.906987 13651 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.968689 10998 rpcz_store.cc:276] 0709 13:16:19.731859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.731978 (+   119us) service_pool.cc:224] Handling call
0709 13:16:20.962695 (+1230717us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b54001b76d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:20.962850 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150572800}
W20260709 13:16:20.970893 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66241.7us
W20260709 13:16:20.985746 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.990057 10393 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:20.991308 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:20.993851 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:20.995760 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:20.997016 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:20.964705 13777 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.988s	user 0.013s	sys 0.000s
I20260709 13:16:20.910764 13771 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:20.997032 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:20.997766 10399 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:21.005685 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:21.033281 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.043762 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:21.045887 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:21.049677 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 571) took 1141 ms. Trace:
I20260709 13:16:21.049599 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.050565 10244 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:21.050266 10316 rpcz_store.cc:276] 0709 13:16:19.908720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.661463 (+752743us) service_pool.cc:224] Handling call
0709 13:16:20.661770 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.662288 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:20.663331 (+  1043us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.049304 (+385973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.049363 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:21.049411 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.049494 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.049623 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24050,"prepare.queue_time_us":870,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"thread_start_us":343484,"threads_started":1}
I20260709 13:16:20.979570 13698 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:21.056097 11002 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:21.057723 10396 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:21.061034 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2139) took 1588 ms. Trace:
W20260709 13:16:21.065507 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.061455 10396 rpcz_store.cc:276] 0709 13:16:19.472299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.696834 (+224535us) service_pool.cc:224] Handling call
0709 13:16:19.707952 (+ 11118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.057566 (+1349614us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b54001dd6a0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5fdc0 00007f58c3aea1c0 00007f58c3aeb231 00007f58c3ae7d8f 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c
0709 13:16:21.060701 (+  3135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.060962 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7550336}
I20260709 13:16:21.071146 13771 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.072741 13771 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:21.036299 13760 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.000s
I20260709 13:16:21.031822 13675 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.055599 13792 consensus_meta.cc:287] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.002s
W20260709 13:16:21.055374 13652 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.757s	user 0.004s	sys 0.007s
I20260709 13:16:21.050789 13644 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.131489 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:21.114101 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:21.133535 10994 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:21.117184 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.066555 13687 consensus_meta.cc:287] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.995s	user 0.008s	sys 0.004s
I20260709 13:16:21.032025 13381 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.997999 13659 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.082005 13777 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:21.112274 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:21.064378 13698 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.907171 13844 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.979173 13755 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:20.991415 13864 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.004664 13651 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:21.239799 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 79118.3us
I20260709 13:16:21.184594 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:21.248407 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.253891 10393 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:21.260165 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:21.261209 10247 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:21.262830 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.263669 10247 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:21.264803 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:21.267319 10247 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:21.244375 13779 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.232s	user 0.010s	sys 0.003s
I20260709 13:16:21.275516 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.272552 10324 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.111227 13657 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.280656 10319 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:21.282011 10243 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:21.239720 13470 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.224212 13762 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.184973 13498 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.252718 13777 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.291141 10994 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:21.253458 13698 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.128211 13792 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:21.307871 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.322924 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:21.249495 13862 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.275803 13839 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.001s
I20260709 13:16:21.224522 13838 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:21.111565 13760 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.224517 13733 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.240018 13644 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.312464 10247 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:21.326056 10243 raft_consensus.cc:2368] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8.
I20260709 13:16:21.249080 13666 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:16:21.378825 13733 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.379799 13731 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.253703 13381 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.160013 13675 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.341476 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:21.329749 10396 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:21.342612 10398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1703) took 1688 ms (client timeout 1670 ms). Trace:
I20260709 13:16:21.345989 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 660) took 1250 ms. Trace:
I20260709 13:16:21.348784 13651 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:21.299849 13779 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:21.350255 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.384795 10398 rpcz_store.cc:269] 0709 13:16:19.641780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.648554 (+  6774us) service_pool.cc:224] Handling call
0709 13:16:21.329985 (+1681431us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b54000109d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:21.330094 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14660992}
W20260709 13:16:21.351428 13669 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.936s	user 0.007s	sys 0.004s
W20260709 13:16:21.389263 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47876us
I20260709 13:16:21.321673 13498 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.322707 13777 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:21.358021 10290 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.052s	sys 0.073s
I20260709 13:16:21.315833 13470 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.402269 13779 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.403786 13381 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:21.405086 13854 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:16:21.405710 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2413) took 2586 ms. Trace:
I20260709 13:16:21.320942 13762 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.385623 10391 rpcz_store.cc:276] 0709 13:16:20.095675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.154694 (+ 59019us) service_pool.cc:224] Handling call
0709 13:16:20.154925 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.294129 (+139204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.345707 (+1051578us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002dc154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:21.345916 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275146624}
I20260709 13:16:21.391921 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2134) took 1925 ms. Trace:
I20260709 13:16:21.411590 10395 rpcz_store.cc:276] 0709 13:16:19.466871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.503743 (+ 36872us) service_pool.cc:224] Handling call
0709 13:16:19.504326 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.110192 (+605866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.391608 (+1281416us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400032854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:21.391837 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352741632}
I20260709 13:16:21.397264 13498 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:21.394969 10290 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.052s	sys 0.073s
W20260709 13:16:21.413160 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 779798us
I20260709 13:16:21.359815 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.405777 13644 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:21.406286 10249 rpcz_store.cc:276] 0709 13:16:18.819573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.819772 (+   199us) service_pool.cc:224] Handling call
0709 13:16:18.850984 (+ 31212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.851251 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:19.144045 (+292794us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.405252 (+2261207us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b18003c4c60. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287
0709 13:16:21.405349 (+    97us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.405399 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:21.405451 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.405539 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.405651 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37180,"prepare.queue_time_us":452503,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":33558,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":10948,"spinlock_wait_cycles":20812672,"thread_start_us":352873,"threads_started":2}
I20260709 13:16:21.418792 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.419740 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:21.341213 13786 consensus_meta.cc:287] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.035s	user 0.003s	sys 0.009s
W20260709 13:16:21.417101 10246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.029s	sys 0.071s
I20260709 13:16:21.359053 13684 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:21.421518 10246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.029s	sys 0.071s
I20260709 13:16:21.422485 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:21.423418 10397 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:21.340837 13862 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.393985 13651 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:21.430182 13666 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:21.406466 13833 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:21.433236 13558 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:21.433589 13833 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.434952 13864 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.435247 13762 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.436188 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.437587 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:21.421142 13863 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:16:21.411010 13850 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.360674 13838 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.328123 13843 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.394131 13662 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:16:21.445204 10249 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:21.449113 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:21.456475 10250 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:21.446846 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.458568 10243 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 12 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:16:21.452936 10966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.012s	sys 0.030s
W20260709 13:16:21.459224 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.459482 10966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.012s	sys 0.030s
I20260709 13:16:21.433274 13677 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:21.463856 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:21.467537 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:16:21.443075 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.370278 13839 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.466143 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 570) took 1725 ms. Trace:
I20260709 13:16:21.474375 10321 rpcz_store.cc:276] 0709 13:16:19.740405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.415533 (+675128us) service_pool.cc:224] Handling call
0709 13:16:20.419679 (+  4146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.955290 (+535611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.465821 (+510531us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54001883d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:21.466076 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167035264}
I20260709 13:16:21.394554 13669 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.437059 13651 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:21.442520 13834 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.050s	sys 0.079s
W20260709 13:16:21.463689 13584 consensus_meta.cc:287] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.346s	user 0.012s	sys 0.002s
I20260709 13:16:21.450676 13760 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.492583 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.493726 10243 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:16:21.494102 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.494616 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.494957 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.484033 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.495690 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.496150 10249 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:21.472821 13866 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.466758 13677 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.474965 13762 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:21.482725 13834 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.051s	sys 0.079s
I20260709 13:16:21.515339 10321 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:21.477595 13558 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.475279 13850 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:21.531181 10250 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
W20260709 13:16:21.589564 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.476493 13684 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:21.488983 13787 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.531049 13866 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.595778 13787 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.479540 13651 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:21.600028 13866 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.520927 13659 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:21.516361 13733 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.477721 13870 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.531493 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:21.480513 13665 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.552042 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:21.492172 13843 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.602842 10249 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.602303 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.607883 10250 raft_consensus.cc:2410] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:16:21.609706 13795 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.000s
I20260709 13:16:21.609534 13786 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.603086 13665 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.610819 13786 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:21.613412 13756 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.305s	user 0.004s	sys 0.005s
I20260709 13:16:21.615898 10249 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:21.619318 13786 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.620862 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.621007 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:21.603327 10243 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:21.623831 13669 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.624519 13669 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:21.624996 13669 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:21.495684 13731 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.494769 13779 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.635093 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:21.639336 10249 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:21.581517 13672 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.288s	user 0.012s	sys 0.001s
I20260709 13:16:21.613870 13756 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.576061 13838 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.626107 13762 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:21.625860 13726 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.041s	sys 0.082s
I20260709 13:16:21.574453 13865 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:21.582475 13864 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:21.593691 13558 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:21.641954 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.602771 13870 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.634474 13733 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.633157 13786 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.621743 13698 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.637039 13873 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.632568 13795 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:21.703545 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.567718 13666 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.660815 10248 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:21.528602 13677 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.666704 10243 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:21.637455 13792 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:21.634636 13684 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.603574 13843 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.708274 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.639851 13731 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.659192 13558 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.655033 13755 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:21.722472 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.708876 13665 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:21.710978 10362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.033s	sys 0.031s
I20260709 13:16:21.640148 13779 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.713163 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.726832 10243 raft_consensus.cc:2410] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:21.727142 10364 leader_election.cc:400] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8.
I20260709 13:16:21.658589 13864 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.715391 10242 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:21.649273 13672 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.716761 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.732920 10250 raft_consensus.cc:2410] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:21.657852 13865 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:21.723433 10362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.033s	sys 0.031s
I20260709 13:16:21.748476 10325 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:21.751442 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:21.722718 13862 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.753779 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:21.727483 10364 leader_election.cc:403] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.727840 10249 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:21.729487 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:21.752868 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:21.711206 13771 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.003s
I20260709 13:16:21.700400 13733 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.757310 10324 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:21.700923 13786 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.734566 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:21.734822 13872 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:16:21.738359 13868 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:16:21.738759 13689 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:21.740489 13843 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.743270 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1578) took 1318 ms. Trace:
I20260709 13:16:21.743470 13684 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.744247 10390 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:21.745324 13672 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.769371 10248 rpcz_store.cc:276] 0709 13:16:20.424572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.424718 (+   146us) service_pool.cc:224] Handling call
0709 13:16:20.425075 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.704601 (+1279526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.742925 (+ 38324us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540006ccd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:21.743182 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2841329024}
I20260709 13:16:21.777146 13672 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8.
I20260709 13:16:21.777221 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.777715 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.756780 10317 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:21.778543 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.769064 13689 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:21.779426 10250 raft_consensus.cc:2410] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:21.768671 13691 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.780149 13691 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.781534 13756 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.782140 13691 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.770536 11002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:21.783241 11002 raft_consensus.cc:606] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:21.783578 11002 raft_consensus.cc:614] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:21.784260 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1584) took 1309 ms. Trace:
I20260709 13:16:21.784544 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:21.785146 10317 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:21.757980 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.786182 10248 raft_consensus.cc:2410] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:21.711683 13666 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.708374 13873 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.762558 13665 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.774559 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.780521 10250 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:21.716895 13695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.005s	sys 0.035s
I20260709 13:16:21.760784 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:21.747323 13870 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:21.771762 10996 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:21.714576 13669 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.788503 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:21.815589 10244 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:21.762514 13839 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:21.776327 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49347.3us
I20260709 13:16:21.788980 10249 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:21.787652 10248 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.756182 13659 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.784623 10246 rpcz_store.cc:276] 0709 13:16:20.475059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.488072 (+ 13013us) service_pool.cc:224] Handling call
0709 13:16:20.488502 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.669583 (+181081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.669611 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.670096 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.424499 (+754403us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:21.424538 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.424607 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.784032 (+359425us) raft_consensus.cc:1685] finished
0709 13:16:21.784056 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.784202 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58905,"raft.queue_time_us":200303,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":16369,"thread_start_us":826691,"threads_started":2,"wal-append.queue_time_us":825921}
I20260709 13:16:21.786105 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.816588 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:21.961918 10324 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.787859 10993 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:21.815595 10999 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:21.962782 10317 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:21.817580 10243 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:21.766065 13792 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.769384 13662 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:16:21.921147 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.946784 10362 leader_election.cc:400] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8.
W20260709 13:16:21.944223 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.758847 13584 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:16:21.813817 13695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.005s	sys 0.036s
I20260709 13:16:21.949120 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.952198 10250 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:21.725584 13762 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:21.951954 13862 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.952818 13756 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.958465 13883 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:21.960501 13755 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:21.967233 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.966624 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.971084 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.072817 10319 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:16:22.073169 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 102218us
I20260709 13:16:21.949756 13718 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.814527 13665 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:21.986992 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:21.963761 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.944911 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.990170 13672 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.990675 13695 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.992465 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.085280 10321 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:21.999164 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 657) took 2311 ms. Trace:
I20260709 13:16:21.999524 13791 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:22.000082 13691 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:22.000211 13839 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:22.000654 13684 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:22.098981 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:21.968901 13659 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.011231 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 662) took 1676 ms. Trace:
I20260709 13:16:22.014285 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.104373 10390 rpcz_store.cc:276] 0709 13:16:20.334954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.786126 (+451172us) service_pool.cc:224] Handling call
0709 13:16:20.793022 (+  6896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.775508 (+982486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.010891 (+235383us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540021b954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:22.011147 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187154816}
I20260709 13:16:22.105190 10247 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:22.106105 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:22.106660 10247 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.021724 13844 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.023401 13699 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:22.027771 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.029670 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 562) took 2367 ms. Trace:
I20260709 13:16:22.129112 10318 rpcz_store.cc:276] 0709 13:16:19.661843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.144078 (+482235us) service_pool.cc:224] Handling call
0709 13:16:20.167323 (+ 23245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.848908 (+681585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.029328 (+1180420us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400113d54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:22.029588 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438231296}
I20260709 13:16:22.032433 13793 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.037086 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.131443 10249 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:22.038997 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:22.131819 10247 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:22.132179 10325 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.042598 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2148) took 1049 ms. Trace:
I20260709 13:16:22.044611 13739 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.049324 13470 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:21.965103 13866 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.059537 10290 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:21.965777 10246 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.968652 13843 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.075687 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:22.134542 10393 rpcz_store.cc:276] 0709 13:16:20.993286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.256253 (+262967us) service_pool.cc:224] Handling call
0709 13:16:21.283055 (+ 26802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.393876 (+110821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.393905 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.398032 (+  4127us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.710208 (+312176us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:21.710284 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.042003 (+331719us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001347d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:22.042072 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.042139 (+    67us) raft_consensus.cc:1685] finished
0709 13:16:22.042159 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.042514 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551,"raft.queue_time_us":3196,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":252504448,"thread_start_us":311719,"threads_started":1,"wal-append.queue_time_us":357003}
W20260709 13:16:22.143419 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 67800.2us
I20260709 13:16:22.078779 10316 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.088765 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:22.144614 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 55947.6us
I20260709 13:16:22.082482 13698 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.145434 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:22.086395 10397 rpcz_store.cc:276] 0709 13:16:19.687955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.097885 (+409930us) service_pool.cc:224] Handling call
0709 13:16:20.099986 (+  2101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.423964 (+1323978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.998889 (+574925us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002fe754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:21.999083 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043178368}
I20260709 13:16:22.150856 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2275) took 2926 ms. Trace:
I20260709 13:16:22.151298 10323 rpcz_store.cc:276] 0709 13:16:19.224579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.224704 (+   125us) service_pool.cc:224] Handling call
0709 13:16:20.906349 (+1681645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.954622 (+ 48273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.150647 (+1196025us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400114c50. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:22.150789 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3866613504}
I20260709 13:16:22.152418 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.066150  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:22.002941 13870 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:22.104704 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.971757 13792 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.164173 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.157218 10967 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:22.070552 13662 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.079154 13726 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.077502 13787 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.088184 13875 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.079416 13864 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.080229 13498 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.155498 13666 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.160732 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.092854 13795 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.163349 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.092396 13695 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.080783 13883 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.174964 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.101020 13760 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.058866 13756 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.163213 13771 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:16:22.100725 13812 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.163502 13843 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.193730 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.259517 10995 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:22.195674 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:22.196058 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.261439 10242 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:22.070926 13862 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.208227 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.208971 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:22.266472 10996 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.078370 13718 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.080935 13755 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.093223 13672 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.218914 13867 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.208667 13851 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:16:22.181219 13699 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:22.172863 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.291498 11001 raft_consensus.cc:2410] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:22.190637 13739 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.189248 13846 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.184600 13470 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:22.259153 13733 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:22.238497 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.191087 13793 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.173720 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.305500 10998 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
W20260709 13:16:22.306036 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 304653us
W20260709 13:16:22.187105 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 127656us
I20260709 13:16:22.211001 13865 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.203927 13698 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:22.214350 13702 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:22.163617 13866 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.192368 10246 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:22.258255 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:22.320240 10319 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.243952 13833 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.241997 13666 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:22.283852 10316 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:22.336519 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.246637 13731 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.093684 13651 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:22.257987 13877 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.470s	user 0.001s	sys 0.000s
I20260709 13:16:22.200016 13662 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.204643 13726 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.362195 10399 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:22.251384 13786 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.294009 10250 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:16:22.153646 10325 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:22.363687 10250 pending_rounds.cc:85] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:16:22.363974 10250 pending_rounds.cc:107] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:22.364209 10250 raft_consensus.cc:2889] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.231855 13498 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.302111 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:22.197099 13779 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:22.309219 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.309994 10323 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.311926 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.369108 10242 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:22.369277 10399 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:22.311519 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:22.303071 13881 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 13:16:22.318528 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.376890 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:22.220551 13875 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.322531 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.377894 10398 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:22.324854 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:22.326054 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 246041us
I20260709 13:16:22.379161 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.275521 13812 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.301661 13873 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.302655 13699 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:22.339751 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:22.380537 13873 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:22.381456 13873 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:22.381090 13699 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.381858 13873 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:22.382814 13873 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.315775 13846 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:22.345086 10324 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:22.334411 13665 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.385989 10246 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:22.354693 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2431) took 1027 ms. Trace:
I20260709 13:16:22.293495 13867 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.357309 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.393460 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.394016 10392 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:22.341909 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.358392 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:22.365221 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 63240.4us
I20260709 13:16:22.396721 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:22.336840 13684 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:16:22.370837 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 61707.9us
I20260709 13:16:22.365401 13850 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.404111 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.372781 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.373191 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.376689 13870 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.374905 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:22.411571 10396 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.315277 13793 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:22.351989 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.419509 10395 raft_consensus.cc:2410] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:22.322626 13733 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:22.394361 11002 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
W20260709 13:16:22.370064 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58629.6us
I20260709 13:16:22.423094 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:22.397909 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:22.366204 13790 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:16:22.372491 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:22.390213 10244 rpcz_store.cc:276] 0709 13:16:21.327678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.936294 (+608616us) service_pool.cc:224] Handling call
0709 13:16:21.939200 (+  2906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.939398 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:22.082082 (+142684us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.354358 (+272276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.354408 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:22.354454 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.354520 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.354637 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12147,"prepare.queue_time_us":350555,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1739,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8200,"thread_start_us":414292,"threads_started":2,"wal-append.queue_time_us":322932}
I20260709 13:16:22.427886 10998 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.352368 13691 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:16:22.388713 13884 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:16:22.367441 13791 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:16:22.405571 10242 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:16:22.435622 10242 pending_rounds.cc:85] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:22.373905 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:22.435961 10242 pending_rounds.cc:107] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:22.406895 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:22.404443 13851 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:22.340255 13666 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.328644 13698 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.386804 13751 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:22.445981 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:22.415091 10323 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:22.388549 13760 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.455389 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 749) took 1450 ms. Trace:
I20260709 13:16:22.455757 10249 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:22.387418 13895 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:22.402794 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:22.426913 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.384843 13846 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.389200 13659 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:22.430387 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:22.405532 10995 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:22.411238 13885 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:16:22.386696 13873 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.422356 13641 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:22.487394 10395 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:22.436291 10242 raft_consensus.cc:2889] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.438150 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:22.490015 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51930.9us
I20260709 13:16:22.491387 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.376281 13731 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.410787 13833 raft_consensus.cc:2764] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:22.442029 10993 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:22.429286 13887 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:16:22.449923 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1700) took 2987 ms. Trace:
I20260709 13:16:22.450379 13698 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.450757 13751 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.472054 13695 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.481818 13851 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.514645 13851 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.515122 13851 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.515337 13718 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.517002 10395 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:22.456590 10390 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:22.518934 13684 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:22.519480 13684 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.519958 13666 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.521512 13684 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.499048 13795 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:22.513551 13833 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:22.523878 13677 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.001s
I20260709 13:16:22.523664 13833 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.524333 13677 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.428566 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.455837 10245 rpcz_store.cc:276] 0709 13:16:21.004876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.005009 (+   133us) service_pool.cc:224] Handling call
0709 13:16:21.005336 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.006073 (+   737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.006103 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.031171 (+ 25068us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.482376 (+451205us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:21.483234 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.483344 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.455153 (+971809us) raft_consensus.cc:1685] finished
0709 13:16:22.455173 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.455322 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26020,"raft.queue_time_us":1145,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":31280,"thread_start_us":322368,"threads_started":1,"wal-append.queue_time_us":611205}
I20260709 13:16:22.429647 13792 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:22.472446 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 756) took 1135 ms. Trace:
I20260709 13:16:22.527925 10248 rpcz_store.cc:276] 0709 13:16:21.336983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.967772 (+630789us) service_pool.cc:224] Handling call
0709 13:16:21.968060 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.968263 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:22.354120 (+385857us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.472070 (+117950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.472125 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:22.472176 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.472244 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.472382 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336,"prepare.queue_time_us":333662,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":220,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12658,"thread_start_us":487131,"threads_started":2}
W20260709 13:16:22.472580 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 74748.9us
I20260709 13:16:22.475085 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.410709 13584 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:22.432087 13862 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.479679 10998 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:22.434995 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:22.543953 11002 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.491583 13895 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:22.443847 13898 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.498659 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1593) took 1011 ms. Trace:
I20260709 13:16:22.455598 13756 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.499222 10394 rpcz_store.cc:276] 0709 13:16:19.462228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.716735 (+2254507us) service_pool.cc:224] Handling call
0709 13:16:21.717049 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.717405 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.717438 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.721122 (+  3684us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.238554 (+517432us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:22.238616 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.238717 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.449713 (+210996us) raft_consensus.cc:1685] finished
0709 13:16:22.449735 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.449865 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":944,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7701,"thread_start_us":473105,"threads_started":1,"wal-append.queue_time_us":619624}
I20260709 13:16:22.422290 13870 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.451936 13662 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.453330 13812 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:22.510526 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 107796us
I20260709 13:16:22.446985 13865 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:16:22.533814 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.505880 13672 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:22.537194 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:22.538556 13883 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.539731 13755 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.542061 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.502578 13864 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.494921 10396 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:22.477581 13848 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:16:22.563568 13861 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:16:22.476784 13892 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:16:22.564028 13651 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:22.512197 13751 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:22.565604 13666 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:22.567382 13777 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.149s	user 0.011s	sys 0.002s
I20260709 13:16:22.568050 13793 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.568742 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:22.574756 13837 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:16:22.574891 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.575551 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.575779 13698 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:22.576370 10144 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 7 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 8 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:22.577452  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:22.496176 13659 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
W20260709 13:16:22.788630 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 260279us
I20260709 13:16:22.812686 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1595) took 1324 ms. Trace:
I20260709 13:16:22.806634 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1590) took 1320 ms. Trace:
I20260709 13:16:22.586998 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.611922 10996 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:22.855175 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.857916 10321 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:22.857982 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:22.804530 10249 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:22.860065 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1599) took 1344 ms. Trace:
I20260709 13:16:22.860438 10249 rpcz_store.cc:276] 0709 13:16:21.515908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.803595 (+1287687us) service_pool.cc:224] Handling call
0709 13:16:22.804218 (+   623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.859793 (+ 55575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.860012 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.860914 10242 rpcz_store.cc:276] 0709 13:16:21.487579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.404969 (+917390us) service_pool.cc:224] Handling call
0709 13:16:22.405250 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.498376 (+ 93126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.498590 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.855362 10246 rpcz_store.cc:276] 0709 13:16:21.488139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.797108 (+1308969us) service_pool.cc:224] Handling call
0709 13:16:22.797527 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.797941 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.797978 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.798037 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:22.798085 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.798160 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.812597 (+ 14437us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3667,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107}
W20260709 13:16:22.854969 10319 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.011s
I20260709 13:16:22.863834 10319 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:22.864437 10325 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:22.862113 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2435) took 1133 ms. Trace:
I20260709 13:16:22.865272 10249 rpcz_store.cc:276] 0709 13:16:21.728844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.861303 (+1132459us) service_pool.cc:224] Handling call
0709 13:16:22.861620 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.861790 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.861814 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.861874 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:22.861905 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.861959 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.862064 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.866631 10316 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:22.867929 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.587383 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.869073 10399 raft_consensus.cc:2410] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:22.584738 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:22.869823 10398 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:22.582459 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:22.866036 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.882695 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:22.882815 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:22.884181 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.855509 10243 rpcz_store.cc:276] 0709 13:16:21.486728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.968358 (+481630us) service_pool.cc:224] Handling call
0709 13:16:22.039710 (+ 71352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.039981 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:22.281634 (+241653us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.363464 (+ 81830us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.363515 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:22.363569 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.363630 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.806385 (+442755us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b54003b3dd0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:22.806562 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11541,"prepare.queue_time_us":268506,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1962,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":19954,"spinlock_wait_cycles":125154048,"thread_start_us":322627,"threads_started":2,"wal-append.queue_time_us":208628}
W20260709 13:16:22.942170 10393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.022s
W20260709 13:16:22.942682 10393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.023s
I20260709 13:16:22.892894 10317 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:22.810336 13558 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.079s	user 0.009s	sys 0.003s
I20260709 13:16:22.953681 10249 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:16:22.890524 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 356824us
I20260709 13:16:22.891786 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:22.565637 13896 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:16:22.947363 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:22.958245 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:22.960137 10246 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:22.960505 10396 raft_consensus.cc:2376] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8. Re-sending same reply.
W20260709 13:16:22.959036 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 67343us
I20260709 13:16:22.527976 13695 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:22.801240 13878 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.815s	user 0.001s	sys 0.001s
I20260709 13:16:22.963289 10364 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:22.716336 13844 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 13:16:22.788666 13833 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.795455 13867 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.788470 13866 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.971161 10999 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:22.784515 13763 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.973094 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:22.973927 10396 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.638494 13498 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.773427 13906 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:22.968732 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.638842 13862 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:22.969558 10362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.019s	sys 0.015s
I20260709 13:16:22.966353 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:22.990918 10362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.020s	sys 0.015s
I20260709 13:16:22.889683 13677 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:22.959443 13669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.036s	sys 0.076s
I20260709 13:16:22.955892 13793 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.974887 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:22.964478 13584 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:22.967064 13762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.024s
I20260709 13:16:22.978446 13699 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:22.979379 13874 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:22.979519 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:22.986997 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.016204 10319 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:22.987967 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 748) took 1997 ms. Trace:
I20260709 13:16:23.017086 10241 rpcz_store.cc:276] 0709 13:16:20.991070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.992949 (+  1879us) service_pool.cc:224] Handling call
0709 13:16:21.051159 (+ 58210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.051537 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.051564 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.095449 (+ 43885us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.722058 (+626609us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:21.722104 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.722169 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.800483 (+1078314us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:22.987637 (+187154us) raft_consensus.cc:1685] finished
0709 13:16:22.987662 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.987899 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21090,"raft.queue_time_us":103,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":24285,"spinlock_wait_cycles":168302464,"thread_start_us":463527,"threads_started":1,"wal-append.queue_time_us":710130}
I20260709 13:16:22.940881 13851 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.988539 13870 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:22.981307 13875 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:22.988693 13906 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.958135 13675 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:22.991257 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 578754us
I20260709 13:16:22.890707 13698 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.889271 13777 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.004212 11002 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:22.994793 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.015048 13867 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.968465 13755 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.976294 13662 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:22.986915 13903 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:16:23.020569 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:23.027109 13892 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.896000 13666 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:22.961915 13558 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:23.011569 13762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.025s
I20260709 13:16:23.025087 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.024753 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.050860 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:23.052510 10398 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:23.053125 10321 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:22.968266 13787 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.033164 13792 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:23.102176 10997 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:23.053483 10396 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:22.981104 13763 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.011922 13584 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.025086 13772 raft_consensus.cc:3055] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:23.026386 13795 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.054464 13897 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
W20260709 13:16:23.010382 13669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.036s	sys 0.078s
I20260709 13:16:23.035421 13843 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.119205 10324 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:23.119541 10244 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:23.099996 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49244.7us
W20260709 13:16:23.100360 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 75377.6us
W20260709 13:16:23.077484 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 57065.7us
I20260709 13:16:23.025010 13739 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:16:23.121022 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:23.120959 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.122875 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:23.011718 13862 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:23.105885 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 250779us
W20260709 13:16:23.127190 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.127529 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:23.103231 13760 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:16:23.114727 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.032958 13672 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:16:23.117287 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.127157 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:23.102293 13873 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.006s
I20260709 13:16:23.035069 13695 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:16:23.067127 13867 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.122589 13883 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:23.099916 13791 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.208072 10321 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:23.210819 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.212168 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.105330 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.213024 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.098872 13662 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.128762 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:16:23.219436 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 90744.4us
I20260709 13:16:23.220021 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 846) took 1472 ms. Trace:
I20260709 13:16:23.221161 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:23.109544 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2216) took 3860 ms. Trace:
I20260709 13:16:23.103026 13651 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:23.132166 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 125313us
I20260709 13:16:23.229326 10321 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:23.106033 13875 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:23.104403 13792 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.113490 13584 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.156702 13777 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.157086 13763 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.158630 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.159742 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.251933 10318 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:23.158689 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2440) took 1164 ms. Trace:
I20260709 13:16:23.252776 10246 rpcz_store.cc:276] 0709 13:16:21.994066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.863026 (+868960us) service_pool.cc:224] Handling call
0709 13:16:22.863317 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.960806 (+ 97489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.158424 (+197618us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b540006e0d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:23.158628 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213506944}
I20260709 13:16:23.253726 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:23.133039 13644 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:23.161533 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.254788 10319 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:23.129937 13911 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:23.031189 13895 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.163362 13698 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.163417 13906 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.165040 13666 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.165931 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.168856 13751 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.221676 13769 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:23.157109 13558 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.170527 13851 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.132596 13843 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.173293 13726 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.173928 13862 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.173858 10245 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:23.174860 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1591) took 1687 ms. Trace:
W20260709 13:16:23.181192 13904 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:23.131585 13760 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.271559 13812 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:23.069636 13755 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.184680 13834 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:23.185045 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:23.185539 13907 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:23.130867 13870 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:23.186038 13910 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:23.185938 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 580) took 1007 ms. Trace:
I20260709 13:16:23.329833 10392 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:23.329758 10323 rpcz_store.cc:276] 0709 13:16:22.178684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.195419 (+ 16735us) service_pool.cc:224] Handling call
0709 13:16:23.185767 (+990348us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b540020a654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:23.185882 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113294592}
I20260709 13:16:23.130038 13699 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.189640 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:23.191673 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.262269 13915 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:16:23.192684 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 857) took 1007 ms. Trace:
I20260709 13:16:23.334010 10999 rpcz_store.cc:276] 0709 13:16:22.185862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.185999 (+   137us) service_pool.cc:224] Handling call
0709 13:16:23.192498 (+1006499us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54005a8054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:23.192627 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622328576}
I20260709 13:16:23.194240 13899 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:23.195001 13893 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:23.195292 13866 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:23.196626 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.131682 13772 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:23.204704 13892 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.205853 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2297) took 1713 ms. Trace:
I20260709 13:16:23.344841 10325 rpcz_store.cc:276] 0709 13:16:21.492639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.364161 (+871522us) service_pool.cc:224] Handling call
0709 13:16:22.864286 (+500125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.864780 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.205649 (+340869us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400115150. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:23.205796 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149494016}
I20260709 13:16:23.346711 10325 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:23.201933 13864 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.212172 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.328263 13834 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:23.124179 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:23.214905 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.222540 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1594) took 1734 ms. Trace:
I20260709 13:16:23.222205 10322 rpcz_store.cc:276] 0709 13:16:19.250420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.098441 (+848021us) service_pool.cc:224] Handling call
0709 13:16:20.098773 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:20.099285 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.099307 (+    22us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:20.121200 (+ 21893us) log.cc:844] Serialized 52 byte log entry
0709 13:16:20.170920 (+ 49720us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:20.300359 (+129439us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.320993 (+ 20634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.321127 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.338297 (+2017170us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800083560. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:23.101911 (+763614us) raft_consensus.cc:1685] finished
0709 13:16:23.107074 (+  5163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.109457 (+  2383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61487,"prepare.queue_time_us":123449,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4135,"raft.queue_time_us":112144,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":15477,"spinlock_wait_cycles":6744832,"thread_start_us":122163,"threads_started":2,"wal-append.queue_time_us":175049}
I20260709 13:16:23.220445 10997 rpcz_store.cc:276] 0709 13:16:21.747218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.749367 (+  2149us) service_pool.cc:224] Handling call
0709 13:16:21.749656 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.102677 (+1353021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.219749 (+117072us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003cd054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:23.219960 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3103355648}
I20260709 13:16:23.233140 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.236477 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2300) took 1739 ms. Trace:
I20260709 13:16:23.253865 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.160964 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.256237 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:23.137097 13897 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.259656 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.260043 10396 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:23.259687 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:23.260983 10320 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:23.261889 10318 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:16:23.265712 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 138607us
I20260709 13:16:23.264349 10397 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
W20260709 13:16:23.274626 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.231775 13792 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.234651 13665 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:23.229491 13651 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:23.275221 10319 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: [6.9-7.10]
I20260709 13:16:23.266964 13762 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:16:23.257972 13795 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:23.283432 13662 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.259212 13644 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.260610 13865 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.287694 13867 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.263765 13689 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.291478 10317 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:23.292456 13751 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.289991 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1604) took 1634 ms. Trace:
I20260709 13:16:23.234287 13875 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:23.310704 10250 rpcz_store.cc:276] 0709 13:16:21.487012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.976609 (+489597us) service_pool.cc:224] Handling call
0709 13:16:22.067582 (+ 90973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.371242 (+303660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.174597 (+803355us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540006f4d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:23.174793 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519926144}
I20260709 13:16:23.295240 13883 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:23.192504 13718 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.343429 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.213847 10242 raft_consensus.cc:2410] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:23.300696 13769 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.391250 13665 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:23.390997 10244 rpcz_store.cc:276] 0709 13:16:21.487872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.537329 (+1049457us) service_pool.cc:224] Handling call
0709 13:16:22.537703 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.120129 (+582426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.222064 (+101935us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54002ebb54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:23.222454 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337464192}
I20260709 13:16:23.392318 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.392554 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.393270 13923 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.393658 13834 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.375098 13659 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:23.394878 13834 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:23.395269 13659 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:23.395946 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 136351us
I20260709 13:16:23.396260 13659 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.396951 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:23.397483 13659 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.397701 10249 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:16:23.332753 13862 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.399293 13862 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.399770 13769 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.401250 13862 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:23.401647 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 168593us
I20260709 13:16:23.402940 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.403082 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.403734 13843 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:23.404253 13843 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:23.404389 13875 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.404691 13843 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:23.337365 13760 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:16:23.406929 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.338984 13870 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:23.407565 10242 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 3.
I20260709 13:16:23.407990 13870 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.408476 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:23.409441 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 285315us
I20260709 13:16:23.348536 13892 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.411192 13892 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.410737 10324 rpcz_store.cc:276] 0709 13:16:21.496757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.384632 (+887875us) service_pool.cc:224] Handling call
0709 13:16:22.384927 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.119497 (+734570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.236108 (+116611us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54000cbf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:23.236359 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688277888}
I20260709 13:16:23.412021 10246 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:23.408653 13795 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.412966 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:23.413480 13883 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.413611 10246 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.413142 13795 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.414534 13689 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.373013 13772 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.415288 13772 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.378572 13771 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:23.416895 13771 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.417766 13771 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.418342 13865 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:23.418802 13865 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:23.418715 13726 consensus_queue.cc:1175] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 3 index: 6 } }
I20260709 13:16:23.393953 13921 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:23.371551 13755 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.349102 10243 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:23.403818 10248 rpcz_store.cc:276] 0709 13:16:21.655578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.855118 (+1199540us) service_pool.cc:224] Handling call
0709 13:16:22.855519 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.855954 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.855982 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.856453 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.115463 (+259010us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:23.115502 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.115568 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.289780 (+174212us) raft_consensus.cc:1685] finished
0709 13:16:23.289798 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.289931 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10608,"raft.queue_time_us":110,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":83624,"thread_start_us":144692,"threads_started":1,"wal-append.queue_time_us":329603}
I20260709 13:16:23.421679 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.421815 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.422317 10243 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:23.423177 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.423556 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.423920 10243 raft_consensus.cc:2410] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:23.392691 13651 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:23.424707 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:23.425457 10241 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:23.427418 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.428699 13699 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.428597 13883 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.392306 13665 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.429906 13883 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.430467 13665 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.431351 10967 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.428797 13684 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:23.432540 13846 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:23.432814 13684 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.432971 13846 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:23.433260 13684 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.433444 13846 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.403755 10250 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:23.436416 10391 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:23.423602 10364 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.350287 13763 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:23.437258 13763 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:23.437485 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.438179 13763 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.438706 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.439375 13763 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.441316 13726 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.441725 13726 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.442065 13726 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.442615 13921 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:23.443042 13921 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.443390 13921 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.445345 13644 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.446696 13771 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.447216 13897 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.424417 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:23.452463 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.423965 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:23.394896 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.466396 10392 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:23.466157 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.393312 10244 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:23.468200 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.406594 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:23.470026 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 71333.6us
I20260709 13:16:23.401746 13862 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:23.424710 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.337131 13893 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:23.493352 10248 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.508562 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:23.513334 10397 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.509920 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:23.513628 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 118823us
W20260709 13:16:23.506598 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46584.9us
W20260709 13:16:23.511009 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 104501us
I20260709 13:16:23.512250 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.493656 10391 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
W20260709 13:16:23.516903 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66095.2us
I20260709 13:16:23.517235 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.449760 13846 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.517858 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.518450 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.515138 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:23.522075 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:23.519285 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.454962 13718 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.490962 13558 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.533352 10242 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:23.374006 13584 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.541745 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.543650 10245 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:23.543895 10246 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:23.514942 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.545397 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:23.546576 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.490324 13755 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:23.493470 13897 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.546263 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.520584 13702 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:23.520246 13751 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:23.520998 13911 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.552918 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:23.536702 13844 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:23.573196 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.572808 10397 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:23.515694 13864 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:23.575343 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.532582 13698 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:23.532992 13644 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.561178 10242 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:23.578702 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.520438 13873 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:23.556229 10144 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.490835 13739 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:16:23.563971 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:23.564337 10316 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:23.532793 13659 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:23.558534 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.550767 13470 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.560864 13897 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.580374 10997 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:23.585634 10144 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.561702 13702 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:23.589525 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.547528 13755 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.543201 13912 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.591224 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:23.637447 10391 raft_consensus.cc:2410] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:23.550978 13498 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:23.592724 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:23.592844 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:23.576541 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.590538 10248 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:23.563051 13923 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:23.598948 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.603477 10999 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:23.589241 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.645426 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:23.578293 13675 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.646562 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.646939 13675 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.647511 13675 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:23.623080 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.601512 10144 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 4 to 8, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 8 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:23.650668 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.652073 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.571115 13812 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:23.652781 10995 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:23.652881 13812 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.653774 10248 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:23.654564 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.547789 13793 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:16:23.633596 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.553232 13851 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:23.541253 13762 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:16:23.583343 13641 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:23.658187 13641 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.587064 13873 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.583491 13698 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:23.659360 13698 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:23.659140 13641 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.577338 13864 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:23.660840 13864 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:23.591338 13659 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.662469 13659 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.659108 13873 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.592028 13470 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.666718 13470 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.645874 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.671343 10996 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:23.672149 13911 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.672751 13911 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.646191 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:23.651467 10144 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:23.621625 10146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 283) took 15207 ms (client timeout 15000 ms). Trace:
I20260709 13:16:23.675289 10144 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 6 to 8, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 8 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:23.676878 13911 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:23.676714 10144 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 6 to 9, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:23.679047 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:23.682600 10144 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:23.674772 10146 rpcz_store.cc:269] 0709 13:16:08.414273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.414453 (+   180us) service_pool.cc:224] Handling call
0709 13:16:23.620859 (+15206406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:16.513483 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:16.514609 (+  1126us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:16.514737 (+   128us) write_op.cc:435] Acquired schema lock
0709 13:16:16.514784 (+    47us) tablet.cc:662] Decoding operations
0709 13:16:16.642753 (+127969us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:16.642834 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:16.642866 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:16:16.777545 (+134679us) tablet.cc:701] Row locks acquired
0709 13:16:16.789915 (+ 12370us) write_op.cc:260] PREPARE: finished
0709 13:16:16.818631 (+ 28716us) write_op.cc:270] Start()
0709 13:16:16.845791 (+ 27160us) write_op.cc:276] Timestamp: P: 1783602976798814 usec, L: 0
0709 13:16:16.845824 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:16:16.899118 (+ 53294us) log.cc:844] Serialized 4858 byte log entry
0709 13:16:17.331401 (+432283us) op_driver.cc:464] REPLICATION: finished
0709 13:16:18.190479 (+859078us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c09de0ac 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c751eef0
0709 13:16:18.623075 (+432596us) write_op.cc:301] APPLY: starting
0709 13:16:18.640364 (+ 17289us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:18.759711 (+119347us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:18.794598 (+ 34887us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:19.213039 (+418441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:19.213518 (+   479us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:16:19.213591 (+    73us) write_op.cc:312] APPLY: finished
0709 13:16:19.214131 (+   540us) log.cc:844] Serialized 89 byte log entry
0709 13:16:19.367147 (+153016us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:19.379783 (+ 12636us) write_op.cc:454] Released schema lock
0709 13:16:19.388032 (+  8249us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:19.448887 (+ 60855us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:19.448921 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115684,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":1251566,"apply.run_cpu_time_us":36576,"apply.run_wall_time_us":804611,"num_ops":12,"prepare.queue_time_us":103575,"prepare.run_cpu_time_us":9521,"prepare.run_wall_time_us":403862,"raft.queue_time_us":217918,"raft.run_cpu_time_us":33125,"raft.run_wall_time_us":1477599,"replication_time_us":484089,"spinlock_wait_cycles":12442496,"thread_start_us":1891342,"threads_started":5,"wal-append.queue_time_us":322686,"wal-append.run_cpu_time_us":25274,"wal-append.run_wall_time_us":2443085}]]}
I20260709 13:16:23.692852 13659 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.694880 13470 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.622303 13849 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.697834 13698 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.700083 13864 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.591107 13760 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 13:16:23.701671 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.696434 13873 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.745044 10144 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 7 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.770936 10144 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 8 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:23.701520 13791 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.599541 13918 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.176s
W20260709 13:16:23.762578 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 217238us
I20260709 13:16:23.601897 13669 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.779856 13669 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.780409 13669 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.761289 13849 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.788717 10390 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:23.773494 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.774266 10144 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 7 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:23.776007 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 173316us
I20260709 13:16:23.789740 11002 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:23.777139 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.778873 10392 raft_consensus.cc:2368] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
W20260709 13:16:23.705220 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 112566us
I20260709 13:16:23.791464 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:23.766300 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 225006us
I20260709 13:16:23.583176 13893 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:23.744362 13923 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.760464 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:23.765709 13899 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.790253 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:23.804899 10398 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.805656 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.814963 10391 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:23.774473 13760 consensus_queue.cc:1243] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:23.690047 13812 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:23.808288 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:23.857491 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 51879.2us
I20260709 13:16:23.806618 10999 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:23.762567 13915 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:16:23.858609 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.706425 13498 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:23.859579 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:23.879046 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:23.883697 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:23.813511 13558 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.818979 13917 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.819444 13739 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:23.908905 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.804766 13870 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:16:23.921479 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:23.922886 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 137032us
I20260709 13:16:23.880285 13793 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.880745 13893 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:23.916095 13772 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.007s
I20260709 13:16:23.858181 13918 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:16:23.808226 13849 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:23.938489 13930 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:16:23.934733 13924 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 13:16:24.018666 13651 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.000s
I20260709 13:16:23.943230 13739 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:23.942824 13718 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:23.937881 13931 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:24.002106 13498 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.002851  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.003268 13755 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:24.002897 13864 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:23.937773 13795 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.002s
I20260709 13:16:24.097903 10398 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
W20260709 13:16:24.007428 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 199214us
I20260709 13:16:23.931701 13793 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.936156 13906 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:24.019691 13665 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.004s
W20260709 13:16:24.020488 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2228) took 1593 ms (client timeout 2028 ms). Trace:
I20260709 13:16:24.020581 13470 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:23.965332 13666 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:23.934190 13927 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:16:24.022713 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 585) took 1169 ms. Trace:
W20260709 13:16:24.030840 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.964799 13584 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:24.080082 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.140930 10321 rpcz_store.cc:276] 0709 13:16:22.853403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.236212 (+382809us) service_pool.cc:224] Handling call
0709 13:16:23.236656 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.259911 (+ 23255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.259949 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.263809 (+  3860us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.544303 (+280494us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:23.544359 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.544425 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.022440 (+478015us) raft_consensus.cc:1685] finished
0709 13:16:24.022462 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.022650 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22782,"raft.queue_time_us":30557,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":11463,"thread_start_us":215994,"threads_started":1,"wal-append.queue_time_us":276860}
I20260709 13:16:24.099584 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:24.004534 13938 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.778354 13675 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:24.117403 10316 rpcz_store.cc:269] 0709 13:16:22.427076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.867249 (+440173us) service_pool.cc:224] Handling call
0709 13:16:23.189446 (+322197us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:16:24.020305 (+830859us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54001883d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:24.020420 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566694400}
W20260709 13:16:24.135462 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 256501us
I20260709 13:16:23.928766 13917 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.215361 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:24.134994 13755 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:24.116909 13793 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.117064 13906 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:24.233493 13862 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:24.234472 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 134979us
I20260709 13:16:24.141144 13864 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.208032 13689 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.001s
I20260709 13:16:24.236603 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:24.313138 10399 raft_consensus.cc:2410] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:16:24.278510 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.237178 13771 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.003s
I20260709 13:16:24.119941 13651 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.124977 13795 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.223315 13870 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.325260 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 88766.8us
I20260709 13:16:24.332406 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:24.344228 10243 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:24.346778 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:24.324211 10393 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:24.244098 13659 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:24.315225 13698 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:24.311805 13873 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:24.348764 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:24.351351 10362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.012s
I20260709 13:16:24.329310 13851 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:24.384128 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 159084us
W20260709 13:16:24.440907 10362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.005s	sys 0.021s
W20260709 13:16:24.448912 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 633028us
I20260709 13:16:24.012586 13923 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.453001 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:24.454195 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 105537us
I20260709 13:16:24.469486 10321 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:16:24.350751 13792 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.948s	user 0.010s	sys 0.000s
I20260709 13:16:24.351995 13718 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.350787 13666 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.333161 13953 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:24.494695 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:24.495431 10391 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:24.335383 13912 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:24.311991 13864 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.473779 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:24.485670 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:24.499130 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:24.447477 13851 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.499456 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:24.477378 13470 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:24.496675 10288 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:24.539884 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:24.540797 10996 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:24.471377 13698 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.536974 10319 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.324561 13739 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.547196 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:24.548832 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52456.7us
I20260709 13:16:24.353060 13867 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:16:24.473301 13915 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:24.345994 13870 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.473145 13941 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.541260 13934 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.610s	user 0.001s	sys 0.000s
I20260709 13:16:24.564790 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:24.533679 13862 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:24.545142 13470 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:24.571384 13939 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:16:24.560230 13953 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:24.571908 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:24.573248 13956 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
W20260709 13:16:24.575650 13669 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.000s
W20260709 13:16:24.575773 13834 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.180s	user 0.009s	sys 0.000s
I20260709 13:16:24.540668 13689 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.542251 13851 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.499136 13912 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:24.570705 13946 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:16:24.618875 13940 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.596s	user 0.001s	sys 0.000s
I20260709 13:16:24.559021 13718 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.647123 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 592) took 1684 ms. Trace:
I20260709 13:16:24.619415 10391 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:24.584293 13875 consensus_meta.cc:287] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.173s	user 0.015s	sys 0.000s
I20260709 13:16:24.620491 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:24.487262 13906 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.597566 13470 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:24.560425 13883 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.000s
I20260709 13:16:24.642554 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:24.560096 13698 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.638927 13689 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.645181 13864 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:24.587486 13941 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.647526 10325 rpcz_store.cc:276] 0709 13:16:22.962969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.352086 (+389117us) service_pool.cc:224] Handling call
0709 13:16:23.352482 (+   396us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:16:23.533851 (+181369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.533897 (+    46us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:16:23.540391 (+  6494us) log.cc:844] Serialized 104 byte log entry
0709 13:16:23.635017 (+ 94626us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:23.635058 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.642295 (+  7237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.646881 (+1004586us) raft_consensus.cc:1685] finished
0709 13:16:24.646902 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.647065 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":175160,"raft.queue_time_us":182885,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10812,"thread_start_us":50802,"threads_started":1,"wal-append.queue_time_us":251105}
I20260709 13:16:24.628572 13558 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.583040 13915 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.629106 13669 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:24.646795 13726 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.204s	user 0.002s	sys 0.008s
I20260709 13:16:24.659220 10248 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.645150 13964 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.662667 10394 raft_consensus.cc:2410] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:24.537034 13792 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:24.653126 13762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.010s	sys 0.015s
I20260709 13:16:24.649410 13675 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:24.677964 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1628) took 1287 ms. Trace:
I20260709 13:16:24.667038 13862 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.669536 13651 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:24.652559 13875 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.661775 13867 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:24.680346 13953 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.657416 13968 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.659926 13755 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:24.697141 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:24.723773 10241 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.703635 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:24.708035 10250 rpcz_store.cc:276] 0709 13:16:23.390371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.601660 (+211289us) service_pool.cc:224] Handling call
0709 13:16:23.602001 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.623640 (+ 21639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.623672 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.624131 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.996738 (+372607us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:23.996780 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.996857 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.677744 (+680887us) raft_consensus.cc:1685] finished
0709 13:16:24.677768 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.677900 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21182,"raft.queue_time_us":54165,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":22912,"thread_start_us":226444,"threads_started":1,"wal-append.queue_time_us":490936}
I20260709 13:16:24.687750 13895 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:24.689885 13644 consensus_meta.cc:287] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.097s	user 0.005s	sys 0.004s
W20260709 13:16:24.692176 13893 consensus_meta.cc:287] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.002s
I20260709 13:16:24.712631 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1627) took 1353 ms. Trace:
I20260709 13:16:24.736604 10246 rpcz_store.cc:276] 0709 13:16:23.359034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.583842 (+224808us) service_pool.cc:224] Handling call
0709 13:16:23.584157 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.584461 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.584487 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.591416 (+  6929us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.778333 (+186917us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:23.778389 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.778489 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.712343 (+933854us) raft_consensus.cc:1685] finished
0709 13:16:24.712372 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.712572 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2179,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":52,"thread_start_us":77058,"threads_started":1,"wal-append.queue_time_us":242471}
W20260709 13:16:24.686187 13843 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.281s	user 0.010s	sys 0.000s
I20260709 13:16:24.714339 10242 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:16:24.596200 13684 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.162s	user 0.012s	sys 0.000s
W20260709 13:16:24.705137 13865 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.286s	user 0.012s	sys 0.000s
W20260709 13:16:24.699168 13921 consensus_meta.cc:287] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.255s	user 0.008s	sys 0.003s
W20260709 13:16:24.701195 13897 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.065s	user 0.007s	sys 0.001s
W20260709 13:16:24.710958 13762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.011s	sys 0.015s
I20260709 13:16:24.701088 13795 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:24.702682 13892 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.291s	user 0.010s	sys 0.002s
I20260709 13:16:24.688086 13698 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:24.726195 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:24.693437 13941 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:24.695649 10248 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:24.691280 13689 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:24.688370 13971 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:24.695904 13870 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:24.699441 13812 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:24.724445 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:24.735234 11001 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:24.740006 10994 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:24.694770 13726 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.688997 13702 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:24.728241 13968 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.750114 10242 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:24.781558 10246 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:16:25.069268 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 344892us
I20260709 13:16:24.767910 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:24.961580 10241 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:25.075932 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2456) took 1050 ms. Trace:
I20260709 13:16:25.076421 10241 rpcz_store.cc:276] 0709 13:16:24.025789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.696832 (+671043us) service_pool.cc:224] Handling call
0709 13:16:25.075858 (+379026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.068351 10250 raft_consensus.cc:2410] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:24.728264 13895 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:24.736292 13669 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:25.028625 13961 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:16:24.780555 13970 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:25.021548 13972 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:25.129370 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.070828 13864 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.132157 10395 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:25.119705 13702 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.101457 13911 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:25.105928 13644 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.080189 13897 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.089812 13977 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:25.102649 13698 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:24.743412 13843 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.080463 13921 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.107292 13689 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:16:24.743237 13684 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:24.755105 13865 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.132308 13498 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:25.144927 13972 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.166643 13795 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.975850 13755 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.085969 13971 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.080616 13892 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.189496 13762 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:25.356964 13762 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:25.357252 13968 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.357690 13843 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.187867 13875 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:25.185189 13792 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.187372 13977 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:25.140269 13970 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.168154 13911 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.145347 13864 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:25.380620 13979 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:16:25.398639 13980 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:25.400679 13971 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.406934 13897 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:25.409657 13921 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.410967 13977 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.167690 13895 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.438737 13895 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:25.440207 13945 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.217s	user 0.008s	sys 0.008s
I20260709 13:16:25.426856 13911 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.146692 10246 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:25.357982 13762 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.603188 10997 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:25.570214 10244 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.596585 10396 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:25.571157 10247 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:25.738473 13843 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.740029 13849 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.616s	user 0.016s	sys 0.005s
I20260709 13:16:25.739761 13843 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.741142 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2450) took 2473 ms. Trace:
I20260709 13:16:25.740775 13849 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:25.567020 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.011s	sys 0.057s
I20260709 13:16:25.745565 13786 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.746666 13915 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.178339 13644 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.748513 13726 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.719914 13968 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:25.228999 13698 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:25.596231 10391 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.946s	user 0.017s	sys 0.008s
W20260709 13:16:25.467355 13964 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.009s
W20260709 13:16:25.464911 13912 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.006s
W20260709 13:16:25.483660 13851 consensus_meta.cc:287] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.836s	user 0.006s	sys 0.010s
W20260709 13:16:25.762807 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.018s	sys 0.064s
I20260709 13:16:25.648783 13865 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.648129 13792 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.597993 13988 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:25.769028 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.451242 13892 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:25.773999 10391 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:16:25.782931 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.783759 13875 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.444206 13972 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.445669 13970 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.786634 11000 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:25.787007 13969 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.358572 13795 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.741725 10249 rpcz_store.cc:276] 0709 13:16:23.267489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.554348 (+286859us) service_pool.cc:224] Handling call
0709 13:16:23.554795 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.775618 (+220823us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:23.775651 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.811319 (+ 35668us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.335022 (+523703us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.335241 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.740175 (+1404934us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b540006c2d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:25.740280 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.740390 (+   110us) raft_consensus.cc:1685] finished
0709 13:16:25.740404 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.740875 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20076,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":187286400,"thread_start_us":586653,"threads_started":2,"wal-append.queue_time_us":792972,"wal-append.run_cpu_time_us":2046,"wal-append.run_wall_time_us":1077807}
W20260709 13:16:25.797505 10392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2166) took 2218 ms (client timeout 1837 ms). Trace:
W20260709 13:16:25.775383 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 1.19037e+06us
I20260709 13:16:25.795432 13988 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.802728 13812 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:25.839161 13812 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:25.800688 10393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 684) took 2334 ms (client timeout 1540 ms). Trace:
W20260709 13:16:25.802096 13793 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.559s	user 0.008s	sys 0.008s
I20260709 13:16:25.807822 13684 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:25.845005 13988 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:25.854140 10395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2161) took 2247 ms (client timeout 1624 ms). Trace:
I20260709 13:16:25.797343 13644 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.805423 13739 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.786903 13968 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.878732 13915 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.878727 13851 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.880014 13915 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.806905 13760 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.854763 10395 rpcz_store.cc:269] 0709 13:16:23.575530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.575842 (+   312us) service_pool.cc:224] Handling call
0709 13:16:25.807937 (+2232095us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002ddf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:25.823022 (+ 15085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410514816}
I20260709 13:16:25.883358 10318 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 8. Ops: [6.7-6.7]
I20260709 13:16:25.882956 13760 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.884356 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.884613 13684 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.885327 10395 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:25.885417 13684 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.888307 13684 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:25.890439 13698 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:25.830871 10392 rpcz_store.cc:269] 0709 13:16:23.578608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.589277 (+ 10669us) service_pool.cc:224] Handling call
0709 13:16:25.796885 (+2207608us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000f32d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:25.797223 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323703552}
I20260709 13:16:25.892514 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:25.893744 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2178) took 1179 ms. Trace:
I20260709 13:16:25.894848 13739 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.897029 13906 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.878139 13968 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:25.900240 13975 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.818s	user 0.008s	sys 0.012s
W20260709 13:16:25.901144 10362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.543s (SENT) [suppressed 12 similar messages]
W20260709 13:16:25.842568 10393 rpcz_store.cc:269] 0709 13:16:23.465687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.465820 (+   133us) service_pool.cc:224] Handling call
0709 13:16:25.799960 (+2334140us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54001dfe54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:25.800323 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867654272}
I20260709 13:16:25.906420 10392 rpcz_store.cc:276] 0709 13:16:24.714480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.891943 (+1177463us) service_pool.cc:224] Handling call
0709 13:16:25.893620 (+  1677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.858640 13793 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.861351 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:25.863016 13875 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:25.864147 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.864609 13843 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.864880 13795 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.866832 13849 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:25.867493 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 182315us
I20260709 13:16:25.925479 13875 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.868117 13972 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:25.926620 13760 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.928237 13851 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.927323 13972 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.929141 13846 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.930833 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.931628 10392 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:25.932176 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2169) took 1377 ms. Trace:
W20260709 13:16:25.932348 13952 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.373s	user 0.015s	sys 0.024s
I20260709 13:16:25.932586 10392 rpcz_store.cc:276] 0709 13:16:24.554523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.929093 (+1374570us) service_pool.cc:224] Handling call
0709 13:16:25.932102 (+  3009us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:25.870275 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 738) took 2223 ms (client timeout 2159 ms). Trace:
I20260709 13:16:25.870484 13912 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:25.933434 10994 rpcz_store.cc:269] 0709 13:16:23.646117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.650377 (+  4260us) service_pool.cc:224] Handling call
0709 13:16:25.869743 (+2219366us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54006fb8d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:25.869982 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2503122816}
I20260709 13:16:25.934826 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:25.871461 10999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 735) took 2232 ms (client timeout 1543 ms). Trace:
I20260709 13:16:25.935912 10392 raft_consensus.cc:2410] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:25.935683 10999 rpcz_store.cc:269] 0709 13:16:23.645165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.646306 (+  1141us) service_pool.cc:224] Handling call
0709 13:16:25.871027 (+2224721us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540048d354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:25.871252 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366202112}
I20260709 13:16:25.794168 13786 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.937028 13739 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.873123 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 731) took 2291 ms. Trace:
I20260709 13:16:25.797892 13969 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:25.939738 13786 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.916656 13988 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:25.854617 13812 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.918915 13726 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.919443 10249 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:25.936671 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2177) took 1257 ms. Trace:
I20260709 13:16:25.938925 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:25.940593 13702 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.016s
W20260709 13:16:25.921868 13470 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.260s	user 0.009s	sys 0.008s
W20260709 13:16:25.833920 10391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1743) took 1352 ms (client timeout 1796 ms). Trace:
I20260709 13:16:25.915107 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1737) took 1446 ms. Trace:
I20260709 13:16:25.922003 13793 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.938445 11002 rpcz_store.cc:276] 0709 13:16:23.581576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.582092 (+   516us) service_pool.cc:224] Handling call
0709 13:16:23.601508 (+ 19416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.790146 (+188638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.872380 (+2082234us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400633b54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:25.872824 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432449408}
I20260709 13:16:25.948289 10392 rpcz_store.cc:276] 0709 13:16:24.679190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.934347 (+1255157us) service_pool.cc:224] Handling call
0709 13:16:25.936583 (+  2236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.914407 13964 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:25.952467 10391 rpcz_store.cc:269] 0709 13:16:24.470914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.552744 (+ 81830us) service_pool.cc:224] Handling call
0709 13:16:25.815541 (+1262797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.941068 13865 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.952718 10395 rpcz_store.cc:276] 0709 13:16:24.461349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.883731 (+1422382us) service_pool.cc:224] Handling call
0709 13:16:25.907347 (+ 23616us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.956370 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 868) took 1403 ms. Trace:
I20260709 13:16:25.951361 13470 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.959318 10997 rpcz_store.cc:276] 0709 13:16:24.546511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.546852 (+   341us) service_pool.cc:224] Handling call
0709 13:16:25.941526 (+1394674us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001b76d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:25.949933 (+  8407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424861568}
I20260709 13:16:25.953595 13846 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:25.968641 13846 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.971104 13846 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.972005 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.972930 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2175) took 1325 ms. Trace:
I20260709 13:16:25.973255 10395 rpcz_store.cc:276] 0709 13:16:24.647961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.958065 (+1310104us) service_pool.cc:224] Handling call
0709 13:16:25.972845 (+ 14780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.975553 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.980067 10395 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:25.962728 13972 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:25.983829 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2168) took 1429 ms. Trace:
I20260709 13:16:25.984546 10395 rpcz_store.cc:276] 0709 13:16:24.554287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.973910 (+1419623us) service_pool.cc:224] Handling call
0709 13:16:25.983754 (+  9844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.985268 10393 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:25.985683 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:25.985949 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2176) took 1327 ms. Trace:
I20260709 13:16:25.986310 10393 rpcz_store.cc:276] 0709 13:16:24.658859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.938485 (+1279626us) service_pool.cc:224] Handling call
0709 13:16:25.985696 (+ 47211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:25.987200 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.985715 10397 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:25.982972 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.987222 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:25.944164 13792 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:25.992686 10395 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:25.993105 10392 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:25.994323 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:25.999832 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2171) took 1444 ms. Trace:
I20260709 13:16:26.000226 10392 rpcz_store.cc:276] 0709 13:16:24.555010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.954202 (+1399192us) service_pool.cc:224] Handling call
0709 13:16:25.999768 (+ 45566us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:25.990885 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 89970.3us
I20260709 13:16:25.990556 13915 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:25.990810 13849 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.009866 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:26.010915 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.011636 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.012682 13846 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:26.014444 13684 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.015401 13684 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.013506 13846 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.020851 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.021600 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.013833 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.023120 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.026760 10250 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:26.020031 13787 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.003652 13865 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:26.029560 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:26.031306 13865 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.031903 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:26.033871 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 597) took 1564 ms. Trace:
I20260709 13:16:26.035995 10395 raft_consensus.cc:2368] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:16:26.034932 10318 rpcz_store.cc:276] 0709 13:16:24.481287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.481529 (+   242us) service_pool.cc:224] Handling call
0709 13:16:24.482225 (+   696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.884003 (+1401778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.033357 (+149354us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003ec6d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:26.033711 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219695872}
I20260709 13:16:25.988621 13726 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:26.051062 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 98124.8us
I20260709 13:16:26.002831 13988 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:26.057497 13470 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.059475 10246 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.061293 13812 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:26.064049 13915 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.066939 13849 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.075351 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:26.077217 10397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2170) took 1522 ms (client timeout 1922 ms). Trace:
I20260709 13:16:26.077790 13787 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.078696 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2453) took 2697 ms. Trace:
I20260709 13:16:26.062191 13812 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:26.069211 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.123413 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.123883 13999 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.124361 10392 raft_consensus.cc:2376] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11. Re-sending same reply.
I20260709 13:16:26.124698 13999 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.125663 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.126536 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2180) took 1359 ms. Trace:
I20260709 13:16:26.066326 13702 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.127605 10246 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:26.098943 10393 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:26.118177 10247 rpcz_store.cc:276] 0709 13:16:23.381381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.601660 (+220279us) service_pool.cc:224] Handling call
0709 13:16:23.602001 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.755051 (+2153050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.078379 (+323328us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000a8a54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:26.078615 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4527082368}
W20260709 13:16:26.119017 10397 rpcz_store.cc:269] 0709 13:16:24.554754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.089686 (+534932us) service_pool.cc:224] Handling call
0709 13:16:26.076889 (+987203us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540045c754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.077113 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950588672}
I20260709 13:16:26.126892 10392 rpcz_store.cc:276] 0709 13:16:24.766908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.125251 (+1358343us) service_pool.cc:224] Handling call
0709 13:16:26.126476 (+  1225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.079607 13988 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.079182 13726 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:26.133503 10399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 675) took 3289 ms (client timeout 2527 ms). Trace:
W20260709 13:16:26.134021 10399 rpcz_store.cc:269] 0709 13:16:22.843833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.150758 (+306925us) service_pool.cc:224] Handling call
0709 13:16:26.133063 (+2982305us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54000bc7d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.133293 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096460160}
I20260709 13:16:26.135311 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.066968 13864 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.084142 13846 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:26.140909 13846 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.141588 13846 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.143428 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.083317 13938 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:26.144181 13938 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.144174 10393 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:26.146996 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2172) took 1589 ms. Trace:
I20260709 13:16:26.147349 10393 rpcz_store.cc:276] 0709 13:16:24.557738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.143067 (+1585329us) service_pool.cc:224] Handling call
0709 13:16:26.146912 (+  3845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.152122 13998 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:26.154388 13955 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.600s	user 0.010s	sys 0.020s
I20260709 13:16:26.137980 10391 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:26.140277 10394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2164) took 2562 ms (client timeout 1571 ms). Trace:
I20260709 13:16:26.187551 10250 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:26.158013 10394 rpcz_store.cc:269] 0709 13:16:23.578046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.592605 (+ 14559us) service_pool.cc:224] Handling call
0709 13:16:26.136131 (+2543526us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540040f454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.140102 (+  3971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354977536}
I20260709 13:16:26.191363 13684 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.193653 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:26.226298 10247 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 3.
I20260709 13:16:26.240563 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1718) took 3659 ms. Trace:
I20260709 13:16:26.241201 10390 rpcz_store.cc:276] 0709 13:16:22.581285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.581443 (+   158us) service_pool.cc:224] Handling call
0709 13:16:22.581738 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.789201 (+1207463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.239829 (+2450628us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540045b854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:26.240270 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775354112}
I20260709 13:16:26.198554 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.252776 10392 raft_consensus.cc:2410] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:16:26.204524 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 82346.8us
I20260709 13:16:26.207959 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.214040 13938 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.265216 13938 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:26.214753 10396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 680) took 2757 ms (client timeout 1688 ms). Trace:
W20260709 13:16:26.266422 10396 rpcz_store.cc:269] 0709 13:16:23.457258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.467972 (+ 10714us) service_pool.cc:224] Handling call
0709 13:16:26.214476 (+2746504us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540027b854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.214673 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4793033472}
I20260709 13:16:26.216986 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2449) took 2949 ms. Trace:
W20260709 13:16:26.268167 13966 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.672s	user 0.019s	sys 0.012s
I20260709 13:16:26.268559 10244 rpcz_store.cc:276] 0709 13:16:23.267199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.516623 (+249424us) service_pool.cc:224] Handling call
0709 13:16:23.516962 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.761810 (+2244848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.216547 (+454737us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54000b95d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:26.216900 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4720219904}
I20260709 13:16:26.220587 10241 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.224032 13684 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.157315 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1624) took 2855 ms. Trace:
I20260709 13:16:26.268200 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.316742 10249 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:26.399359 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.407729 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.422322 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.405462 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.344595 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2463) took 1198 ms. Trace:
I20260709 13:16:26.427821 10249 rpcz_store.cc:276] 0709 13:16:25.119197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.860606 (+741409us) service_pool.cc:224] Handling call
0709 13:16:26.317530 (+456924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.314464 10245 rpcz_store.cc:276] 0709 13:16:23.301654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.571767 (+270113us) service_pool.cc:224] Handling call
0709 13:16:23.600058 (+ 28291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.600300 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.600339 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.613270 (+ 12931us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.135098 (+521828us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.135143 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.135221 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.153360 (+2018139us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:26.156688 (+  3328us) raft_consensus.cc:1685] finished
0709 13:16:26.156711 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.157097 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298238208,"thread_start_us":363722,"threads_started":1,"wal-append.queue_time_us":694712}
I20260709 13:16:26.412580 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.357739 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2444) took 3092 ms. Trace:
W20260709 13:16:26.443111 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 320161us
I20260709 13:16:26.437760 10243 rpcz_store.cc:276] 0709 13:16:23.265658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.424433 (+158775us) service_pool.cc:224] Handling call
0709 13:16:26.357209 (+2932776us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400070154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.357522 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911237248}
I20260709 13:16:26.262320 13912 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.458174 13999 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.343607 13938 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.357049 13967 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.697s	user 0.018s	sys 0.012s
W20260709 13:16:26.477120 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 353467us
I20260709 13:16:26.355512 10396 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:26.501507 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2182) took 1332 ms. Trace:
W20260709 13:16:26.496140 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.489159 13762 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.501948 10396 rpcz_store.cc:276] 0709 13:16:25.168995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.267713 (+1098718us) service_pool.cc:224] Handling call
0709 13:16:26.501447 (+233734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.312927 13702 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:26.504853 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 60865.9us
I20260709 13:16:26.500479 10390 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:26.517004 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2174) took 1885 ms. Trace:
I20260709 13:16:26.517427 10390 rpcz_store.cc:276] 0709 13:16:24.627063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.408325 (+1781262us) service_pool.cc:224] Handling call
0709 13:16:26.512316 (+103991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.476315 13684 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.524556 10397 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:16:26.489409 13851 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.500551 13938 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.530368 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1735) took 2066 ms. Trace:
I20260709 13:16:26.534008 10397 rpcz_store.cc:276] 0709 13:16:24.460853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.458118 (+1997265us) service_pool.cc:224] Handling call
0709 13:16:26.517294 (+ 59176us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.526522 (+  9228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.526772 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.535776 13999 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:26.537729 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.537304 13641 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.542976 10390 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:26.544096 13849 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.544782 13792 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.523491 13739 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.552071 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.553390 11002 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:26.553725 13584 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.556820 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1739) took 2079 ms. Trace:
I20260709 13:16:26.557381 10390 rpcz_store.cc:276] 0709 13:16:24.469832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.524173 (+2054341us) service_pool.cc:224] Handling call
0709 13:16:26.531718 (+  7545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.549391 (+ 17673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.549581 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.560518 13695 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.561411 13695 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.563402 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1736) took 2102 ms. Trace:
I20260709 13:16:26.563862 10393 rpcz_store.cc:276] 0709 13:16:24.461106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.475854 (+2014748us) service_pool.cc:224] Handling call
0709 13:16:26.533599 (+ 57745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.562996 (+ 29397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.563029 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.563072 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.563108 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.563172 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.563314 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.531934 13787 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.529798 13702 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.571329 13641 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.578104 13718 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.578883 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.579253 13702 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.579586 10318 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:26.580225 13938 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.573324 13584 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:26.582880 13584 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:26.576934 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.593573 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:26.593850 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 43501.3us
I20260709 13:16:26.589821 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:26.594945 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.607650 10396 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:26.608510 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1738) took 2143 ms. Trace:
I20260709 13:16:26.608690 10995 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 10. (term mismatch)
I20260709 13:16:26.609241 10995 pending_rounds.cc:85] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 9
I20260709 13:16:26.609525 10995 pending_rounds.cc:107] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260709 13:16:26.609833 10995 raft_consensus.cc:2889] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:26.610162 14002 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:26.578835 13718 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:26.610785 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:26.611680 10998 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:26.612519 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:26.613207 10998 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.614995 10994 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:16:26.616302 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:26.616439 13684 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.571525 13846 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.618645 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:26.619364 10999 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.608863 10396 rpcz_store.cc:276] 0709 13:16:24.465386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.509486 (+2044100us) service_pool.cc:224] Handling call
0709 13:16:26.547195 (+ 37709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.608196 (+ 61001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.608434 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.616925 10994 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:26.595983 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:26.558876 13739 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:26.627256 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:26.628371 10397 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:16:26.628921 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:26.629341 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.629746 10996 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:26.630631 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.629016 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1740) took 2159 ms. Trace:
I20260709 13:16:26.632633 10397 rpcz_store.cc:276] 0709 13:16:24.470089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.551668 (+2081579us) service_pool.cc:224] Handling call
0709 13:16:26.606184 (+ 54516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.628779 (+ 22595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.628965 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.638548 10390 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.551430 13851 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:26.656762 11002 raft_consensus.cc:2410] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:26.627774 13739 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.658080 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.658998 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.664511 10396 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:26.660569 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:26.661240 13928 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 3.025s	user 0.020s	sys 0.031s
W20260709 13:16:26.662441 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.664126 10245 raft_consensus.cc:2376] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9. Re-sending same reply.
I20260709 13:16:26.663427 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:26.612542 13718 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:26.670670 10995 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.673816 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:26.674930 10245 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:26.675688 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.675969 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:26.676183 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:26.677201 10245 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:26.677470 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.678217 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.678692 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.677233 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.677767 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.679075 10321 raft_consensus.cc:2368] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:26.679033 10323 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:26.682956 13641 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.684314 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.685202 10392 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 5: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:26.686103 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.686810 10392 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:26.687479 10320 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:26.687685 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.688490 10392 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:26.689260 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.689733 10392 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.691138 10994 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 10. (term mismatch)
I20260709 13:16:26.691516 10994 pending_rounds.cc:85] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 9
I20260709 13:16:26.691741 10994 pending_rounds.cc:107] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260709 13:16:26.691987 10994 raft_consensus.cc:2889] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.698589 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.700708 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.700909 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.701996 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2192) took 1113 ms. Trace:
I20260709 13:16:26.702348 10395 rpcz_store.cc:276] 0709 13:16:25.588887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.700533 (+1111646us) service_pool.cc:224] Handling call
0709 13:16:26.701931 (+  1398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.703303 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.703940 10395 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:26.704821 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.705106 13695 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.706913 10396 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:26.708058 10241 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:26.677340 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:26.603834 13899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.935s	user 0.035s	sys 0.056s
I20260709 13:16:26.678963 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:26.721501 11000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 737) took 3075 ms (client timeout 2082 ms). Trace:
W20260709 13:16:26.706442 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 60141.2us
I20260709 13:16:26.835215 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:26.819149 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.808230 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:26.889278 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.833425 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.826571 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:26.838279 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:26.763432 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.749899 10391 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.004s
I20260709 13:16:26.892863 10391 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:26.786875 10998 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
W20260709 13:16:26.893551 10391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2181) took 1763 ms (client timeout 1729 ms). Trace:
W20260709 13:16:26.893976 10391 rpcz_store.cc:269] 0709 13:16:25.130184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.966784 (+836600us) service_pool.cc:224] Handling call
0709 13:16:26.893480 (+926696us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:26.891438 10995 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:26.830516 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.822638 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.834537 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:26.827283 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:26.836882 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.767161 10996 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:26.892212 10324 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.828423 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.774369 10317 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:26.722080 11000 rpcz_store.cc:269] 0709 13:16:23.645836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.645975 (+   139us) service_pool.cc:224] Handling call
0709 13:16:26.721301 (+3075326us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400251554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.721439 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4815945472}
I20260709 13:16:26.823195 10246 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:26.898751 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:26.899693 10994 raft_consensus.cc:2368] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:16:26.900763 10320 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.914964 10243 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:26.916404 10243 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:26.897670 10395 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:26.725775 11001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 740) took 3073 ms (client timeout 1559 ms). Trace:
I20260709 13:16:26.902673 13812 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:26.905543 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1732) took 2445 ms. Trace:
I20260709 13:16:26.906581 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:26.907727 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:26.791953 13899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.221s	user 0.036s	sys 0.057s
I20260709 13:16:26.838706 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:26.925586 11001 rpcz_store.cc:269] 0709 13:16:23.652000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.654315 (+  2315us) service_pool.cc:224] Handling call
0709 13:16:26.725385 (+3071070us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004f06d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:26.725602 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483110144}
I20260709 13:16:26.825189 14003 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.930976 10241 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:26.924875 10398 rpcz_store.cc:276] 0709 13:16:24.459990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.460127 (+   137us) service_pool.cc:224] Handling call
0709 13:16:24.460415 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.056807 (+1596392us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:26.056867 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.056928 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.056981 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.905161 (+848180us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400301954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:26.905206 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.905383 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6797,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":32960,"spinlock_wait_cycles":3639924480}
I20260709 13:16:26.935398 10324 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:26.935848 10247 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:26.936017 10318 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:26.940225 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.940460 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.942515 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.942660 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.943351 10397 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:26.944262 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.945839 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.931435 10319 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:26.944258 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.953478 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:26.955782 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.960330 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:26.961993 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:26.963735 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:26.964455 10398 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.959589 10322 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:26.967092 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:26.967687 10322 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.971813 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.972600 10395 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 4.
I20260709 13:16:26.973676 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:26.940544 13917 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.982899 13851 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:26.986536 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:26.987304 11001 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:26.991546 10394 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:26.993031 10320 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:27.000819 10249 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:27.003203 10321 raft_consensus.cc:2410] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:27.005077 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:27.005929 10391 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.007341 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.006531 10324 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:27.008086 10320 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:27.009269 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.009473 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.010049 10399 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.011027 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.010118 10244 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:27.011817 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2470) took 1016 ms. Trace:
I20260709 13:16:27.012107 10244 rpcz_store.cc:276] 0709 13:16:25.995360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.009179 (+1013819us) service_pool.cc:224] Handling call
0709 13:16:27.011746 (+  2567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.012297 10396 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:27.013525 10323 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:27.012233 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
W20260709 13:16:27.014262 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.021420 10397 raft_consensus.cc:2410] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:27.023794 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.026404 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.030886 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.031111 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.031728 10998 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:27.032750 10394 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:27.034379 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.037427 10322 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:27.037539 10399 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:27.038348 10243 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.038564 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.039311 11001 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:27.040343 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.041050 10995 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 5: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:27.046438 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.046729 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.047392 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.062408 10398 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:27.063023 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.065263 10320 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 5: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.067997 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.076355 10319 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:27.081413 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.091285 10316 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.064049 13851 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.107077 10996 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 4.
I20260709 13:16:27.107777 10399 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:16:27.108062 10324 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.108212 10399 pending_rounds.cc:85] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 8
I20260709 13:16:27.108582 10399 pending_rounds.cc:107] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:16:27.108877 10399 raft_consensus.cc:2889] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.108932 10318 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:27.110299 10323 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:27.112031 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.112742 11000 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:27.113641 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.108392 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.116534 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.117213 10998 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:27.118052 11002 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:27.118312 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.118993 11001 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:27.118072 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.119879 10995 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:27.120752 10391 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:27.121551 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.117237 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.122219 11000 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:27.123149 10994 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.131116 10396 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.132097 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1742) took 2661 ms. Trace:
I20260709 13:16:27.132550 10396 rpcz_store.cc:276] 0709 13:16:24.470686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.064987 (+2594301us) service_pool.cc:224] Handling call
0709 13:16:27.130780 (+ 65793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.131755 (+   975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.132022 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:27.137153 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.141912 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1741) took 2671 ms. Trace:
I20260709 13:16:27.142454 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.143239 10323 raft_consensus.cc:2368] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7.
I20260709 13:16:27.142393 10393 rpcz_store.cc:276] 0709 13:16:24.470453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.564858 (+2094405us) service_pool.cc:224] Handling call
0709 13:16:26.565290 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.572043 (+  6753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.572089 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:26.620036 (+ 47947us) log.cc:844] Serialized 52 byte log entry
0709 13:16:26.925243 (+305207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:26.925310 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.925434 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.141638 (+216204us) raft_consensus.cc:1685] finished
0709 13:16:27.141658 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.141815 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5339,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":53436,"thread_start_us":304775,"threads_started":1,"wal-append.queue_time_us":519624}
I20260709 13:16:27.143865 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.144112 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.144624 10322 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:27.145314 10318 raft_consensus.cc:2410] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:16:27.145573 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.146589 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.147400 10317 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.148238 10321 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:27.148550 10317 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:27.149379 13969 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:27.149842 10317 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:27.147413 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.151539 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.151695 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1629) took 1092 ms. Trace:
I20260709 13:16:27.152027 10245 rpcz_store.cc:276] 0709 13:16:26.059329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.681810 (+622481us) service_pool.cc:224] Handling call
0709 13:16:26.682251 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.683814 (+  1563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.683854 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.684504 (+   650us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.927474 (+242970us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.927527 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.927618 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.151494 (+223876us) raft_consensus.cc:1685] finished
0709 13:16:27.151511 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.151643 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":870,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":105,"thread_start_us":242451,"threads_started":1,"wal-append.queue_time_us":465269}
I20260709 13:16:27.146148 10319 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.155126 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.155606 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.155872 10245 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:27.156251 10249 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:27.158618 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.159222 10397 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:27.146664 10318 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:27.159953 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2173) took 2572 ms. Trace:
I20260709 13:16:27.160394 10397 rpcz_store.cc:276] 0709 13:16:24.587989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.030072 (+2442083us) service_pool.cc:224] Handling call
0709 13:16:27.159004 (+128932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.159680 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.159899 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.158679 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.172849 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.174635 10994 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:27.174830 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.179786 10244 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:27.179023 10999 consensus_meta.cc:287] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:16:27.182428 13812 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:27.190047 10999 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:27.181967 10243 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:27.190268 10319 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:27.018755 14003 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.205230 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.194749 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.195686 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:27.193302 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.174465 13969 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:27.222177 10391 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.227761 10316 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:27.222606 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.231954 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.237558 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.240832 10397 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:27.241029 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:27.240078 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.243784 10396 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:27.245187 10249 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.247249 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.251099 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.251886 10994 raft_consensus.cc:2368] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:16:27.252112 14003 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.268931 10316 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:27.271934 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.245056 13695 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:27.192782 13851 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:27.290179 10390 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
I20260709 13:16:27.290819 10390 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:27.294013 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.301002 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.301822 10241 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:27.319276 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.319996 10994 raft_consensus.cc:1813] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Handling vote request from an unknown peer ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:27.320533 10994 raft_consensus.cc:2368] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:27.322602 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1630) took 1118 ms. Trace:
I20260709 13:16:27.273936 13969 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:27.335682 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.336736 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:27.351826 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.327328 10242 rpcz_store.cc:276] 0709 13:16:26.203905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.695123 (+491218us) service_pool.cc:224] Handling call
0709 13:16:26.695423 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.695709 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:26.990612 (+294903us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.321308 (+330696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.322321 (+  1013us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:27.322372 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.322442 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.322547 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":509386,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1411,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":545036,"threads_started":2}
I20260709 13:16:27.334327 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.377341 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.390563 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.397856 10241 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:27.403941 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.404561 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.415468 10248 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:27.417203 10249 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
W20260709 13:16:27.418952 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 69295.4us
I20260709 13:16:27.419678 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.420436 10316 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:27.423427 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0124203259999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:16:27.425100 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:27.425978 13938 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.427076 10318 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [5.7-7.9]
I20260709 13:16:27.435283 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.435607 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.435000 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.435853 10999 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:27.436308 11000 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:27.436841 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.437166 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:27.437254 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.437597 11001 raft_consensus.cc:2393] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 4: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:27.437884 10994 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:27.438550 10243 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.438657 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.438872 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.378508 13899 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.447340 13899 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.449558 13899 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.487043 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.489980 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.490376 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.490805 10319 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:27.491137 11000 raft_consensus.cc:2368] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
W20260709 13:16:27.491299 10144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 208) took 11604 ms (client timeout 15000 ms). Trace:
I20260709 13:16:27.488399 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.492348 10318 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:27.493196 10243 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:27.496059 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.490046 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.500979 11002 raft_consensus.cc:2410] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:27.538949 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.541426 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.542523 10318 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.549196 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:27.549129 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 370989us
I20260709 13:16:27.550074 11002 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:27.562908 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 86205.7us
I20260709 13:16:27.563407 10324 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:27.564028 13702 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.563941 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:27.565615 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 870) took 1039 ms. Trace:
I20260709 13:16:27.548298 13851 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.495962 13812 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:16:27.576807 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 321026us
I20260709 13:16:27.577201 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:27.575877 10394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.019s	sys 0.007s
I20260709 13:16:27.577817 11002 raft_consensus.cc:1813] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Handling vote request from an unknown peer ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:27.578140 10394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.007s
I20260709 13:16:27.580230 11002 raft_consensus.cc:2368] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:27.567013 10997 rpcz_store.cc:276] 0709 13:16:26.549942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.554364 (+  4422us) service_pool.cc:224] Handling call
0709 13:16:26.554881 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.555276 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:26.805879 (+250603us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.550381 (+744502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.550435 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:27.561511 (+ 11076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.561600 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.561784 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":540619,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":25071,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":839034,"threads_started":3,"wal-append.queue_time_us":410964}
I20260709 13:16:27.548676 13883 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:27.601540 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.604831 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:27.491706 10144 rpcz_store.cc:269] 0709 13:16:15.887153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.887440 (+   287us) service_pool.cc:224] Handling call
0709 13:16:27.491085 (+11603645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:24.639096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:24.645357 (+  6261us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:24.645406 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:16:24.645424 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:24.646521 (+  1097us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:24.646586 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:24.649182 (+  2596us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:24.684753 (+ 35571us) tablet.cc:701] Row locks acquired
0709 13:16:24.684775 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:16:24.684954 (+   179us) write_op.cc:270] Start()
0709 13:16:24.685079 (+   125us) write_op.cc:276] Timestamp: P: 1783602984684903 usec, L: 0
0709 13:16:24.685100 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:24.686070 (+   970us) log.cc:844] Serialized 4430 byte log entry
0709 13:16:25.735280 (+1049210us) op_driver.cc:464] REPLICATION: finished
0709 13:16:25.838692 (+103412us) write_op.cc:301] APPLY: starting
0709 13:16:25.838917 (+   225us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:25.839375 (+   458us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:25.839548 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:26.010466 (+170918us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:26.041093 (+ 30627us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:16:26.041179 (+    86us) write_op.cc:312] APPLY: finished
0709 13:16:26.042000 (+   821us) log.cc:844] Serialized 83 byte log entry
0709 13:16:26.065544 (+ 23544us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:26.068568 (+  3024us) write_op.cc:454] Released schema lock
0709 13:16:26.070013 (+  1445us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:26.076162 (+  6149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:26.076212 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1867066,"reported_tablets":21,"spinlock_wait_cycles":407296,"child_traces":[["op",{"apply.queue_time_us":102879,"apply.run_cpu_time_us":7346,"apply.run_wall_time_us":237426,"num_ops":11,"prepare.queue_time_us":578259,"prepare.run_cpu_time_us":28902,"prepare.run_wall_time_us":519235,"raft.queue_time_us":300368,"raft.run_cpu_time_us":21091,"raft.run_wall_time_us":48757,"replication_time_us":1046855,"thread_start_us":865218,"threads_started":4,"wal-append.queue_time_us":698533,"wal-append.run_cpu_time_us":7717,"wal-append.run_wall_time_us":1639082}]]}
W20260709 13:16:27.608243 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 336361us
I20260709 13:16:27.614034 10324 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:27.561287 13969 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.579941 13702 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.586264 10145 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 7, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.623070 10318 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:27.623374 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.624053 11002 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
W20260709 13:16:27.624888 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47158us
I20260709 13:16:27.614729 13883 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.623628 10318 pending_rounds.cc:85] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 4
I20260709 13:16:27.630352 10318 pending_rounds.cc:107] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:27.630625 10318 raft_consensus.cc:2889] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.620080 13695 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.640130 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.584985 13938 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:27.641712 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.645797 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:27.650482 10145 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 10, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 10 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:16:27.652474 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71634.9us
I20260709 13:16:27.653937 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:27.654819 13851 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:27.653623 10145 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 7, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 7 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:27.635438 13883 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.664170 13851 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:27.671001 13851 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:27.671608 13812 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:27.672160 13812 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:27.672133 13851 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.673579 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:27.673770 13812 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:27.677073 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.679600 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.680735 10325 raft_consensus.cc:2368] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7.
I20260709 13:16:27.678077 10145 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.675944 13883 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:27.682657 14014 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:16:27.682493 14011 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:16:27.682777 14015 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:27.697892 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.683010 14022 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:27.650211 13695 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.683202 14020 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.696623 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.703989 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.710109 13812 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:27.711093 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.710165 14020 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:27.711807 14004 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:27.712237 14004 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:27.712777 14020 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:27.713270 14004 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:27.710610 14012 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:16:27.710636 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1632) took 1054 ms. Trace:
I20260709 13:16:27.714820 10246 rpcz_store.cc:276] 0709 13:16:26.664412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.899530 (+235118us) service_pool.cc:224] Handling call
0709 13:16:26.899963 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.900327 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.900355 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.900915 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.204757 (+303842us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.204927 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.205795 (+   868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.710399 (+504604us) raft_consensus.cc:1685] finished
0709 13:16:27.710418 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.710576 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9088,"thread_start_us":303299,"threads_started":1,"wal-append.queue_time_us":423948}
I20260709 13:16:27.713971 14020 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.738933 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:27.739540 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:27.740845 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 176976us
W20260709 13:16:27.742635 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 103061us
I20260709 13:16:27.752512 10316 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:27.744239 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.732064 10145 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 9, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 9 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:27.703974 14022 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:27.739284 14028 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.760471 14028 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:27.760980 14028 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:27.760918 14022 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:27.715648 14026 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:27.746933 14004 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:27.771836 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 97305.5us
I20260709 13:16:27.772270 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.775702 10316 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:27.780508 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:27.789539 10213 leader_election.cc:400] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:16:27.789943 10213 leader_election.cc:403] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:27.791544 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.769279 14022 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.771656 13998 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:27.804557 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.773312 14026 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.774300 14023 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.812951 13938 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:16:27.822449 10145 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:27.816985 10965 connection.cc:256] RPC call timeout handler was delayed by -3.6971810430000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:16:27.824256 10965 connection.cc:256] RPC call timeout handler was delayed by -3.468293949000099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:16:27.819312 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 162599us
I20260709 13:16:27.766844 14027 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:16:27.807102 14026 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.826292 13969 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:27.827303 14031 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:27.837940 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1745) took 1283 ms. Trace:
I20260709 13:16:27.857021 10394 rpcz_store.cc:276] 0709 13:16:26.557591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.033501 (+475910us) service_pool.cc:224] Handling call
0709 13:16:27.033852 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.034265 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.034290 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.034769 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.578714 (+543945us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.578769 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.578863 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.837714 (+258851us) raft_consensus.cc:1685] finished
0709 13:16:27.837734 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.837875 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":235,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":543519,"threads_started":1,"wal-append.queue_time_us":766075}
I20260709 13:16:27.844571 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.859784 10316 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:27.823746 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:27.803809 13998 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.853947 10145 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 4 to 6, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 6 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:27.868523 10965 connection.cc:256] RPC call timeout handler was delayed by -3.3419009550000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:16:27.869988 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.871807 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 91387.7us
I20260709 13:16:27.862692 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:27.874382 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 218764us
I20260709 13:16:27.879079 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:27.880613 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.881839 10316 raft_consensus.cc:2410] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:16:27.869396 13998 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.889658 10247 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:27.886161 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.884676 10145 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.889935 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.874090 13938 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:27.893745 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.897372 10250 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:27.872792 14031 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:27.915048 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 52438.7us
I20260709 13:16:27.920540 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:27.921133 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 115933us
I20260709 13:16:27.915814 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.927385 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:27.928143 13695 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.928191 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 688) took 1342 ms. Trace:
I20260709 13:16:27.929427 10317 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:27.928952 10395 rpcz_store.cc:276] 0709 13:16:26.585469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.047979 (+462510us) service_pool.cc:224] Handling call
0709 13:16:27.096716 (+ 48737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.550336 (+453620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.550376 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.551166 (+   790us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.679581 (+128415us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:27.679619 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.679693 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.927881 (+248188us) raft_consensus.cc:1685] finished
0709 13:16:27.927908 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.928105 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3706,"raft.queue_time_us":18482,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11822,"thread_start_us":438745,"threads_started":2,"wal-append.queue_time_us":259832}
I20260709 13:16:27.933051 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.933336 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.933928 10323 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.934561 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.934666 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.935920 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:27.936015 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.936643 10325 raft_consensus.cc:2376] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9. Re-sending same reply.
I20260709 13:16:27.936777 10319 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:27.937638 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.938301 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:27.938596 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.939234 10320 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:27.940892 13771 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:27.940914 10364 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.941610 13771 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:27.928354 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:27.943962 10250 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:27.945320 10245 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:27.948136 10316 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:27.942564 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:27.942602 13771 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:27.958453 14044 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:27.899899 13702 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.903538 13938 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:27.961406 10323 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:27.959007 14038 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.944084 13917 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:27.969313 13938 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:27.966672 10145 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 6, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 6 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.975070 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:27.978005 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.981346 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.987411 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.976492 10317 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:27.972018 14038 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:27.920023 14043 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:16:27.964358 14037 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:27.993089 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.971978 14040 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:28.025633 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:28.025900 14040 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.026335 14040 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.991705 14050 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:28.027072 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:28.027508 14050 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.028115 14050 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.028247 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:28.029364 13702 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.030113 13702 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:28.030604 13851 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:28.031278 13851 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.031773 13851 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.035245 14040 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.037573 14040 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.974924 14027 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:16:28.044983 14040 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:28.045411 14040 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:27.999018 14038 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.046380 14040 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:27.990952 14003 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.050561 14003 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:28.052762 14003 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:27.997786 13899 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.053709 13899 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:28.054946 14045 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:28.055866 13899 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:27.991963 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:27.995986 14023 raft_consensus.cc:697] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:27.970605 13695 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:28.011461 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:27.987720 14041 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.023600 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.023839 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:28.086319 10316 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:28.024354 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.025367 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:27.959146 14044 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:28.082793 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 93735.3us
I20260709 13:16:28.082660 13969 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:28.084743 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56613.2us
I20260709 13:16:28.087217 10317 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:28.088259 10393 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:28.086865 10145 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 3, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:28.027103 14031 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:27.993848 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.097273 10396 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:28.099912 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 157432us
I20260709 13:16:28.022667 14037 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.103184 10965 connection.cc:256] RPC call timeout handler was delayed by -3.0896810429999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25270000000000004s for a response
W20260709 13:16:28.103785 10965 connection.cc:256] RPC call timeout handler was delayed by -2.9276479940001536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:16:28.104266 10965 connection.cc:256] RPC call timeout handler was delayed by -2.7944479940001656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:16:28.104707 10965 connection.cc:256] RPC call timeout handler was delayed by -2.7332810430000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2923s for a response
W20260709 13:16:28.105083 10965 connection.cc:256] RPC call timeout handler was delayed by -2.4374136100000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:16:28.030642 13702 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:28.105471 10965 connection.cc:256] RPC call timeout handler was delayed by -2.4185136099999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:16:28.105940 10965 connection.cc:256] RPC call timeout handler was delayed by -2.4122136099999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:16:28.106500 10965 connection.cc:256] RPC call timeout handler was delayed by -2.4122136099999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:16:28.106966 10965 connection.cc:256] RPC call timeout handler was delayed by -2.3609136099998977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 13:16:28.107343 10965 connection.cc:256] RPC call timeout handler was delayed by -2.3075479940000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 13:16:28.107767 10965 connection.cc:256] RPC call timeout handler was delayed by -2.2673136099999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:16:28.108054 10965 connection.cc:256] RPC call timeout handler was delayed by -2.2466136099999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:16:28.108340 10965 connection.cc:256] RPC call timeout handler was delayed by -2.0981136099999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:16:28.108635 10965 connection.cc:256] RPC call timeout handler was delayed by -1.9640136099999381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:16:28.108920 10965 connection.cc:256] RPC call timeout handler was delayed by -1.8182136099999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:16:28.109201 10965 connection.cc:256] RPC call timeout handler was delayed by -1.8182136099999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:16:28.109488 10965 connection.cc:256] RPC call timeout handler was delayed by -1.7903136099998846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:16:28.109776 10965 connection.cc:256] RPC call timeout handler was delayed by -1.3979136099999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2669s for a response
W20260709 13:16:28.110045 10965 connection.cc:256] RPC call timeout handler was delayed by -1.3979136099999323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2669s for a response
I20260709 13:16:28.110828 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:28.114394 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:28.117188 14046 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:16:28.115720 14023 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.107187 13994 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.125620 13994 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:28.126053 13994 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.094342 14028 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.129244 13695 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:28.090689 13969 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.134649 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 191798us
I20260709 13:16:28.104409 14037 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.138216 10397 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
W20260709 13:16:28.139236 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48409.5us
I20260709 13:16:28.138490 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:28.144021 14043 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.147421 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:28.147939 14044 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:28.148316 14043 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.148753 14043 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.149102 14043 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.151477 14040 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.133492 13695 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.228420 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.228911 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 83177.9us
I20260709 13:16:28.143920 14052 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:16:28.231287 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 120667us
W20260709 13:16:28.234663 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.236425 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.231303 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:28.254062 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 259572us
W20260709 13:16:28.258888 10290 connection.cc:256] RPC call timeout handler was delayed by -2.4655575899998894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 13:16:28.259531 10290 connection.cc:256] RPC call timeout handler was delayed by -2.4448575899998559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:16:28.259919 10290 connection.cc:256] RPC call timeout handler was delayed by -2.2954575900000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:16:28.260208 10362 connection.cc:256] RPC call timeout handler was delayed by -1.2922150070000953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2649s for a response
I20260709 13:16:28.253679 10245 raft_consensus.cc:2376] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9. Re-sending same reply.
I20260709 13:16:28.099993 14041 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.267313 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:28.268074 10290 connection.cc:256] RPC call timeout handler was delayed by -2.1910575899999003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
W20260709 13:16:28.268445 10290 connection.cc:256] RPC call timeout handler was delayed by -2.0866575899999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:16:28.268712 10290 connection.cc:256] RPC call timeout handler was delayed by -1.1668575900000633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32160000000000005s for a response
I20260709 13:16:28.270123 10250 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:28.269984 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:28.228206 13695 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.270123 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:28.274343 10997 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:28.231359 14028 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:28.284641 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 111775us
I20260709 13:16:28.285499 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:28.284184 14026 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.246713 14048 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:28.280956 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:28.288702 10994 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.285735 14038 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.288189 14020 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.550s	user 0.002s	sys 0.009s
I20260709 13:16:28.266444 14044 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:16:28.306541 10394 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:28.317042 14065 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:28.317647 14065 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.286170 13771 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:16:28.328979 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.312410 13883 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.008s
W20260709 13:16:28.314019 14004 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
W20260709 13:16:28.370965 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53050.6us
I20260709 13:16:28.281088 13702 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.357084 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.379505 14055 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.379946 14055 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:28.380489 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 102270us
I20260709 13:16:28.380846 14055 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:28.381793 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:28.276968 14031 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:28.382208 14055 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.382586 14031 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:28.384022 14031 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.387856 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.388512 14054 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:28.392125 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:28.392310 10318 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:28.318020 14065 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.302380 13998 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:28.406386 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 145605us
W20260709 13:16:28.408047 10362 connection.cc:256] RPC call timeout handler was delayed by -1.1554150070001015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2801s for a response
W20260709 13:16:28.409565 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.395328 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 109941us
I20260709 13:16:28.413123 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:28.413605 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:28.424270 14075 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.424865 14075 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:28.425244 14075 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:28.428481 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 45602.1us
I20260709 13:16:28.430109 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:28.373540 13883 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:28.430738 14022 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.622s	user 0.013s	sys 0.006s
I20260709 13:16:28.454720 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:28.450861 14000 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.410400 13851 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.465306 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 51826.5us
W20260709 13:16:28.474184 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.458629 13969 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:28.467923 14000 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:28.503098 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 131564us
I20260709 13:16:28.488484 14022 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:28.537989 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 86415.8us
I20260709 13:16:28.537379 14044 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:28.539886 14044 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:28.540328 14044 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:28.541714 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 53953.8us
I20260709 13:16:28.542635 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:28.504154 14000 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.545239 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:28.542824 14061 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:16:28.536899 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 106868us
I20260709 13:16:28.560446 13938 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.561005 13938 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:28.561465 13938 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.537003 13969 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:28.579051 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:28.580257 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:28.571965 14085 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:28.559808 14050 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:16:28.589938 14038 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:28.591527 13998 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:28.593549 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:28.594842 13883 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:28.595559 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:28.597783 10248 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:28.598907 14026 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:28.599901 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:28.600566 10248 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.601418  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:28.600051 14041 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:28.553115 14071 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:16:28.603467 13851 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:28.603219 14026 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:28.606564 10994 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:28.523205 14043 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:28.564006 14076 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:28.670593 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 120258us
W20260709 13:16:28.670990 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 385258us
W20260709 13:16:28.680649 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 112254us
I20260709 13:16:28.583858 14022 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:28.691383 10290 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:28.697674 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 88042.1us
I20260709 13:16:28.563648 14042 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:16:28.649271 14076 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.682899 13994 consensus_meta.cc:287] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 13:16:28.716950 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:28.696307 14035 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:16:28.636574 13969 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:28.722992 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:28.607930 14050 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.731366 14050 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:28.733187 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:28.733893 10246 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:28.739598 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:28.747180 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 182222us
W20260709 13:16:28.751770 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 60547.7us
I20260709 13:16:28.750756 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:28.754832 10246 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:28.756062 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:28.728976 14033 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:28.715245 14076 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.766458 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:28.768685 14056 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.520s	user 0.004s	sys 0.000s
I20260709 13:16:28.769680 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:28.762133 14050 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:28.762367 13702 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:28.770339 14059 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:16:28.752475 14085 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.738750 13883 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:28.770928 14060 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:16:28.785707 14064 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:28.871156 14064 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:28.871905 14064 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.871441 14065 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.874863 14065 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:28.876624 14065 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:28.887585 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.892750 13938 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.894388 10249 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:28.896440 14040 consensus_meta.cc:287] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.002s
I20260709 13:16:28.897526 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:28.898357 10246 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.914600 14085 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:28.912545 10249 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:28.812407 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:28.814926 14086 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.916622 14086 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.777032 14022 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:16:28.819788 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 78972.4us
W20260709 13:16:28.919555 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 150001us
I20260709 13:16:28.760140 14088 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.921922 14087 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:28.923046 14088 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:28.922828 14087 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:28.923682 14088 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:28.924981 14088 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.815955 14035 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:28.787581 14033 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:28.722509 13994 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:28.926918 14077 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:16:28.926811 14049 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:28.928082 14078 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:16:28.967453 10394 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:28.968732 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:28.859344 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.936437 10248 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:28.824225 13702 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.925827 14087 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:28.984622 11002 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:28.953382 10994 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:28.951015 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.862571 14042 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:28.960841 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:29.001076 10398 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:28.962860 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.963742 10246 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:29.006989 10247 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:28.867888 14050 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:28.972802 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.970523 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:28.929870 14004 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:28.860141 14082 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:29.014012 11000 raft_consensus.cc:2410] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:16:29.013967 14050 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.015154 14004 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:29.016129 14004 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:28.972609 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:29.017795 10396 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:29.018199 14033 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.019685 13994 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:29.021575 14086 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:29.022163 14086 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.022636 14086 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.023515 14080 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:29.023950 14080 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:29.024682 14086 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:29.024794 14080 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.025920 14080 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.013916 14082 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:28.992372 10391 raft_consensus.cc:2368] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
I20260709 13:16:28.999173 10395 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:29.005790 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:28.963938 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:29.008522 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:29.009157 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 196841us
W20260709 13:16:28.973592 14037 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.002s
I20260709 13:16:28.974457 14091 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.909804 14044 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:28.966416 14022 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:29.046671 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:28.982172 13702 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.049878 10999 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:29.005990 14079 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 13:16:29.013871 14049 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:29.012976 14040 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:29.069082 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:29.069720 14040 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:29.070672 13695 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.782s	user 0.004s	sys 0.008s
I20260709 13:16:29.071115 13695 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.071885 14040 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:29.066103 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:29.072878 10997 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:29.031493 13938 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:29.073246 13695 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:29.068998 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:29.074162 10394 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:29.048487 14091 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:29.075170 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:29.075295 14004 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.075511 14091 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.076644 14091 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.077643 10997 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:29.078677 14082 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.079512 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:29.011400 14043 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:29.076789 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:29.083298 10994 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:29.085448 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:29.089778 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 327464us
I20260709 13:16:29.091015 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:28.980371 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 169039us
I20260709 13:16:29.067795 14022 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.067878 14049 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:29.103890 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.110785 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.051605 14037 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.096895 13917 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.100911 14022 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:29.109990 14075 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.007s
W20260709 13:16:29.119238 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 197807us
I20260709 13:16:29.123862 10390 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:29.116250 14043 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.132148 10290 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.143188 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:29.145247 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.148880 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.121642 14075 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.131695 13917 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:16:29.171193 14104 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.171540 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.172322 14058 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:29.177799 10362 leader_election.cc:400] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7.
I20260709 13:16:29.178187 10362 leader_election.cc:403] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.206688 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:16:29.208294 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51215.8us
I20260709 13:16:29.209381 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.166638 14099 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:29.140194 14049 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.205495 14042 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.227407 14100 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.205489 14074 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:16:29.227742 14096 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:29.228565 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:29.231029 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52068.5us
W20260709 13:16:29.231091 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 131481us
I20260709 13:16:29.232133 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.218894 14066 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.218014 13938 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:29.234205 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:29.229211 13695 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7.
I20260709 13:16:29.236935 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.181492 14043 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:16:29.239223 10290 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:29.240852 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:29.264494 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 88197.5us
I20260709 13:16:29.267776 14049 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.270495 14018 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.238081 13994 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:29.242933 14104 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:29.244704 14096 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:29.248852 14058 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:29.282625 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:29.240345 13938 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.286355 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:16:29.288345 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 55993.6us
I20260709 13:16:29.279632 14018 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.283969 14037 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:29.283497 14104 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:29.302460 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 65589us
I20260709 13:16:29.288116 14058 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.304955 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:29.278445 14087 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:16:29.287492 14107 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:29.307431 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.271446 14099 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:16:29.329259 14098 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
I20260709 13:16:29.331933 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:29.333140 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:29.334208 10290 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.292977 14018 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.330368 14102 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:29.349095 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.349429 14102 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.349882 14102 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.353521 14088 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.341286 13994 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.354636 13994 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:29.355046 13994 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:29.357334 14000 consensus_meta.cc:287] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.004s
I20260709 13:16:29.360364 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:29.361436 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:29.298714 13695 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:29.344444 13917 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.345697 14043 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:29.345885 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.309608 14058 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.305716 14093 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:29.445642 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 154353us
W20260709 13:16:29.381218 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47072.9us
I20260709 13:16:29.447307 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:29.370679 14028 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.458454 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2489) took 1045 ms. Trace:
I20260709 13:16:29.458873 10247 rpcz_store.cc:276] 0709 13:16:28.412675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.412849 (+   174us) service_pool.cc:224] Handling call
0709 13:16:29.458283 (+1045434us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540006efd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:29.458405 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352663296}
I20260709 13:16:29.453747 14112 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:29.454900 14099 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:29.382891 14074 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.460719 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:29.469758 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:29.460721 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:29.373178 14031 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:29.462802 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 702) took 1470 ms. Trace:
I20260709 13:16:29.372987 14040 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:29.325757 14064 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.382598 14107 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:29.470621 10243 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:29.470916 10241 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:29.472200 10249 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:29.472100 10390 rpcz_store.cc:276] 0709 13:16:27.992760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.992882 (+   122us) service_pool.cc:224] Handling call
0709 13:16:29.462559 (+1469677us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002dc654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:29.462724 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2531360512}
W20260709 13:16:29.546411 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 78824us
W20260709 13:16:29.464617 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 174093us
I20260709 13:16:29.560129 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.472740 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:29.383683 14075 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:29.556234 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:29.357767 14000 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:29.466068 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 133000us
W20260709 13:16:29.547165 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 77526.6us
I20260709 13:16:29.548779 10242 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:29.452067 13812 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:29.573237 10362 connection.cc:256] RPC call timeout handler was delayed by -1.0734980120000728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 13:16:29.573927 10362 connection.cc:256] RPC call timeout handler was delayed by -1.0473980120000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:16:29.465495 14112 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:29.581199 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:29.563819 13917 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:29.595382 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:29.565099 14031 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:29.585906 14076 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.004s
I20260709 13:16:29.584437 14075 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:29.603669 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:29.610160 10249 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:29.575448 14040 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:29.612020 14040 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:29.617022 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 55888.2us
I20260709 13:16:29.471774 14028 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:29.618196 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.588575 14112 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:29.634322 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 175596us
I20260709 13:16:29.635432 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:29.637681 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:16:29.616876 14095 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:16:29.602959 14113 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:29.618587 14023 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:29.593616 14100 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:16:29.618963 14075 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:29.619714 13917 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:29.619963 13883 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.451462 14096 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.469560 14104 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.641147 14111 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:29.621299 13695 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:29.620361 14076 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.647221 13938 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:29.647472 14075 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.677047 10390 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:29.645867 14023 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:29.678558 10246 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:29.913092 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:29.941829 10395 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:29.914129 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:29.786254 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 224295us
I20260709 13:16:29.943365 10393 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:29.915094 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:29.946455 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:29.947527 10323 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:29.815404 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.814419 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2494) took 1198 ms. Trace:
I20260709 13:16:29.982407 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:29.982904 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:29.983142 10323 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.983876 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:29.984194 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:29.984969 10325 raft_consensus.cc:2376] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8. Re-sending same reply.
I20260709 13:16:29.983178 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:29.987097 10325 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:29.987290 10321 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:29.989289 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:29.991010 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:29.991237 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:29.992659 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:30.005199 10323 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:30.019356 10396 raft_consensus.cc:2368] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
W20260709 13:16:29.695923 14110 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:16:29.957785 10250 rpcz_store.cc:276] 0709 13:16:28.605588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.605737 (+   149us) service_pool.cc:224] Handling call
0709 13:16:28.606110 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.645046 (+ 38936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.645094 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.665851 (+ 20757us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.045543 (+379692us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:29.045589 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.046499 (+   910us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.803869 (+757370us) raft_consensus.cc:1685] finished
0709 13:16:29.803896 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.804092 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35064,"raft.queue_time_us":74750,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7898,"spinlock_wait_cycles":608640,"thread_start_us":358368,"threads_started":1,"wal-append.queue_time_us":432257}
I20260709 13:16:29.919883 14122 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.711025 14119 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:16:30.022847 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:30.070988 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 430008us
I20260709 13:16:30.047802 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.048800 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:29.855224 14091 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.004s
W20260709 13:16:29.706540 14105 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 13:16:30.050871 13702 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.001s
W20260709 13:16:29.965497 13994 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.005s
W20260709 13:16:30.061699 14018 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.691s	user 0.001s	sys 0.009s
I20260709 13:16:30.053052 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:29.807895 14004 consensus_meta.cc:287] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.732s	user 0.008s	sys 0.004s
I20260709 13:16:29.922075 14115 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:29.695500 14082 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.767745 14104 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.706321 14101 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.487s
I20260709 13:16:29.703662 14118 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:30.048617 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 259054us
I20260709 13:16:29.696645 14064 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:30.069231 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:29.946569 14023 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.055727 10250 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:29.814985 14125 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.417s
I20260709 13:16:29.816583 14000 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:29.695732 14116 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:30.069931 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:29.695001 14109 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:16:29.656960 13883 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:29.942173 14088 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
W20260709 13:16:30.070742 14022 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.946s	user 0.011s	sys 0.002s
I20260709 13:16:30.110631 14022 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.113065 14022 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:30.070480 14049 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.000s
I20260709 13:16:30.082175 13994 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.114842 10394 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:30.115120 10245 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.116281 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1768) took 1159 ms. Trace:
I20260709 13:16:30.116451 14028 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:30.116693 10394 rpcz_store.cc:276] 0709 13:16:28.957454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.074860 (+117406us) service_pool.cc:224] Handling call
0709 13:16:30.116077 (+1041217us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003b97d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:30.116213 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389299072}
W20260709 13:16:30.078961 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 441326us
I20260709 13:16:30.080127 10317 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:30.080891 10390 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:30.124004 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1769) took 1165 ms. Trace:
I20260709 13:16:30.124374 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:30.084677 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:29.966178 14099 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:16:30.090504 14082 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:29.707291 13917 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.124485 10390 rpcz_store.cc:276] 0709 13:16:28.958511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.071425 (+1112914us) service_pool.cc:224] Handling call
0709 13:16:30.080651 (+  9226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.123652 (+ 43001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.123935 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:30.131042 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 92087us
I20260709 13:16:30.113826 14022 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:29.680500 14076 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.088610 10249 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:30.089331 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 455364us
I20260709 13:16:30.093042 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:29.815528 14123 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:30.060093 14113 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:30.093719 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:30.096403 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.096801 11002 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:30.097770 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.116308 13994 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:30.098001 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.098562 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.092188 10395 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:30.157888 11001 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.810756 13695 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.158195 10993 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.159837 13883 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:29.703456 14102 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.098891 14118 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:30.162111 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:30.162900 14058 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:16:30.084518 14115 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.787055 14031 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.085201 14018 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:30.109869 14042 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.872s	user 0.003s	sys 0.005s
I20260709 13:16:30.100600 14131 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:30.083626 13702 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.135321 10393 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:16:30.112995 14080 consensus_meta.cc:287] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.087s	user 0.011s	sys 0.000s
I20260709 13:16:30.147193 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:29.663877 14107 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.150121 10321 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:30.155109 10247 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.155296 10325 raft_consensus.cc:2376] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9. Re-sending same reply.
W20260709 13:16:30.108135 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.163550 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:30.163816 10994 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:30.164561 10996 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:30.076534 14122 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.164882 10390 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:30.144732 14028 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.087620 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.200421 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.169098 11001 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:30.172732 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.201346 11002 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.174163 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:30.182246 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 57921.6us
I20260709 13:16:30.156913 14127 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:30.196201 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 113723us
I20260709 13:16:30.171150 14115 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.202349 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.200659 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.205559 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.205761 10320 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:30.206063 10323 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:30.206197 10324 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:30.207151 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.207538 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.207748 10322 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.208164 10323 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:30.208894 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.209625 10317 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:30.209730 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 62722.1us
I20260709 13:16:30.210412 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.210966 10319 raft_consensus.cc:2376] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11. Re-sending same reply.
I20260709 13:16:30.211397 14141 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.208256 10324 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:30.215065 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.217486 10993 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:30.213949 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:30.221607 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.188117 14042 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.224860 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:30.163388 14058 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.227082 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.233098 10250 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:30.188225 14137 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:30.253060 10322 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:30.163057 14118 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.212641 14028 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.213073 14127 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:30.212637 14136 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.241833 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.222797 14076 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:30.257210 10320 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:30.262665 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:30.241086 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.264662 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:30.278967 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:30.267138 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:30.281574 10249 raft_consensus.cc:2393] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:30.282474 14071 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.254909 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:30.249626 14112 consensus_meta.cc:287] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 13:16:30.284787 10998 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:16:30.280577 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:30.252919 14137 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:30.266018 14127 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.298518 14137 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.255462 13994 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:30.187125 14131 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:30.301723 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69928.3us
I20260709 13:16:30.278648 13695 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:16:30.260859 14141 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:30.300753 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.305470 10316 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:30.303520 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.309829 10249 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.311076 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:30.312114 10249 raft_consensus.cc:2410] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:30.313148 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:30.294275 14042 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.290956 14071 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:30.300016 14088 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:30.323347 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 70654.7us
I20260709 13:16:30.326568 10250 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.329727 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 882) took 1393 ms. Trace:
I20260709 13:16:30.330376 10999 rpcz_store.cc:276] 0709 13:16:28.936308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.936529 (+   221us) service_pool.cc:224] Handling call
0709 13:16:30.329475 (+1392946us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54003cd054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:30.329645 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184091520}
I20260709 13:16:30.278108 14114 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:30.320636 14076 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:30.332135 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 112181us
I20260709 13:16:30.362586 11002 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:30.350042 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:30.367417 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:30.369206 10362 leader_election.cc:336] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.840s (SENT)
I20260709 13:16:30.369390 11002 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:30.355507 10317 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:30.285723 14136 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.377671 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:30.290550 14112 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.381688 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.388679 10316 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:30.390789 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:30.394672 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.395359 10325 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:30.380293 14102 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.392158 14076 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:30.324891 14133 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 13:16:30.425824 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.428156 14142 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:30.394330 13969 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:30.384217 13994 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:30.402876 14096 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:30.430085 14096 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:30.379091 14128 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:30.428073 14122 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:30.429558 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1767) took 1477 ms. Trace:
W20260709 13:16:30.424387 10213 connection.cc:256] RPC call timeout handler was delayed by -3.2293447580000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:16:30.407389 14028 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:30.437944 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 68768.4us
I20260709 13:16:30.383843 14141 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:30.305075 14113 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.416949 14091 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:30.438925 10396 rpcz_store.cc:276] 0709 13:16:28.952472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.053033 (+1100561us) service_pool.cc:224] Handling call
0709 13:16:30.072617 (+ 19584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.072860 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.072884 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.084206 (+ 11322us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.199430 (+115224us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:30.199466 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.199532 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.429359 (+229827us) raft_consensus.cc:1685] finished
0709 13:16:30.429378 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.429501 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":90506,"threads_started":1,"wal-append.queue_time_us":200980}
W20260709 13:16:30.444841 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 89685.7us
I20260709 13:16:30.422499 14018 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:30.447738 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:30.448400 10362 leader_election.cc:336] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.869s (SENT)
I20260709 13:16:30.455873 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.425232 13702 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.462707 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:30.440623 10213 connection.cc:256] RPC call timeout handler was delayed by -3.1787097230001109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2802s for a response
W20260709 13:16:30.468549 10213 connection.cc:256] RPC call timeout handler was delayed by -3.0933841940000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 13:16:30.473542 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.474175 10325 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.450222 14058 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.470369 14028 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:30.469518 14102 raft_consensus.cc:2764] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:30.480088 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:30.480747 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:30.483588 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.486577 13883 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:30.487106 13883 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.487476 13883 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.489203 14023 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.489420 14076 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.490409 13969 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:30.475394 14091 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:30.492738 14091 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.493449 10999 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:30.447106 14096 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.494669 14141 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.495935 14148 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:30.489216 14093 consensus_meta.cc:287] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.038s	user 0.002s	sys 0.010s
I20260709 13:16:30.497748 14093 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.498586 14131 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:30.498981 14152 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:16:30.503268 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 51509.6us
I20260709 13:16:30.438050 14128 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:30.509229 10288 leader_election.cc:336] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.560s (SENT)
I20260709 13:16:30.529035 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:30.509856 14058 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:30.558574 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54616.6us
I20260709 13:16:30.559902 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.562503 14044 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:30.599992 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 67609.2us
I20260709 13:16:30.512756 14128 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.510267 14156 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:16:30.542677 14042 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:16:30.608693 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87563.1us
I20260709 13:16:30.499431 14122 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:16:30.537849 13812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.001s	sys 0.016s
I20260709 13:16:30.623816 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.639087 10323 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.623745 14051 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:30.626993 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2500) took 1167 ms. Trace:
I20260709 13:16:30.642056 10246 rpcz_store.cc:276] 0709 13:16:29.459088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.459276 (+   188us) service_pool.cc:224] Handling call
0709 13:16:29.459539 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.946956 (+487417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.626730 (+679774us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540043dad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:30.626923 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503164160}
I20260709 13:16:30.630146 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 806) took 1157 ms. Trace:
I20260709 13:16:30.643162 10245 rpcz_store.cc:276] 0709 13:16:29.472261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.555699 (+ 83438us) service_pool.cc:224] Handling call
0709 13:16:29.556142 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.115595 (+559453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.629905 (+514310us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54002eb654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:30.630083 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285017984}
I20260709 13:16:30.631754 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.632463 13883 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.633265 14112 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.648839 10247 raft_consensus.cc:2410] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:30.634475 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.650099 10316 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.644889 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:30.642791 13812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.002s	sys 0.016s
I20260709 13:16:30.646989 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.609704 14055 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.646334 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:30.653139 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.657967 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.653971 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.654844 13969 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.646185 14000 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:30.664188 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.642560 14136 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:30.665792 10316 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:30.660645 14146 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.666538 14156 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.667681 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:30.656684 14042 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.683408 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.685215 10323 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:30.644083 14122 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:16:30.688946 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:30.691679 10324 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
W20260709 13:16:30.668457 14083 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.901s	user 0.000s	sys 0.016s
I20260709 13:16:30.708734 14136 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:30.648573 14058 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:30.716652 10325 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:30.726214 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 257023us
I20260709 13:16:30.678687 14113 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.680915 14000 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:30.721748 10323 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.662962 14055 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.727034 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:30.727888 10213 connection.cc:256] RPC call timeout handler was delayed by -2.9260447580002165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:16:30.747408 10325 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:30.747450 10213 connection.cc:256] RPC call timeout handler was delayed by -2.7261841939998703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:16:30.750021 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:30.748049 10213 connection.cc:256] RPC call timeout handler was delayed by -2.1960841939999227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
I20260709 13:16:30.769769 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.792200 10323 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.727566 14051 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.780267 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:30.794983 11002 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:30.796011 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.788184 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:30.788465 10997 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:30.788990 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:30.789242 11000 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:30.796968 11002 raft_consensus.cc:2368] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
W20260709 13:16:30.793567 10213 connection.cc:256] RPC call timeout handler was delayed by -1.8357931100001679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 13:16:30.798527 10213 connection.cc:256] RPC call timeout handler was delayed by -1.7896609050001189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2752s for a response
W20260709 13:16:30.798970 10213 connection.cc:256] RPC call timeout handler was delayed by -1.6782931100001406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:16:30.799364 10213 connection.cc:256] RPC call timeout handler was delayed by -1.6116931100002603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:16:30.799744 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5864931100002195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:16:30.748863 13969 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:30.800156 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5567931100001715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:16:30.800894 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5099931100000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:16:30.801187 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5099931100000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:16:30.801494 10213 connection.cc:256] RPC call timeout handler was delayed by -1.5034609050001109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.307s for a response
W20260709 13:16:30.801887 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4982931100000769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:16:30.802184 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4982931100000769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:16:30.802505 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4658931100002519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:16:30.802776 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4478931100002228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 13:16:30.803076 10213 connection.cc:256] RPC call timeout handler was delayed by -1.392993110000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 13:16:30.803346 10213 connection.cc:256] RPC call timeout handler was delayed by -1.392993110000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:16:30.748709 14023 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.804689 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:30.803683 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3353931100002683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 13:16:30.788467 14167 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:16:30.807865 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3200931100002435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:16:30.811754 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3200931100002435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:16:30.812557 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0563931100002719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24260000000000004s for a response
I20260709 13:16:30.814214 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.814563 10325 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:30.815233 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:30.931057 10323 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
W20260709 13:16:30.887269 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.816493 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:30.933261 10249 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:30.835455 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.932492 10323 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:30.825912 11001 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.935348 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:30.804502 13969 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.796444 14136 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.896577 14173 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:16:30.897212 14137 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.003s
W20260709 13:16:30.887495 14171 log.cc:927] Time spent T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:16:30.884806 14161 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:16:30.941612 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:30.972672 10323 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.945395 14128 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:30.891355 14075 consensus_meta.cc:287] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.849s	user 0.013s	sys 0.000s
I20260709 13:16:30.810931 13883 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:30.815225 14000 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:30.846814 14127 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:16:30.938642 13969 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.951908 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:30.940028 14136 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:30.959033 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:30.960655 14115 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:16:30.960584 14041 raft_consensus.cc:3055] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:30.963454 14066 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.895581 14162 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 13:16:30.886897 14170 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:16:30.883901 14165 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:30.943091 14055 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:30.982003 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:30.989234 10288 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 2.052s (SENT) [suppressed 44 similar messages]
I20260709 13:16:30.850696 14031 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 13:16:30.806723 14051 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.973533 14137 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.017907 14137 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.994346 14115 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.020435 10995 raft_consensus.cc:2368] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:31.020599 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:31.021502 14115 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:30.991604 14041 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:31.023993 10996 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.992660 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:30.994860 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:30.984073 14076 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:30.995086 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:31.022614 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:31.048291 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53485.2us
I20260709 13:16:31.050861 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:31.055436 11001 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:31.071910 10997 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:31.071939 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.073472 10247 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:30.990849 14127 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.023656 14000 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.055200 14031 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:31.085187 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.099411 10322 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.987742 13998 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:16:31.054502 14161 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:30.986161 14075 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:30.992365 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.049768 14113 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:31.083988 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 91436.8us
I20260709 13:16:31.106976 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:31.072341 14033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.051s	user 0.017s	sys 0.035s
I20260709 13:16:31.055060 14076 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:31.118043 14076 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.099694 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.121140 10247 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 5.
I20260709 13:16:31.069780 14115 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.069201 14139 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:31.061146 14112 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.109578 10249 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:31.113891 14146 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:31.076439 14041 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:30.995158 14066 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.106628 14031 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:31.130532 10322 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:31.109503 14113 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:31.121766 14033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.100s	user 0.017s	sys 0.035s
I20260709 13:16:31.162884 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:31.165351 10321 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:31.161155 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:31.167060 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 60160.1us
I20260709 13:16:31.088454 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:31.171593 10995 raft_consensus.cc:606] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.172065 10995 raft_consensus.cc:614] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.134950 14115 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:31.176772 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.172695 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.188434 10996 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:31.197749 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:31.198719 10321 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:31.161551 14113 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.168642 14058 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.213543 10213 leader_election.cc:400] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:16:31.214763 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:31.215801 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 894) took 1011 ms. Trace:
I20260709 13:16:31.169044 14112 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.216331 10993 rpcz_store.cc:276] 0709 13:16:30.204321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.218381 (+ 14060us) service_pool.cc:224] Handling call
0709 13:16:30.255829 (+ 37448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.256376 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:30.362747 (+106371us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.609685 (+246938us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.632742 (+ 23057us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.632878 (+   136us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:30.632911 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.632979 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.215532 (+582553us) raft_consensus.cc:1685] finished
0709 13:16:31.215556 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.215729 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11405,"prepare.queue_time_us":171815,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":12064,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":4948,"thread_start_us":245806,"threads_started":2,"wal-append.queue_time_us":306388}
I20260709 13:16:31.219841 10323 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:31.229346 10997 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.232486 14137 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:16:31.232975 10242 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:31.233757 10321 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [6.9-8.10]
I20260709 13:16:31.234247 10242 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:31.235330 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 777) took 1137 ms. Trace:
I20260709 13:16:31.235842 10996 rpcz_store.cc:276] 0709 13:16:30.098291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.200448 (+102157us) service_pool.cc:224] Handling call
0709 13:16:31.235185 (+1034737us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54003f7fd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:31.235277 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883417344}
W20260709 13:16:31.239523 14156 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.517s	user 0.002s	sys 0.016s
I20260709 13:16:31.240137 14156 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.230572 14136 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.241986 14115 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.243244 14075 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.245623 14051 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.246466 14058 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.249554 14058 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.259177 10995 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.264333 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 771) took 1168 ms. Trace:
I20260709 13:16:31.264729 10994 rpcz_store.cc:276] 0709 13:16:30.095494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.095632 (+   138us) service_pool.cc:224] Handling call
0709 13:16:30.095956 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.192511 (+ 96555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.264011 (+1071500us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54007503d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:31.264243 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155456768}
I20260709 13:16:31.266695 14076 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:31.268079 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.271142 10248 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:31.272017 14066 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.273406 10248 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.217867 13998 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:31.149044 14177 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:16:31.287178 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 72518.6us
I20260709 13:16:31.290536 10213 leader_election.cc:400] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:31.290921 10213 leader_election.cc:403] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.291544 14139 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:31.283535 13998 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:31.309160 10247 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.289090 14128 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:31.313048 10247 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.302755 14075 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:31.314422 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.305148 14033 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.319466 10247 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.322872 14187 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.323457 14187 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.325922 14187 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.311558 14040 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.330314 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.326356 13998 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.285454 14031 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.332001 13998 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.331497 14192 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.331573 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.333729 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.334738 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.335482 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.337823 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.341107 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.341925 10391 raft_consensus.cc:2368] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
I20260709 13:16:31.317665 14127 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:31.341001 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.321108 14156 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.350196 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.350677 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.351400 10393 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.321276 14136 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.358527 10398 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.326400 14185 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:31.341830 14031 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.363286 10394 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:31.365077 10396 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:16:31.350826 14128 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:31.370203 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:31.326483 14139 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.9, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.337293 14040 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.382380 10399 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:31.383167 10213 leader_election.cc:400] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:16:31.384923 10213 leader_election.cc:403] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.388208 10396 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:31.384594 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.369328 14127 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.379300 14128 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:31.392036 14065 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.400508 13969 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.360101 14156 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.416566 14156 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.382263 14076 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:31.418828 10394 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:31.420398 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.421236 10396 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.421511 14112 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.422221 10242 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:31.411345 14040 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.412786 14037 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.426108 14190 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:31.426038 14037 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:31.413839 14194 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:31.425384 14075 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:31.393499 14033 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:16:31.393671 14189 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:31.391120 14192 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 4. Current term is 5.
I20260709 13:16:31.433148 14189 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:31.433279 14192 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:31.433684 14189 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:31.408939 14128 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:31.435060 14189 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.436733 14189 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:31.408748 14065 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:31.433789 14192 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:31.440186 14192 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.365342 14136 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.438723 14065 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.447290 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.390087 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:31.445266 14136 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:31.431486 14037 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.450739 10397 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.450968 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.458184 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:31.458715 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68686.5us
I20260709 13:16:31.460273 10398 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.461009 10396 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:31.462885 14075 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.469015 14192 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.474220 14114 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:31.474812 14114 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:31.475618 14114 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.475986 11000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0de4147226834030b0fd22d4a0948990"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:31.476603 11000 raft_consensus.cc:606] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.476682 14041 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.476614 14114 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.479795 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 781) took 1102 ms. Trace:
W20260709 13:16:31.480406 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.481050 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.481666 14042 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:31.482164 14042 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.482612 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.483063 11000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:31.483654 11000 raft_consensus.cc:606] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.483829 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:31.487074 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.377876 10393 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:31.483413 10399 raft_consensus.cc:2410] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:16:31.489828 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.480192 10999 rpcz_store.cc:276] 0709 13:16:30.377130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.377252 (+   122us) service_pool.cc:224] Handling call
0709 13:16:30.392582 (+ 15330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.493852 (+101270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.479579 (+985727us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54004f3654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:31.479741 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231514880}
I20260709 13:16:31.492614 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.493456 10398 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
W20260709 13:16:31.495487 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.417972 14113 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.495333 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.497889 10393 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:16:31.498613 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.499938 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.500043 13969 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.500149 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:31.506369 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.498515 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.508373 14042 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.514402 11000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:31.515067 11000 raft_consensus.cc:606] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.515439 11000 raft_consensus.cc:614] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.539808 10213 leader_election.cc:400] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8.
I20260709 13:16:31.539999 11001 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:31.543722 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.545070 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:31.545977 14076 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.547027 14076 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:31.547490 14076 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:31.547951 14076 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:31.560715 10213 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.052s (SENT)
I20260709 13:16:31.572278 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.540987 14112 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:31.576124 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.581739 14096 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:31.582973 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 101550us
I20260709 13:16:31.576135 14043 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:31.576475 14033 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.576253 14185 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.584529 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.586826 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:31.577916 14128 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.595690 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:31.598295 10965 leader_election.cc:400] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
I20260709 13:16:31.598774 10965 leader_election.cc:403] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.587517 14082 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.595580 14075 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.597728 14112 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:31.608637 14174 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.731s	user 0.000s	sys 0.002s
I20260709 13:16:31.587284 14096 consensus_queue.cc:1243] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:31.615381 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1664) took 1356 ms. Trace:
I20260709 13:16:31.615473 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:31.593423 14091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.002s	sys 0.016s
I20260709 13:16:31.582397 14193 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:16:31.615867 10245 rpcz_store.cc:276] 0709 13:16:30.259380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.648144 (+388764us) service_pool.cc:224] Handling call
0709 13:16:30.648458 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.648662 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.648686 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.650868 (+  2182us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.749507 (+ 98639us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:30.749545 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.749610 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.608315 (+858705us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b24001151a8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a3a09d 00007f58c366c10e 00007f58c368388c 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221
0709 13:16:31.611046 (+  2731us) raft_consensus.cc:1685] finished
0709 13:16:31.611066 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.615317 (+  4251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52015488,"thread_start_us":82190,"threads_started":1,"wal-append.queue_time_us":141686}
I20260709 13:16:31.614305 14127 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:31.614522 14112 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:31.622654 14127 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:31.623209 14112 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.623647 14127 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.626264 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.627185 10390 raft_consensus.cc:2410] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:16:31.617921 14091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.003s	sys 0.016s
I20260709 13:16:31.613615 14139 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.636018 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 767) took 3379 ms. Trace:
I20260709 13:16:31.619031 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.593773 14043 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.636615 10998 rpcz_store.cc:276] 0709 13:16:28.256255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.256352 (+    97us) service_pool.cc:224] Handling call
0709 13:16:29.309200 (+1052848us) spinlock_profiling.cc:243] Waited 895 us on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3eee 0000000000375939 00007f58c8a371e0 00007f58c8b000c4 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:16:29.309414 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.287513 (+978099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.635607 (+1348094us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54005a1c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:31.635920 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244473600}
I20260709 13:16:31.619154 14041 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
I20260709 13:16:31.619539 14188 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.620339 14087 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.597322 14185 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.652053 14043 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:31.652191 14065 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.658707 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:31.660063 14113 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.661542 14128 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:31.661973 14065 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:31.663546 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 44630.3us
I20260709 13:16:31.665731 10245 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:31.665911 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:31.670004 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.671057 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.673832 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.675488 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:31.676932 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.677253 10245 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.677512 10243 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:31.678764 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:31.679095 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.679579 10247 raft_consensus.cc:2368] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
W20260709 13:16:31.678802 14183 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.394s	user 0.003s	sys 0.000s
I20260709 13:16:31.682476 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.683343 10248 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:16:31.674731 10241 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:31.690696 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.658746 14087 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.726552 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:31.726123 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 130500us
I20260709 13:16:31.668202 13695 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:31.667495 14075 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.669901 14188 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:31.729837 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:31.749080 14075 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.749953 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:31.669584 14139 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.751345 14075 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.752051 14042 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:31.752418 14121 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:31.752624 14042 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:31.752884 14121 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.753263 14121 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:31.755915 14076 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.759879 14087 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:31.761924 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:31.730189 14185 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:31.765185 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 603870us
I20260709 13:16:31.766302 14107 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:31.766779 14107 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:31.767586 14107 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.768635 14107 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.669376 14135 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:16:31.770870 14135 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:31.771715 14135 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:31.772117 14135 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.772485 14135 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.774421 14122 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:31.774835 14122 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:31.683228 13969 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:16:31.670176 14050 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:16:31.732991 10248 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:31.789525 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:31.790030 10247 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:31.790428 10999 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.741256 14115 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:31.741739 10967 leader_election.cc:400] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
W20260709 13:16:31.792681 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51082.5us
I20260709 13:16:31.733899 14102 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:16:31.745124 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.748373 13695 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.729178 14175 raft_consensus.cc:993] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:16:31.779058 14100 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:31.780583 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:31.781081 10390 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.781464 10241 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:31.781374 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.786669 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:31.671489 14113 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:16:31.789505 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:31.802704 10998 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:31.791610 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.796267 10243 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:16:31.797535 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.803732 10243 pending_rounds.cc:85] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:31.804100 10243 pending_rounds.cc:107] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:16:31.804468 10243 raft_consensus.cc:2889] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.804842 10243 pending_rounds.cc:107] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:16:31.805151 10243 raft_consensus.cc:2889] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.805573 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:31.807227 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.807788 10999 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:31.808056 10397 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:31.805222 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.781486 14022 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:31.813392 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:31.813901 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.816241 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.816326 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.819033 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.817981 14122 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.827962 14041 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:31.828400 14041 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:31.829219 14041 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.798208 13695 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.753619 14042 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.832231 10248 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:31.798802 14076 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:31.838318 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.837168 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.842748 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:31.843907 10362 leader_election.cc:400] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:31.844058 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.844901 10394 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:31.845861 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.846063 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:31.847781 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 620) took 1146 ms. Trace:
I20260709 13:16:31.848176 10362 leader_election.cc:403] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.843474 11000 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
W20260709 13:16:31.850713 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.852101 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.819032 14082 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.853943 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.860965 10396 raft_consensus.cc:2410] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:31.863780 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.848404 10325 rpcz_store.cc:276] 0709 13:16:30.701713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.936274 (+234561us) service_pool.cc:224] Handling call
0709 13:16:30.982629 (+ 46355us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:30.991969 (+  9340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.992007 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:31.080892 (+ 88885us) log.cc:844] Serialized 78 byte log entry
0709 13:16:31.206800 (+125908us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:31.338502 (+131702us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.847036 (+508534us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.847330 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.847432 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.847499 (+    67us) raft_consensus.cc:1685] finished
0709 13:16:31.847518 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.847707 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":507941,"prepare.queue_time_us":78955,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":4686,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":82010,"thread_start_us":133776,"threads_started":2,"wal-append.queue_time_us":202200}
I20260709 13:16:31.825073 14040 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:31.856477 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.866556 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:31.866820 10398 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.867395 10397 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:31.857213 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:31.868516 10397 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.869820 10397 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:31.870070 10392 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:31.814951 14022 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:31.824013 14139 raft_consensus.cc:1081] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:16:31.859661 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:31.878676 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 84441.3us
I20260709 13:16:31.911409 10398 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:31.915405 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:31.880376 14175 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:31.882520 14133 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:31.885098 14048 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.885707 14114 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.887481 14115 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:31.891912 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.898523 14043 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:31.908720 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:31.919703 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:31.922961 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.939042 10248 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:31.823823 14031 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:16:31.856791 14041 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:31.939680 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.938464 10245 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:31.946097 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.946943 10317 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.946841 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.947907 10316 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.908372 14102 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.847028 14188 consensus_queue.cc:1059] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:16:31.936075 14211 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:16:31.922500 14074 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.845649 14146 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:16:31.932252 14133 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:31.931041 14068 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.961352 10320 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:31.922300 14087 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:31.940779 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.970525 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.971606 10322 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 13:16:31.938651 14114 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.972729 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.973255 14074 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.962208 14102 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:31.975634 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1659) took 1822 ms. Trace:
I20260709 13:16:32.007777 10250 rpcz_store.cc:276] 0709 13:16:30.153569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.267314 (+113745us) service_pool.cc:224] Handling call
0709 13:16:30.267554 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.327212 (+ 59658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.975333 (+1648121us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b54002ebb54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:31.975560 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135186176}
I20260709 13:16:31.977322 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 784) took 1180 ms. Trace:
W20260709 13:16:31.977672 14189 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.001s
I20260709 13:16:32.009141 11001 rpcz_store.cc:276] 0709 13:16:30.796977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.070426 (+273449us) service_pool.cc:224] Handling call
0709 13:16:31.070850 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.540659 (+469809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.976993 (+436334us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540048c6d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:31.977243 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078292864}
I20260709 13:16:31.969920 14043 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:16:31.978295 10249 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:31.992883 10317 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:31.902112 14082 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:31.998711 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:32.006481 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.005237 10316 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:32.011312 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:32.012470 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 169262us
I20260709 13:16:32.025352 10248 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:32.027958 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 91319.7us
I20260709 13:16:32.024430 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.029521 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.030217 10320 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:31.966112 14040 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.030165 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:32.038745 10316 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:32.031564 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:31.921641 14022 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.032428 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:32.029652 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:32.006316 14027 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.052639 10320 raft_consensus.cc:1217] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[8.7-11.8]   Dedup: 8.7->[11.8-11.8]
I20260709 13:16:32.053381 10318 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:32.053414 10320 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [8.7-11.8]
I20260709 13:16:32.053936 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:31.984259 14156 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:16:32.004092 14132 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:16:32.029832 14113 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.038998 10241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:54378
I20260709 13:16:32.065725 10241 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.005020 14068 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.066293 10241 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:32.000681 13695 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.007272 14087 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.056758 14223 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.040446 14097 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:32.090358 14080 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:32.090998 14080 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.061064 14054 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:32.091956 14054 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.092197 14018 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:32.092373 14054 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:32.092628 14018 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:32.095656 10395 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:32.096602 14223 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.097648 14223 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.052121 14133 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.099939 13812 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.100546 13812 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.103623 14114 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.103840 14135 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.072218 14113 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:32.105917 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.106390 14113 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.108629 14087 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.110118 14102 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.110484 14031 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:32.111420 14031 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:32.111481 10325 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.111860 14031 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.112821 14031 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.113953 14031 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.055577 14027 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.129019 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.129875 10243 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:32.130617 10250 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:32.101722 13812 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.131093 14027 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.088258 14082 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.089054 13695 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.100656 14133 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.114152 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 617) took 1448 ms. Trace:
W20260709 13:16:32.120981 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.121345 10398 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:32.146409 10398 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.086467 14040 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.123732 14068 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.070168 14022 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.060269 14222 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:32.085813 14074 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.125922 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.093614 14018 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.158778 10241 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.106048 14135 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.132232 10967 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:32.128636 10399 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:32.178113 11001 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:16:32.144654 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 289075us
I20260709 13:16:32.131625 13812 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.145414 10324 rpcz_store.cc:276] 0709 13:16:30.665977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.791616 (+125639us) service_pool.cc:224] Handling call
0709 13:16:30.957243 (+165627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.957690 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:30.957965 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.074829 (+116864us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.096528 (+ 21699us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.096734 (+   206us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.102826 (+  6092us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.103108 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.103206 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.468107 (+364901us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b1800410680. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:31.471034 (+  2927us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b1800410680. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09c92a6 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1
0709 13:16:31.471486 (+   452us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b1800410680. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:31.491290 (+ 19804us) raft_consensus.cc:1685] finished
0709 13:16:31.491310 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.779538 (+288228us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b1800410680. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09c92a6 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1
0709 13:16:31.780845 (+  1307us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b1800410680. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:32.113974 (+333129us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540020a650. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:32.114091 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":323446,"prepare.queue_time_us":8386,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":4803,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":9716,"spinlock_wait_cycles":398654336,"thread_start_us":116363,"threads_started":1,"wal-append.queue_time_us":159633}
I20260709 13:16:32.155251 10247 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
W20260709 13:16:32.159440 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 132184us
I20260709 13:16:32.161348 10325 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:32.067478 14146 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:16:32.129093 14177 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.171106 14076 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:32.173309 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.185182 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:32.187145 11002 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:32.189265 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:32.199450 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:32.211529 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:32.192373 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:32.212493 10999 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:32.150216 14093 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.212215 10243 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.154721 14222 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:32.182946 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.217980 10244 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:32.221691 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.222952 10250 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:32.175092 14068 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.206456 14177 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:32.228174 10250 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:32.228065 14177 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.229264 14177 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.231046 11000 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:32.230919 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2508) took 1583 ms. Trace:
I20260709 13:16:32.232442 14023 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.231647 10246 rpcz_store.cc:276] 0709 13:16:30.647664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.109824 (+462160us) service_pool.cc:224] Handling call
0709 13:16:31.110138 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.286036 (+175898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.286068 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.293593 (+  7525us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.552778 (+259185us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.552819 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.230512 (+677693us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b540006ead4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:32.230564 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.230614 (+    50us) raft_consensus.cc:1685] finished
0709 13:16:32.230632 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.230848 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24410,"raft.queue_time_us":140109,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":16260,"spinlock_wait_cycles":80814080,"thread_start_us":340198,"threads_started":2,"wal-append.queue_time_us":275541}
I20260709 13:16:32.232887 14023 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:32.148231 14027 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:16:32.203651 14175 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:32.235553 14175 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.235960 14175 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:32.207324 14082 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:32.240409 14139 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.240944 14139 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:32.207072 13851 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:16:32.243374 13851 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.243727 13851 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:32.243844 14041 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.244441 14041 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.244601 13851 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.245836 13851 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.248562 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.215763 14093 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:32.251631 14068 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.254581 14080 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.242018 14139 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.193077 13695 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:16:32.256850 14139 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.218556 14188 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:32.253997 14068 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.258982 14188 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.226150 14222 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.214955 14121 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.288183 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:32.209239 14132 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:16:32.334563 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.335783 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:32.294874 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:32.337255 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.337702 10249 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.270147 14115 consensus_queue.cc:1059] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:32.312907 13695 raft_consensus.cc:3055] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.313814 14122 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.273422 14188 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.314522 13969 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.315501 14221 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.317772 14093 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.319051 10244 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:32.322877 14050 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:32.361344 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.361438 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.361814 14050 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.323983 14220 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:32.362130 10321 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:32.362766 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:32.324554 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 151363us
I20260709 13:16:32.325060 14076 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.328104 10398 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.329972 14041 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.330471 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.376299 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.333987 14018 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.337335 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.285157 14121 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.339643 10243 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:32.380085 10398 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.344295 14132 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.347090 10320 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:32.350544 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.404408 10250 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:32.352468 11000 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:32.355016 10241 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:32.363933 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 362247us
I20260709 13:16:32.409274 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:32.368158 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:32.368360 11002 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:32.361545 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.415738 10244 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:32.376855 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:32.295969 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.382748 10246 raft_consensus.cc:2393] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:32.383476 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.387799 10249 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
W20260709 13:16:32.423563 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 46799.1us
I20260709 13:16:32.424609 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:32.425693 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:32.428831 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.434679 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.435215 10316 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:32.435379 10320 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:32.436383 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.436398 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.437045 10320 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 5.
I20260709 13:16:32.437876 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:32.348505 13695 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.439055 13695 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.440392 13695 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.406006 14042 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:16:32.445302 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.404410 14091 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:16:32.446645 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.401580 10245 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:32.434679 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.449088 10316 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.449841 10398 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:16:32.379696 14054 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:32.396821 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.455360 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:32.450922 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:32.460096 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:32.451279 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.462097 10322 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:32.436632 14222 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.464982 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.398459 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:32.466593 10321 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:32.468717 10399 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:32.457899 11002 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:16:32.452350 10324 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:32.412981 14093 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.472482 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:32.460914 10397 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:16:32.473465 10397 pending_rounds.cc:85] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 4
I20260709 13:16:32.473807 10397 pending_rounds.cc:107] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:16:32.474120 10397 raft_consensus.cc:2889] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.476046 10320 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.463156 10398 pending_rounds.cc:85] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 9
I20260709 13:16:32.477115 10398 pending_rounds.cc:107] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:16:32.462574 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.478672 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:32.479372 10395 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:32.393643 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.477947 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.479619 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 81295.1us
I20260709 13:16:32.479578 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:32.480713 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.451704 14189 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:32.485773 10996 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:32.483853 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:32.461357 14022 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.460405 14031 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.489758 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.460975 13812 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.482792 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.496701 10322 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:32.491374 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.483951 10316 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:32.494184 10324 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:32.492184 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:32.498502 10323 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:32.499193 10316 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:16:32.447645 14076 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.489514 10319 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:32.482389 14185 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:32.542755 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 60037.8us
I20260709 13:16:32.543601 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.379142 14221 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.500988 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:32.535751 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44483.1us
I20260709 13:16:32.491490 10398 raft_consensus.cc:2889] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:32.539314 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 55536.3us
I20260709 13:16:32.548863 10322 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:32.549340 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.551072 10323 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:32.486167 14231 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.492776 14022 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.555830 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.543004 14132 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.486006 14040 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:16:32.538051 14075 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.486232 14228 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.594499 10391 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:32.598842 10320 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:32.598999 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:32.491701 14066 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:16:32.603349 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.555543 14226 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:32.604905 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.492288 14220 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:16:32.604658 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:32.555353 14219 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:32.594439 14027 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:16:32.690699 10323 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:32.466686 14050 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.466508 14023 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.545873 14230 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.659581 14133 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.675207 14138 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:32.564419 14022 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.667399 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.559856 14146 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.628934 10321 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:32.673076 10322 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:32.672158 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 69194.4us
I20260709 13:16:32.681177 10324 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:32.720906 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:32.565461 14191 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.681137 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82263.9us
I20260709 13:16:32.538556 13812 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.564800 14233 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:32.629336 14135 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:16:32.596127 14043 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.597661 14076 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.636525 14102 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.636703 14097 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:16:32.665686 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:32.732363 10320 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:32.555769 14175 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.685144 14082 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:32.714643 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:32.715960 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48687.8us
I20260709 13:16:32.566049 14099 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:16:32.689360 10245 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:32.743055 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.706555 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:32.726794 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:32.722735 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:32.674549 14068 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:32.691538 14228 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.735654 10244 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:16:32.740625 10320 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:32.741575 10241 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 5.
W20260709 13:16:32.767279 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 60826.7us
I20260709 13:16:32.745786 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.770977 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:32.773366 14246 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:32.773586 14113 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:32.774245 14113 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.774948 10245 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:32.775763 14097 consensus_queue.cc:1243] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:32.761633 14040 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:32.766777 14037 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:32.777336 14037 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:32.777758 14037 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:32.716970 14074 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:16:32.735499 14226 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:32.778995 14240 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:16:32.719666 14138 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.731137 14080 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:16:32.782464 14138 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.735648 14191 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.752069 14102 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.783502 13812 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.785000 14191 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.785233 14102 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.735744 14233 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.636617 14132 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.703205 14003 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:16:32.787307 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:32.732523 14219 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.791921 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.725241 14076 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.795737 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:32.715142 14133 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.719201 14075 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:16:32.807097 14108 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:32.790535 14082 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.794124 14054 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.794704 14146 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:32.844553 14146 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.845168 14146 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.794312 14230 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:32.846156 14230 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.846823 14230 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:32.849015 13851 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.582s	user 0.002s	sys 0.006s
I20260709 13:16:32.846212 14133 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:32.850142 10316 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:16:32.850546 10316 pending_rounds.cc:85] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 6
I20260709 13:16:32.850765 10316 pending_rounds.cc:107] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:16:32.802299 13812 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:16:32.851240 10316 raft_consensus.cc:2889] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.789721 14043 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.831804 10323 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:32.852720 14254 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:32.815857 14080 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:32.853320 14254 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:32.852579 14043 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:16:32.837252 14003 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:32.854434 14254 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.790403 14102 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.843539 14113 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.850744 14132 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.853291 14080 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:32.855702 14102 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.856705 14080 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.801903 14251 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:32.843745 14093 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:32.858067 14068 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.858363 14093 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.854508 13812 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:32.858564 14068 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:32.858819 14093 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.859087 13812 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:32.859506 14068 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.860045 13812 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:32.862747 14122 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 13:16:32.810213 14220 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.863353 10390 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:32.863926 14228 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.864500 14022 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.829671 14082 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:32.867038 14082 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.867491 14022 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.868445 14082 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.832211 14221 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:32.857834 14102 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:32.875548 13969 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:16:32.876077 13969 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.877506 14075 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:32.878110 14075 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.751669 14189 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:32.879590 14189 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.880327 14075 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.862653 14031 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.805399 14076 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.809609 14222 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:32.829290 14097 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:32.934937 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:32.918522 14018 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.518s	user 0.001s	sys 0.008s
I20260709 13:16:32.910621 10249 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:32.950080 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.952643 10247 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:32.956924 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.797636 14231 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
W20260709 13:16:32.962057 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.922719 14245 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:16:32.968271 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.969249 10248 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:32.804497 14219 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:32.963177 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:32.934749 14097 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:32.990808 14097 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:32.992434 14097 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:32.962186 14185 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:32.995096 14185 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.003626 10244 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:33.004861 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 240228us
W20260709 13:16:33.005448 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.858577 14251 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 13:16:32.946288 14146 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.019517 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:33.022557 11000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.010s
W20260709 13:16:33.022938 11000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.008s	sys 0.010s
I20260709 13:16:33.006328 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:33.008253 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.008430 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:33.009478 14091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.011s
I20260709 13:16:33.026718 10998 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:33.028468 10997 raft_consensus.cc:2410] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:33.035060 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:33.014127 14233 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.037874 10967 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:33.026386 14091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.007s	sys 0.011s
I20260709 13:16:33.045420 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:33.046727 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:33.049484 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:33.050279 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:33.009668 14093 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.042407 14226 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:33.034693 14250 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.042140 14022 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:33.017197 14255 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:33.066546 10393 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:33.054980 14075 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.050424 14175 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:33.075196 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.062211 14188 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
I20260709 13:16:33.079497 14220 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.080083 14220 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.083798 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:33.083930 14037 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.085134 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:33.088138 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.091280 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:33.042018 14221 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.088256 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:33.096987 10244 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:33.098498 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 371745us
W20260709 13:16:33.094758 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 264181us
I20260709 13:16:33.102376 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:33.099345 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:33.094318 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.077785 14258 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.105520 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.108459 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.089145 14251 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:33.111187 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 322578us
I20260709 13:16:33.092464 14250 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.115370 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:33.094081 14220 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:33.062426 14230 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.120260 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:33.122166 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:33.094569 14102 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:33.125859 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:33.168808 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.168087 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.088979 14022 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.068328 14259 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:16:33.123791 10137 maintenance_manager.cc:419] P 07026dacaf3c454eb902b449c5c122fe: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033358
I20260709 13:16:33.167428 14108 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.114661 14132 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.086748 14188 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.126561 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:33.179262 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:33.179874 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.210587 10321 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.153756 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.115701 14037 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:33.183575 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:33.116861 14231 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:33.186343 10997 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:33.125378 14226 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:33.125646 14233 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.112434 14258 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.111979 14247 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:16:33.110915 14075 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:16:33.200126 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.175371 14102 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.180485 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:33.110412 14221 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.214675 10322 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.172674 14091 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:33.187297 14263 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:33.200225 14219 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:33.126529 14256 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.204911 14018 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:16:33.241858 14266 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.248404 14099 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.264215 14099 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.265413 10244 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:33.266171 10395 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:33.267467 10967 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:33.245698 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 154305us
I20260709 13:16:33.253770 10318 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:33.247571 10393 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:33.270455 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:33.247059 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:33.220680 14231 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.255908 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 55860.3us
I20260709 13:16:33.252058 14269 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.196746 14260 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:16:33.285267 14177 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.056s	user 0.013s	sys 0.000s
I20260709 13:16:33.239364 14258 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.188107 14264 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:33.279904 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:33.277455 14271 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.302299 14269 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.210215 14108 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.285319 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:33.303951 10249 raft_consensus.cc:2393] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:33.261113 14261 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:16:33.289661 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:33.242125 14146 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:33.297701 14102 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.277753 14185 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.298967 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:33.288501 14219 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.257580 14233 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.292492 14175 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:33.247875 14022 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.259850 14189 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:33.311852 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:33.312386 10321 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:33.315508 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:33.266496 14263 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:33.352717 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.352989 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:33.323644 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.320035 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.316763 10393 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:33.292903 14251 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:33.289767 14231 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.368881 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.369833 11002 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:33.293649 10244 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:33.344558 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:33.346486 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:33.371193 10325 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.353396 10997 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:33.373040 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.317021 14221 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.334534 14256 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.353227 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.303689 14177 consensus_queue.cc:1059] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:16:33.303787 14254 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:16:33.345731 14189 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:33.352468 14191 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.358534 14022 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.338877 14091 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:16:33.364763 14175 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:33.338660 14185 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.374617 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.374699 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:33.415884 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 90911.5us
I20260709 13:16:33.376680 14099 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.377724 10396 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:33.395525 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2538) took 1035 ms. Trace:
I20260709 13:16:33.420838 10250 rpcz_store.cc:276] 0709 13:16:32.359982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.421036 (+ 61054us) service_pool.cc:224] Handling call
0709 13:16:32.443534 (+ 22498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.626522 (+182988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.626570 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.635651 (+  9081us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.999129 (+363478us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:32.999203 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.999303 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.395300 (+395997us) raft_consensus.cc:1685] finished
0709 13:16:33.395318 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.395459 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21055,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5650,"thread_start_us":453290,"threads_started":2,"wal-append.queue_time_us":390729}
W20260709 13:16:33.397331 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 277160us
I20260709 13:16:33.397845 13883 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:33.407855 13695 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.967s	user 0.014s	sys 0.000s
I20260709 13:16:33.408077 14093 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.423303 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.425382 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:33.426080 14233 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.426728 14233 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.426889 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.408946 10325 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:33.432655 10998 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:33.435850 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.373225 10322 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:33.437906 10998 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:16:33.438338 10322 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:16:33.392709 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:33.413179 10392 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:33.288445 14266 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.441485 10322 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:16:33.440217 10998 pending_rounds.cc:85] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 6
I20260709 13:16:33.443152 10393 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:33.445793 10322 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 13:16:33.353931 14282 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:16:33.447407 10322 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:33.402895 14108 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.444156 14233 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.459223 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.443748 10998 pending_rounds.cc:107] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 13:16:33.461074 10998 raft_consensus.cc:2917] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 13:16:33.461217 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:33.446087 14230 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.461625 10998 raft_consensus.cc:2889] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.445794 14189 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.470703 10999 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:33.468173 14177 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:33.475134 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:33.474357 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.477710 10999 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:33.454107 14188 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:33.484033 14230 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.484570 14230 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.485302 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:32908 (request call id 0) took 13365 ms. Trace:
W20260709 13:16:33.473541 14273 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.219s	user 0.001s	sys 0.001s
I20260709 13:16:33.471935 14099 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.478116 14177 consensus_queue.cc:1243] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:33.494410 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.498713 11002 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:33.485669 10998 rpcz_store.cc:276] 0709 13:16:20.119888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.146070 (+ 26182us) service_pool.cc:224] Handling call
0709 13:16:20.268729 (+122659us) log.cc:844] Serialized 501 byte log entry
0709 13:16:33.485195 (+13216466us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109589,"raft.run_cpu_time_us":615,"raft.run_wall_time_us":615,"thread_start_us":877231,"threads_started":2,"wal-append.queue_time_us":463060,"wal-append.run_cpu_time_us":16985,"wal-append.run_wall_time_us":1168054}
I20260709 13:16:33.491995 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.500619 10322 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:16:33.508253 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:33.470077 14263 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:33.509651 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.514875 14185 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.483003 14281 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:33.515909 14281 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.516956 10250 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:33.480430 14175 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.519122 13883 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:33.486280 14132 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:33.521719 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:33.524562 10322 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.527859 10321 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:33.522210 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:33.500674 14189 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.482617 14113 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:16:33.492322 14259 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:16:33.543089 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.544059 10321 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:33.531052 14097 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:33.540419 14237 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.824s	user 0.000s	sys 0.003s
I20260709 13:16:33.528342 14251 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:33.549227 14284 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.581261 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.535935 14132 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:33.593855 11001 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:33.595197 11001 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:16:33.565797 14294 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:16:33.578570 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.562296 14282 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.603123 14003 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.602628 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 185819us
I20260709 13:16:33.595935 11001 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.564669 14097 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:33.610617 11001 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.594087 14041 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.563365 14108 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:16:33.528894 14250 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:16:33.621622 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.593876 14281 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.594717 14284 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.627792 14284 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:33.629601 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:16:33.631476 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:33.731310 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 99923.9us
I20260709 13:16:33.732438 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.677462 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:33.737051 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:33.737835 11002 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:33.615115 14097 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.740633 10320 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:33.706018 10322 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:33.608549 14266 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.612118 14282 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:33.679566 14261 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:33.772789 10396 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:33.772832 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:33.790050 10998 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:33.706733 14271 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.710208 14113 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.772815 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 180384us
I20260709 13:16:33.785298 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2390) took 1316 ms. Trace:
I20260709 13:16:33.610472 14258 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.811306 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:33.661682 14281 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.772454 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:33.781529 14076 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.860s	user 0.013s	sys 0.000s
I20260709 13:16:33.714097 14230 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.738842 14091 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:33.793293 10316 rpcz_store.cc:276] 0709 13:16:32.468891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.514162 (+ 45271us) service_pool.cc:224] Handling call
0709 13:16:32.514589 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.851904 (+337315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.785017 (+933113us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54000cc954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:33.785212 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770898304}
I20260709 13:16:33.786659 14037 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.806120 14234 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.829263 14076 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.815640 10998 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:33.630643 14041 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.829217 14220 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.638710 14254 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 13:16:33.828467 11001 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:33.878803 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 868) took 1511 ms. Trace:
I20260709 13:16:33.879245 11001 rpcz_store.cc:276] 0709 13:16:32.367770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.367906 (+   136us) service_pool.cc:224] Handling call
0709 13:16:33.593733 (+1225827us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54005d37a0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5fdc0 00007f58c3aebe18 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:33.878718 (+284985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83022720}
I20260709 13:16:33.615310 14003 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:33.861466 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.811414 14188 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:33.872586 14082 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.004s	user 0.012s	sys 0.002s
I20260709 13:16:33.838114 14091 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:33.810937 14271 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.895687 10318 raft_consensus.cc:2410] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:16:33.895996 14302 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:16:33.898995 14235 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.233s	user 0.006s	sys 0.004s
I20260709 13:16:33.899590 14058 raft_consensus.cc:3055] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:33.820586 14113 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.837019 14037 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.829275 14281 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:33.887872 14042 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:16:33.632519 14251 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.882264 14220 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.909513 13812 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.876601 14234 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.907595 14058 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:33.739363 14132 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:33.930532 14297 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:16:33.934499 14258 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:33.934930 14299 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:16:33.918943 14219 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.939673 10399 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:33.946843 14041 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.951071 14003 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:33.959908 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.933188 13812 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:33.966152 14281 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:33.989105 14003 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:33.995378 14003 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:33.989486 14082 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.999711 14082 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.008416 14082 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:34.009785 10390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2233) took 2213 ms (client timeout 1540 ms). Trace:
W20260709 13:16:34.010315 10390 rpcz_store.cc:269] 0709 13:16:31.796505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.801446 (+  4941us) service_pool.cc:224] Handling call
0709 13:16:34.009573 (+2208127us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001aa254. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:34.009694 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391904640}
I20260709 13:16:33.997916 14003 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:33.967690 14282 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:34.016284 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.962529 14219 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.028857 14271 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:33.953105 14091 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:34.043561 14236 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.701s	user 0.002s	sys 0.007s
I20260709 13:16:34.044029 14234 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.038726 14076 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.001754 14058 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.051733 14175 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:34.082295 10999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.011s	sys 0.012s
W20260709 13:16:34.082976 10999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.012s
I20260709 13:16:34.088307 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2379) took 1738 ms. Trace:
I20260709 13:16:34.088750 10319 rpcz_store.cc:276] 0709 13:16:32.345792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.345908 (+   116us) service_pool.cc:224] Handling call
0709 13:16:34.084002 (+1738094us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400276354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:34.084160 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280617856}
W20260709 13:16:34.096427 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.080605 14037 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:34.090641 14058 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.082118 14256 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:34.094831 14255 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:34.115335 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 795) took 1742 ms. Trace:
I20260709 13:16:34.115810 10996 rpcz_store.cc:276] 0709 13:16:32.373012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.373157 (+   145us) service_pool.cc:224] Handling call
0709 13:16:32.373527 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.490562 (+117035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.115034 (+1624472us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400469454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:34.115254 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241316736}
I20260709 13:16:34.100528 14220 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:34.081619 14175 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.104657 14113 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:34.108625 14231 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.716s	user 0.002s	sys 0.011s
I20260709 13:16:34.118647 14310 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.129186 13812 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:34.129807 14097 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.120611 14255 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.204447 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2399) took 1047 ms. Trace:
I20260709 13:16:34.207049 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:34.207504 10324 rpcz_store.cc:276] 0709 13:16:33.157551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.159349 (+  1798us) service_pool.cc:224] Handling call
0709 13:16:33.184912 (+ 25563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.252728 (+ 67816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.252764 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.252802 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:33.252859 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.204183 (+951324us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54002bc854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:34.204232 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.204378 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155462400}
I20260709 13:16:34.208976 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:34.210704 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:34.213569 14175 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:34.164672 14189 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.003s
I20260709 13:16:34.222559 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:34.141330 14068 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.142452 14310 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.230213 14310 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.193138 14287 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.138594 14315 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.139743 14219 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.219110 14003 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.219389 14220 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:34.223636 14135 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:34.225252 14136 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:34.222576 14113 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.138693 14231 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.245954 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:34.238631 14222 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:34.245215 14003 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:34.245850 14228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.015s	sys 0.002s
I20260709 13:16:34.260005 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2308) took 1599 ms. Trace:
I20260709 13:16:34.260175 14156 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.260504 10323 rpcz_store.cc:276] 0709 13:16:32.660881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.701904 (+ 41023us) service_pool.cc:224] Handling call
0709 13:16:32.725273 (+ 23369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.852986 (+127713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.259733 (+1406747us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540022ced4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:34.259933 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244047616}
W20260709 13:16:34.263092 14242 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 1.921s	user 0.004s	sys 0.000s
I20260709 13:16:34.247388 14135 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:34.267050 14222 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:34.267588 14097 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.245278 14219 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:34.252799 14136 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:34.242307 14315 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.276433 14222 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.277525 14231 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:34.258343 14228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.015s	sys 0.002s
I20260709 13:16:34.263818 14023 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.241241 14287 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.282903 14136 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.249243 14113 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.293427 14263 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.294025 14263 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:34.294471 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.295332 14054 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:34.295377 14113 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.295830 14054 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:34.296020 14263 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.296643 14263 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:34.298556 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.299206 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:34.300349 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:34.300943 10247 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:34.303910 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.304800 10249 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:34.306281 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.307621 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.297130 14263 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.310743 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:34.312908 10246 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.312951 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.296940 14054 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.314141 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:34.315505 14315 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.296984 14231 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.311056 14058 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:34.316406 14263 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.319275 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2236) took 1869 ms. Trace:
I20260709 13:16:34.327014 10246 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:34.326913 10391 rpcz_store.cc:276] 0709 13:16:32.449997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.450370 (+   373us) service_pool.cc:224] Handling call
0709 13:16:32.450651 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.666300 (+215649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.319009 (+1652709us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540040f954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:34.319177 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328977280}
I20260709 13:16:34.323257 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.325286 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.330201 10244 raft_consensus.cc:2410] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:34.332346 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.334509 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.335155 10391 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:34.336752 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.338038 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.342504 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.343375 10241 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:34.332463 14058 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:34.344935 14058 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:34.347333 14320 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:16:34.348860 14318 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:34.334539 14135 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:34.334264 14319 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:16:34.359568 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.360435 10247 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:34.371106 10391 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:34.372925 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.373864 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:34.332250 14231 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.358762 14003 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.413868 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.408048 14287 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.460570 14003 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.507601 10244 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:34.512085 10247 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:34.514989 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.517385 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.518071 10250 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:34.520522 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.521152 10250 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:34.521624 14023 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.522266 14023 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.523157 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:34.523741 10250 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.524451 14113 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.525002 14113 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.525605 14023 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.527104 14113 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:34.527774 14113 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:34.527822 14003 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.532428 10324 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:34.534550 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:34.535183 10317 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:34.536286 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:34.536898 10316 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:34.537750 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:34.538357 10322 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:34.539538 10250 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:34.526953 14023 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:34.542649 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:34.543705 10320 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:34.546566 10290 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:34.536473 14243 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.779s	user 0.002s	sys 0.000s
I20260709 13:16:34.548389 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.547551 14233 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:34.551185 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:34.551812 10319 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:34.551797 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:34.552886 10325 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:34.553521 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.558734 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.545944 14156 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:34.602957 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:34.603341 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44710.8us
I20260709 13:16:34.551108 13883 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.604408 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.552997 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.598686 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 842) took 1508 ms. Trace:
W20260709 13:16:34.610481 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 57543.7us
I20260709 13:16:34.554958 14233 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.608928 10248 rpcz_store.cc:276] 0709 13:16:33.089990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.090188 (+   198us) service_pool.cc:224] Handling call
0709 13:16:33.090583 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.093666 (+  3083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.093698 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.093740 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:33.093783 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.598312 (+1504529us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b540009f954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:34.598379 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.598598 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6609664}
I20260709 13:16:34.561962 14068 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:34.701717 10393 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
W20260709 13:16:34.703193 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 98901.5us
I20260709 13:16:34.563511 14136 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:34.704778 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.557613 14003 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:34.708226 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.565649 14074 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.566154 14175 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.704155 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.528316 14113 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.561694 14022 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:16:34.736093 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.737746 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2531) took 2549 ms. Trace:
I20260709 13:16:34.670696 14135 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.549652 14023 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.707234 14136 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:34.733325 14329 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:16:34.744038 10248 raft_consensus.cc:2410] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:34.689046 14233 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.739120 10242 rpcz_store.cc:276] 0709 13:16:32.188230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.189133 (+   903us) service_pool.cc:224] Handling call
0709 13:16:32.189546 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:32.189985 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.190025 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:32.204976 (+ 14951us) log.cc:844] Serialized 52 byte log entry
0709 13:16:32.539156 (+334180us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:32.539196 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.539605 (+   409us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.519470 (+1979865us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:34.733623 (+214153us) raft_consensus.cc:1685] finished
0709 13:16:34.733649 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.737658 (+  4009us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":313,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":13962,"spinlock_wait_cycles":29934336,"thread_start_us":265263,"threads_started":1,"wal-append.queue_time_us":405615}
I20260709 13:16:34.707170 14260 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:34.762948 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:34.715348 14222 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:34.767762 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 172146us
I20260709 13:16:34.708714 14315 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:34.745028 10247 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:34.770735 10241 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 13:16:34.772347 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 68302.5us
I20260709 13:16:34.718257 14068 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:34.822376 10241 pending_rounds.cc:85] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:16:34.737071 14003 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:34.775645 14256 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.702888 13883 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.802502 14037 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:34.822719 10241 pending_rounds.cc:107] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:16:34.855383 10241 raft_consensus.cc:2889] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:34.840159 10395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 733) took 1792 ms (client timeout 2105 ms). Trace:
W20260709 13:16:34.856638 10395 rpcz_store.cc:269] 0709 13:16:33.047902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.048069 (+   167us) service_pool.cc:224] Handling call
0709 13:16:34.839891 (+1791822us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540010c054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:34.840074 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496676224}
W20260709 13:16:34.843379 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68592.3us
W20260709 13:16:34.848067 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.737818 14097 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:16:34.768702 14136 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:34.738165 14251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.046s	sys 0.040s
I20260709 13:16:34.841450 10394 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:34.734966 14074 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.858188 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:34.773193 14260 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:34.858952 14325 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:16:34.872515 14260 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:34.775683 14222 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.846634 14263 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:16:34.873662 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.854933 14091 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.765518 14135 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.896234 14135 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.903774 10398 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:34.906495 14068 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.863377 14282 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:34.910338 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.910712 14282 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.911304 10395 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:34.913543 14282 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.914078 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:34.915952 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.917042 10390 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:34.919535 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2545) took 1805 ms. Trace:
I20260709 13:16:34.920045 10245 rpcz_store.cc:276] 0709 13:16:33.114531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.114668 (+   137us) service_pool.cc:224] Handling call
0709 13:16:33.114995 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.174795 (+ 59800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.174835 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.174878 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:33.174923 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.919267 (+1744344us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b54003b3dd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:34.919319 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.919466 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137015168}
I20260709 13:16:34.921901 14270 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:34.923014 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:34.863798 14251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.046s	sys 0.043s
I20260709 13:16:34.860848 14037 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.818786 14231 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:34.854771 14003 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:34.764046 14175 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:34.884081 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 271327us
I20260709 13:16:34.941643 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:34.839604 14315 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:34.938791 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:34.854724 14256 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.877964 14222 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:34.948863 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:34.949853 10395 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:34.950095 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:34.954025 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 233328us
I20260709 13:16:34.953846 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:34.956984 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.938573 14037 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:34.958360 13851 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:34.958480 14003 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:34.959048 13851 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:34.957590 10390 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:34.972344 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.972460 13883 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:34.973683 10148 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 4 to 5, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 5 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.940986 14287 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:34.975405 10145 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 315) took 19126 ms (client timeout 15000 ms). Trace:
I20260709 13:16:34.983862 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.991154 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:34.965867 14058 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.620s	user 0.024s	sys 0.000s
I20260709 13:16:34.989817 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:34.952162 14251 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:34.961278 14231 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.007207 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.010574 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:35.013448 10392 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:34.960048 13851 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.018492 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.018524 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:34.923061 14091 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.015800 14058 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.003783 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.021783 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:34.975236 14230 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:35.028234 10396 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:35.034199 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.036094 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.021894 14018 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:34.981681 10145 rpcz_store.cc:269] 0709 13:16:15.849615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.849831 (+   216us) service_pool.cc:224] Handling call
0709 13:16:34.975309 (+19125478us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:28.668052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:28.668733 (+   681us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:28.668795 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:16:28.668817 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:28.669941 (+  1124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:28.670049 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:28.670081 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:28.878804 (+208723us) tablet.cc:701] Row locks acquired
0709 13:16:28.878874 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:16:28.879131 (+   257us) write_op.cc:270] Start()
0709 13:16:28.879339 (+   208us) write_op.cc:276] Timestamp: P: 1783602988879034 usec, L: 0
0709 13:16:28.879361 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:28.880319 (+   958us) log.cc:844] Serialized 4010 byte log entry
0709 13:16:29.635965 (+755646us) op_driver.cc:464] REPLICATION: finished
0709 13:16:30.162271 (+526306us) write_op.cc:301] APPLY: starting
0709 13:16:30.162374 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:30.162636 (+   262us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:30.162770 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:30.244892 (+ 82122us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:30.245154 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:16:30.245204 (+    50us) write_op.cc:312] APPLY: finished
0709 13:16:30.245501 (+   297us) log.cc:844] Serialized 77 byte log entry
0709 13:16:30.245674 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:30.245793 (+   119us) write_op.cc:454] Released schema lock
0709 13:16:30.245844 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:30.246190 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:30.246216 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":108189,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":510655,"apply.run_cpu_time_us":3961,"apply.run_wall_time_us":91093,"num_ops":10,"prepare.queue_time_us":207502,"prepare.run_cpu_time_us":41333,"prepare.run_wall_time_us":418908,"raft.queue_time_us":254307,"raft.run_cpu_time_us":31741,"raft.run_wall_time_us":455890,"replication_time_us":729828,"thread_start_us":854338,"threads_started":4,"wal-append.queue_time_us":232494,"wal-append.run_cpu_time_us":73765,"wal-append.run_wall_time_us":2212599}]]}
I20260709 13:16:35.023012 14191 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:35.017808 14231 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.017618 14192 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:35.044349 14058 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.044888 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:35.027155 14139 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.049057 10321 pending_rounds.cc:85] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 4
I20260709 13:16:35.060097 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.060392 10321 pending_rounds.cc:107] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:35.060716 10321 raft_consensus.cc:2889] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.060781 10317 raft_consensus.cc:2376] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11. Re-sending same reply.
I20260709 13:16:35.055200 10316 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:35.061637 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.046527 14018 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.057555 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.010865 14287 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.062209 10317 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:35.030695 14230 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:35.066823 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.066865 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.064491 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.034986 14335 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.075619 10320 pending_rounds.cc:85] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 6
I20260709 13:16:35.075960 10320 pending_rounds.cc:107] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:16:35.069965 10316 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:35.070272 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:35.074980 14023 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.068361 14113 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.045673 14336 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:35.083290 14336 raft_consensus.cc:2764] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:35.062894 14191 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.068532 14018 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:35.090349 10318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2402) took 1779 ms (client timeout 2118 ms). Trace:
W20260709 13:16:35.090798 10318 rpcz_store.cc:269] 0709 13:16:33.311440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.331183 (+ 19743us) service_pool.cc:224] Handling call
0709 13:16:35.090095 (+1758912us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54000cbf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:35.090274 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177740544}
I20260709 13:16:35.060015 14231 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.098101 14080 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.098875 14074 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.099982 14287 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.073208 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.076301 10320 raft_consensus.cc:2889] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.059237 14192 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:35.085942 14191 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:35.108500 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 250352us
I20260709 13:16:35.109565 10395 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:35.117086 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.118634 10319 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:35.065433 14139 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.070369 14230 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:35.100018 14330 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:16:35.046860 14233 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.129156 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.159721 10319 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:35.160449 10148 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 7 to 8, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 8 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.154187 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:35.117910 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 250503us
I20260709 13:16:35.107561 13695 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.159726 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.169064 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.170483 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:35.122588 14139 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.177397 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:35.183450 10245 raft_consensus.cc:2410] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:35.180518 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:35.173832 10323 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:35.164176 14270 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.188894 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:35.176280 14331 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:16:35.192920 10323 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.170104 13883 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:35.206315 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.207059 10319 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:35.235524 10323 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:35.173521 13695 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.240614 10148 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 7 to 10, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 10 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.190663 14315 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.241911 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.198248 13883 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.185535 14135 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:16:35.248159 14331 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:16:35.205510 14256 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.262203 14233 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.262828 14091 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.246426 14175 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:35.282502 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.265661 13883 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.226858 14257 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:16:35.248018 14341 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:35.268905 14228 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:35.270617 14135 consensus_queue.cc:1243] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:16:35.292088 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:35.276638 14256 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:35.293558 14317 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.200s	user 0.002s	sys 0.011s
I20260709 13:16:35.284003 14251 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:35.277652 14122 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:16:35.318701 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.296872 14341 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.293125 14091 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:35.324726 14188 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:35.298050 14136 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:35.340754 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 260082us
W20260709 13:16:35.358039 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 192275us
I20260709 13:16:35.359711 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:35.361263 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:35.364400 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.365329 10999 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:35.367616 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.306938 14228 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.335477 14315 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.315927 14256 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.379166 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.419073 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.432482 10996 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:35.430644 10390 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:35.353510 14188 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.331071 14342 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:16:35.434013 11001 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:35.373697 13851 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:35.380712 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.463997 10999 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:35.342890 14341 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.467214 11001 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:35.467065 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:35.469404 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 199367us
I20260709 13:16:35.374651 14269 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.352663 14233 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:35.480608 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.436964 14091 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:35.456004 14260 consensus_meta.cc:287] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.005s
I20260709 13:16:35.491457 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.376331 14102 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:16:35.486114 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:35.493551 11001 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 6: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:35.493836 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.494495 10399 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:35.436712 14346 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:35.487308 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.489125 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.438812 14068 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.490029 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.498371 10392 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:35.495937 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.496068 10999 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:35.469627 14003 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.498733 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.507754 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.508797 10392 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:35.499322 10399 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:35.484803 13695 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:35.468025 14315 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.500294 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:35.487692 14091 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:35.522953 10396 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:35.501863 14037 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.003s
I20260709 13:16:35.468309 13851 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.488085 14233 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.524629 10399 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:16:35.499841 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 138677us
I20260709 13:16:35.503656 14339 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.531971 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:35.542780 10245 raft_consensus.cc:2410] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:35.534186 10247 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:35.543248 10247 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:35.543421 10998 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:35.544531 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:35.439435 14251 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.533298 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:35.538256 10242 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:35.494141 14260 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.551069 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.545228 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.553767 10242 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:35.544138 10247 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:35.564024 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.569597 10247 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.573047 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:35.573770 10396 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.573899 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:35.574608 10246 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:35.575380 14326 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 1.009s	user 0.011s	sys 0.000s
I20260709 13:16:35.577108 14115 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.577598 14115 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.577965 14115 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.526098 14357 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:35.525190 13695 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:35.582592 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:35.584822 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49524.6us
I20260709 13:16:35.590471 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.601545 10245 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:35.567334 14342 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:35.592070 14192 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.594738 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.608821 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:35.597641 14367 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:35.520676 14362 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:16:35.599141 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.519384 14068 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.605609 10246 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:35.601589 10321 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:35.596678 10247 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:16:35.617942 10247 pending_rounds.cc:85] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:16:35.618216 10247 pending_rounds.cc:107] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:16:35.618498 10247 raft_consensus.cc:2889] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.618489 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.619247 10321 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:35.620117 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.620858 10321 raft_consensus.cc:2376] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8. Re-sending same reply.
I20260709 13:16:35.550958 14113 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.601977 14357 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.613852 10317 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:35.614257 10288 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.621898 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.634326 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.634441 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.635605 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:35.635771 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.518950 14346 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.636276 10396 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:35.634361 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.637383 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.637389 10392 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:35.638284 14346 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.639034 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:35.611279 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 78056.4us
I20260709 13:16:35.639760 10392 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:35.640534 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:35.636194 10317 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.641382 14269 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:35.642115 14269 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:35.642489 14269 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:35.642860 14269 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.581387 14074 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:35.530707 14037 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.521452 14003 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.689780 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.646494 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.646668 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:35.692215 14192 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:35.623044 14250 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.622752 14266 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:35.711822 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.705607 10317 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:35.714104 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.644327 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:35.709910 14351 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:16:35.722380 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.733052 10396 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:35.725847 10392 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.733836 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:35.632380 14146 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:35.735739 10316 raft_consensus.cc:2376] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13. Re-sending same reply.
I20260709 13:16:35.695405 14340 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.613544 14336 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:35.645262 14357 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.740638 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.742630 10999 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:35.745217 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.750761 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.752725 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.645174 14282 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:16:35.625077 14342 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.754585 10392 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:35.769126 10997 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:35.618341 13695 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:35.771283 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.672011 14113 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.616735 14091 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.773782 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:35.741429 14340 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:35.778724 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 132110us
I20260709 13:16:35.704535 14074 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.800978 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:35.781932 10322 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.741842 14256 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.815696 14256 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:35.755342 14255 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.632869 14367 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.758014 14136 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.829262 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.834582 10392 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 6: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:35.828909 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.820915 14374 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.821388 10322 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:35.822661 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.755084 14368 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.732610 14250 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.804095 14340 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:35.839221 14355 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 13:16:35.741113 14146 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:35.753580 14346 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:16:35.776427 14102 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.767343 14266 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.780511 14353 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:35.775182 14175 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:35.849426 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.849493 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:35.873406 10322 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:35.819072 14018 consensus_meta.cc:287] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.004s
I20260709 13:16:35.819959 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:35.859656 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:35.849977 14191 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:16:35.754386 14336 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:35.879743 14080 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.001s
I20260709 13:16:35.875551 14102 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.871541 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.874920 10392 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:35.851889 14228 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.827250 14362 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:16:35.879328 14191 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:35.869982 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:35.958453 10993 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:35.880923 14336 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.881336 10319 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
W20260709 13:16:35.946686 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 126805us
I20260709 13:16:35.961553 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:35.948243 10997 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:35.885573 10994 raft_consensus.cc:2410] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:16:35.903329 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.967353 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:35.955008 14231 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.860s	user 0.008s	sys 0.006s
I20260709 13:16:35.877384 14353 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.985417 10996 raft_consensus.cc:2368] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10.
I20260709 13:16:35.981797 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:35.982508 10325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:16:35.877187 14175 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.986672 10325 raft_consensus.cc:606] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:35.987082 10325 raft_consensus.cc:614] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:35.988627 10392 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:35.977802 14022 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:35.961625 14310 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.956895 14315 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:35.963685 13851 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.987283 14233 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:35.971553 14374 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.967036 14378 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:35.985430 14356 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:16:35.984709 14146 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:35.947443 14018 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.003054 14353 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.985733 14260 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:36.012760 14037 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:36.007954 14375 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.996654 14175 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:35.985919 14231 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:36.011798 14374 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.008315 14378 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:36.066970 14226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.808s	user 0.019s	sys 0.026s
I20260709 13:16:36.054701 14375 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.006052 14310 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.079046 14375 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:36.075019 14226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.819s	user 0.020s	sys 0.027s
I20260709 13:16:36.074573 14378 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:36.099931 14222 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.003s
I20260709 13:16:36.134531 14226 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:36.234123 14222 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.237022 10398 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:16:36.178643 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.180135 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.131582 14188 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.004s
I20260709 13:16:36.243371 14188 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.048094 14068 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.247588 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 659) took 1169 ms. Trace:
I20260709 13:16:36.248801 13695 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:36.175307 10241 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.022s	sys 0.050s
I20260709 13:16:36.237411 14226 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:36.194512 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 664) took 1113 ms. Trace:
I20260709 13:16:36.251160 10325 rpcz_store.cc:276] 0709 13:16:35.080380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.192651 (+1112271us) service_pool.cc:224] Handling call
0709 13:16:36.193241 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.193659 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.193700 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.193775 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:36.193842 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.193935 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.194160 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.208730 10392 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:36.215428 14003 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.218421 11000 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:16:36.004452 14022 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.227381 14113 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.122975 14191 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.127705 14231 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:36.075762 14230 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.000s
W20260709 13:16:36.250779 10241 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.023s	sys 0.050s
I20260709 13:16:36.184765 10322 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:16:36.134837 14341 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.647s	user 0.002s	sys 0.009s
I20260709 13:16:36.299808 14188 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:36.299721 14341 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:36.128427 14357 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.306798 10399 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 12. Ops: []
I20260709 13:16:36.123826 14367 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.306988 14340 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:36.071816 14372 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:16:36.132876 14374 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:36.130010 14382 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:16:36.245952 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2424) took 1140 ms. Trace:
I20260709 13:16:36.248188 10319 rpcz_store.cc:276] 0709 13:16:35.078386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.240002 (+161616us) service_pool.cc:224] Handling call
0709 13:16:36.247110 (+1007108us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5400187ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:36.247371 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451936640}
W20260709 13:16:36.262503 14395 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
W20260709 13:16:36.264819 14269 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.002s
I20260709 13:16:36.269932 14222 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.280048 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 662) took 1200 ms. Trace:
I20260709 13:16:36.295744 14022 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.295570 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 741) took 1326 ms. Trace:
I20260709 13:16:36.298386 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1787) took 1991 ms. Trace:
I20260709 13:16:36.309932 10316 rpcz_store.cc:276] 0709 13:16:35.105012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.244481 (+1139469us) service_pool.cc:224] Handling call
0709 13:16:36.245017 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.245417 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.245444 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.245502 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:36.245583 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.245644 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.245769 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.318869 10322 rpcz_store.cc:276] 0709 13:16:35.079792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.977303 (+897511us) service_pool.cc:224] Handling call
0709 13:16:36.183614 (+206311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.279620 (+ 96006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.279950 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:36.299741 10213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.018s	sys 0.004s
I20260709 13:16:36.321504 10390 rpcz_store.cc:276] 0709 13:16:34.969232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.972081 (+  2849us) service_pool.cc:224] Handling call
0709 13:16:36.294939 (+1322858us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54002fe754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:36.295297 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050818304}
I20260709 13:16:36.327822 14018 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:36.331003 10213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.020s	sys 0.004s
W20260709 13:16:36.341965 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.346408 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.295557 14230 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.355250 14255 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:36.356226 14255 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:36.358506 14367 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:36.359530 14367 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.360105 10246 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:36.327850 14269 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.363210 14357 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.365796 10246 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:36.355000 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:36.321882 10394 rpcz_store.cc:276] 0709 13:16:34.306331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.306481 (+   150us) service_pool.cc:224] Handling call
0709 13:16:34.840987 (+534506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.863990 (+ 23003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.297569 (+1433579us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540010c050. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:36.297989 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228322176}
W20260709 13:16:36.378717 11001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.004s
I20260709 13:16:36.387265 10323 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:36.390439 14341 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:36.391342 14054 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.395160 10322 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:16:36.398540 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.023s	sys 0.035s
W20260709 13:16:36.399359 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.024s	sys 0.035s
W20260709 13:16:36.400899 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 711115us
I20260709 13:16:36.402194 10319 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:16:36.406030 11001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.008s	sys 0.004s
I20260709 13:16:36.412287 14050 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.416039 10319 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:36.412313 14255 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:36.424958 14139 consensus_meta.cc:287] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.231s	user 0.012s	sys 0.011s
W20260709 13:16:36.401965 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 440304us
I20260709 13:16:36.469575 14353 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.426100 14139 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.471204 14367 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.494130 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:36.495900 14400 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:36.496822 14400 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:36.499467 14175 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.510336 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 751) took 1238 ms. Trace:
I20260709 13:16:36.514611 14378 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.516440 10397 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:36.517716 14378 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.511400 10395 rpcz_store.cc:276] 0709 13:16:35.271738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.271901 (+   163us) service_pool.cc:224] Handling call
0709 13:16:35.280270 (+  8369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.485707 (+205437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.485754 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.485805 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:35.485838 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.509788 (+1023950us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400001754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:36.509876 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.510093 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471808896}
W20260709 13:16:36.522775 14115 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.933s	user 0.012s	sys 0.012s
I20260709 13:16:36.523356 14115 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.524863 10998 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:36.507517 14400 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.513139 14175 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.528579 14068 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.529088 14115 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.529225 14068 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.531721 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.532553 10397 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.535897 14353 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.537130 14230 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.538048 13969 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.538758 13969 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.536093 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:36.540402 10395 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:36.541672 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.541793 13969 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:36.542372 10395 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.488385 14375 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.544625 10391 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:36.521984 14074 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.553776 14139 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:36.554075 13883 consensus_meta.cc:287] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.249s	user 0.015s	sys 0.009s
I20260709 13:16:36.557874 14250 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.560292 14375 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:36.567675 10394 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:36.555598 13883 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:36.569784 10392 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:36.585230 10397 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:36.589363 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:36.592191 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:36.585361 13883 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:36.591642 14375 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:36.591394 14139 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:36.596850 14139 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.597358 14139 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:36.597424 14316 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 2.503s	user 0.006s	sys 0.010s
I20260709 13:16:36.600147 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1683) took 4271 ms. Trace:
I20260709 13:16:36.600590 10243 rpcz_store.cc:276] 0709 13:16:32.328309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.380022 (+ 51713us) service_pool.cc:224] Handling call
0709 13:16:32.380433 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.380828 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.380876 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.381416 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.022723 (+1641307us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b18003c49c0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:34.091649 (+ 68926us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:34.091684 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.091775 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.596320 (+2504545us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:36.598957 (+  2637us) raft_consensus.cc:1685] finished
0709 13:16:36.598984 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.599920 (+   936us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23451,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9441,"spinlock_wait_cycles":77489280,"thread_start_us":68722,"threads_started":1,"wal-append.queue_time_us":1655544}
I20260709 13:16:36.602210 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 911) took 1235 ms. Trace:
I20260709 13:16:36.603673 11000 rpcz_store.cc:276] 0709 13:16:35.367252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.367367 (+   115us) service_pool.cc:224] Handling call
0709 13:16:35.367729 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.266754 (+899025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.601810 (+335056us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54006fb8d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:36.602125 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954675584}
I20260709 13:16:36.606808 10993 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:36.607249 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:36.608675 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:36.609144 14400 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:36.609141 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:36.610601 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:36.611181 10994 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:36.611572 14400 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:36.613535 10997 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:36.613658 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.616847 10397 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:36.618971 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:36.619782 10993 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:36.626379 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.627811 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.628508 10394 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.613680 14400 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.626468 10321 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:36.640198 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.645388 10394 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
W20260709 13:16:36.650537 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 906428us
W20260709 13:16:36.650717 10965 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.531s (SENT)
I20260709 13:16:36.652056 10395 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:36.652807 14139 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.655236 14139 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.652105 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:36.657483 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:36.658218 10395 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.663280 14102 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:36.664197 10965 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.612s (SENT) [suppressed 18 similar messages]
I20260709 13:16:36.665437 14139 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:36.666137 14139 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:36.668522 14139 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.671695 10395 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:36.679303 10247 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.692369 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 739) took 1737 ms. Trace:
I20260709 13:16:36.692853 10398 rpcz_store.cc:276] 0709 13:16:34.955240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.955391 (+   151us) service_pool.cc:224] Handling call
0709 13:16:34.971703 (+ 16312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.237637 (+1265934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.692025 (+454388us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540010bb54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:36.692298 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908383488}
I20260709 13:16:36.698578 10247 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:36.699074 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:36.699887 10398 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:36.702180 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:36.704387 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:36.705835 14102 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:36.706427 14102 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:36.707671 14102 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.704413 10242 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:36.711982 10242 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.715677 14400 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:36.716852 14347 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.102s	user 0.004s	sys 0.000s
I20260709 13:16:36.718834 14400 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:36.721114 14400 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:36.722437 14400 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.724349 14400 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.716801 10965 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:36.732453 14139 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.732937 14139 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.736120 14375 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.736932 14375 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:36.750212 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 806) took 1014 ms. Trace:
I20260709 13:16:36.750653 10998 rpcz_store.cc:276] 0709 13:16:35.736175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.736312 (+   137us) service_pool.cc:224] Handling call
0709 13:16:35.736685 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.525341 (+788656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.749838 (+224497us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54003f7fd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:36.750140 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1811583744}
I20260709 13:16:36.785094 14375 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:36.801896 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:36.802995 10998 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:36.733366 14139 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.810663 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2417) took 2281 ms. Trace:
I20260709 13:16:36.811102 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:37.085441 10965 leader_election.cc:336] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.750s (SENT)
I20260709 13:16:37.085736 10398 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:36.821650 10324 rpcz_store.cc:276] 0709 13:16:34.529374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.533294 (+  3920us) service_pool.cc:224] Handling call
0709 13:16:34.533618 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.533998 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.534023 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.541897 (+  7874us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.576593 (+1034696us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b1800378460. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:35.646054 (+ 69461us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:35.700788 (+ 54734us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.675607 (+974819us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b4800270cd8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f 00007f58c8afff37 00007f58c8b1455c 00007f58c8b14508 00007f58c8b14488 00007f58c8b14443 00007f58c8b136ec 00007f58c7a3da96
0709 13:16:36.809838 (+134231us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b1800378460. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287
0709 13:16:36.810071 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.810184 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.810272 (+    88us) raft_consensus.cc:1685] finished
0709 13:16:36.810288 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.810446 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54895,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":130510,"raft.run_cpu_time_us":6942,"raft.run_wall_time_us":2148696,"spinlock_wait_cycles":29685120,"thread_start_us":115557,"threads_started":2,"wal-append.queue_time_us":1181433}
W20260709 13:16:37.086956 10965 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.789s (SENT)
I20260709 13:16:36.865815 10318 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:36.870879 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 667) took 1268 ms. Trace:
I20260709 13:16:36.995631 14340 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:37.015825 14403 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.507s	user 0.003s	sys 0.003s
W20260709 13:16:36.942379 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 290760us
W20260709 13:16:36.943197 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.088748 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:37.228432 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:16:37.570896 10136 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.685s	user 0.010s	sys 0.000s
I20260709 13:16:40.194712 14429 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:38.777909 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.241636 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:38.844110 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2573) took 3311 ms. Trace:
I20260709 13:16:40.200877 10241 rpcz_store.cc:276] 0709 13:16:35.533136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.533262 (+   126us) service_pool.cc:224] Handling call
0709 13:16:35.533553 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.637602 (+104049us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:36.296643 (+659041us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.942287 (+645644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.942382 (+    95us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:36.942516 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.843718 (+1901202us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540043dfd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:38.843778 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.844013 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2028061,"prepare.queue_time_us":439106,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":629155,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":144,"spinlock_wait_cycles":238803328,"thread_start_us":685704,"threads_started":2,"wal-append.queue_time_us":207496,"wal-append.run_cpu_time_us":23412,"wal-append.run_wall_time_us":2321265}
I20260709 13:16:40.202858 14429 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:36.878311 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 846) took 1305 ms. Trace:
W20260709 13:16:38.895871  9152 debug-util.cc:398] Leaking SignalData structure 0x7b08003afce0 after lost signal to thread 10132
W20260709 13:16:38.527009 10271 debug-util.cc:398] Leaking SignalData structure 0x7b080010d400 after lost signal to thread 9147
I20260709 13:16:37.199630 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2319) took 1663 ms. Trace:
I20260709 13:16:40.216131 10318 rpcz_store.cc:276] 0709 13:16:35.536632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.253278 (+716646us) service_pool.cc:224] Handling call
0709 13:16:36.261980 (+  8702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.088939 (+826959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.199349 (+110410us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54002be154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:37.199557 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387779840}
I20260709 13:16:40.216962 14074 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.217399 14066 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.139598 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2327) took 1583 ms. Trace:
I20260709 13:16:40.219061 10319 rpcz_store.cc:276] 0709 13:16:35.556629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.417170 (+860541us) service_pool.cc:224] Handling call
0709 13:16:36.417643 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.139074 (+721431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.139110 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.139176 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:37.139223 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.139300 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.139492 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":720760,"raft.queue_time_us":3759574,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98}
I20260709 13:16:37.089200 10321 rpcz_store.cc:276] 0709 13:16:35.602332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.621625 (+ 19293us) service_pool.cc:224] Handling call
0709 13:16:36.870582 (+1248957us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400209c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:36.870765 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281578880}
I20260709 13:16:37.076714 10323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2331) took 1458 ms. Trace:
I20260709 13:16:40.223230 10323 rpcz_store.cc:276] 0709 13:16:35.617983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.849165 (+231182us) service_pool.cc:224] Handling call
0709 13:16:37.076455 (+1227290us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001883d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:37.076642 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134932352}
I20260709 13:16:37.087780 10324 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:16:38.799582 10346 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf6e0 after lost signal to thread 9147
W20260709 13:16:38.785928 10317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2330) took 3177 ms (client timeout 2127 ms). Trace:
I20260709 13:16:37.203845 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:40.230218 14373 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.230430 14357 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.239320 10390 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:16:37.287184 10391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 747) took 2294 ms (client timeout 1612 ms). Trace:
W20260709 13:16:40.233011 10391 rpcz_store.cc:269] 0709 13:16:34.993052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.018205 (+ 25153us) service_pool.cc:224] Handling call
0709 13:16:37.286848 (+2268643us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002dd554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:37.287069 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3503540992}
I20260709 13:16:40.235117 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1814) took 4622 ms. Trace:
I20260709 13:16:40.235705 10390 rpcz_store.cc:276] 0709 13:16:35.612314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.504826 (+892512us) service_pool.cc:224] Handling call
0709 13:16:37.238889 (+734063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.232254 (+2993365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.234761 (+  2507us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54004501d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:40.235008 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671094656}
I20260709 13:16:37.634721 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2254) took 2051 ms. Trace:
I20260709 13:16:40.237942 10392 rpcz_store.cc:276] 0709 13:16:35.582857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.266069 (+683212us) service_pool.cc:224] Handling call
0709 13:16:36.266790 (+   721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.570264 (+303474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.634459 (+1064195us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54003ba6d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:37.634646 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696342272}
W20260709 13:16:37.239099 10393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1786) took 2935 ms (client timeout 1773 ms). Trace:
W20260709 13:16:37.179333 10396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2253) took 1606 ms (client timeout 1676 ms). Trace:
I20260709 13:16:37.161914 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2250) took 1590 ms. Trace:
I20260709 13:16:40.243815 10399 rpcz_store.cc:276] 0709 13:16:35.571643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.571791 (+   148us) service_pool.cc:224] Handling call
0709 13:16:35.572229 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.307509 (+735280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.161597 (+854088us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54001347d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:37.161833 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688050432}
I20260709 13:16:39.785910 14426 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.046221 14427 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.245216 14426 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.048072 14428 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.102406 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800324840 after lost signal to thread 9147
W20260709 13:16:40.247426 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad080 after lost signal to thread 9150
I20260709 13:16:37.202203 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:38.755578 10967 connection.cc:256] RPC call timeout handler was delayed by -1.3146112860001722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 13:16:37.203459 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.252416 10994 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:40.253134 10994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 823) took 3051 ms (client timeout 1612 ms). Trace:
I20260709 13:16:37.122138 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 810) took 1377 ms. Trace:
I20260709 13:16:37.282466 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.255249 14054 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.255585 11001 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:40.256063 11001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 824) took 3053 ms (client timeout 2137 ms). Trace:
I20260709 13:16:37.202529 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.257335 14391 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.257472 10998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 819) took 3061 ms (client timeout 1846 ms). Trace:
I20260709 13:16:38.835438 13695 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:37.153438 14068 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:39.089265 14076 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.061512 14091 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.835861 14139 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:37.639115 14156 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.271044 14156 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.273459 14156 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:38.150951 14219 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:40.274938 14185 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.274753 14219 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.275456 14185 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.277556 14185 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.277843 14219 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.044811 14256 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:40.279204 14256 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:37.778427 14257 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.215309 14269 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.282101 14257 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:38.814160 14313 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.283604 14313 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.285043 14257 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:37.258641 14250 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:38.815356 14343 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.287250 14343 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:37.075855 14342 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:37.116828 14360 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.503s	user 0.005s	sys 0.000s
W20260709 13:16:37.140400 14365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.006s	sys 0.001s
W20260709 13:16:40.293131 14365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.784s	user 0.007s	sys 0.003s
I20260709 13:16:37.233683 14375 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:40.296617 14375 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:37.267498 14376 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:37.246759 14400 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.299975 14400 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.191151 14255 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.301086 14255 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.302453 14400 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:36.846778 14414 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:40.303439 14255 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:40.192662 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 2.9642e+06us
I20260709 13:16:37.633931 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:40.307022 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 2.67298e+06us
I20260709 13:16:40.308889 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:40.197456 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.199093 10250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1714) took 2958 ms (client timeout 2771 ms). Trace:
I20260709 13:16:40.311671 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:40.311831 10250 rpcz_store.cc:269] 0709 13:16:37.241127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.241290 (+   163us) service_pool.cc:224] Handling call
0709 13:16:40.198978 (+2957688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.312439 10247 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:36.849517 10242 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:40.316846 10242 pending_rounds.cc:85] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:16:40.317188 10242 pending_rounds.cc:107] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:40.317466 10242 raft_consensus.cc:2889] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:40.318302 14254 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:16:40.206005 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 654) took 5131 ms. Trace:
I20260709 13:16:40.207365 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2426) took 4652 ms. Trace:
I20260709 13:16:40.320412 10320 rpcz_store.cc:276] 0709 13:16:35.074914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.075030 (+   116us) service_pool.cc:224] Handling call
0709 13:16:35.075393 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:35.164551 (+ 89158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.164600 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:35.171361 (+  6761us) log.cc:844] Serialized 52 byte log entry
0709 13:16:35.469129 (+297768us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:35.691300 (+222171us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.722129 (+1030829us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18003fc100. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287
0709 13:16:36.722786 (+   657us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.205324 (+3482538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.205446 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.205601 (+   155us) raft_consensus.cc:1685] finished
0709 13:16:40.205617 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.205786 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3494653,"prepare.queue_time_us":50756,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":3447,"raft.queue_time_us":3714168,"raft.run_cpu_time_us":502,"raft.run_wall_time_us":57381,"spinlock_wait_cycles":3587840,"thread_start_us":586092,"threads_started":3,"wal-append.queue_time_us":403431,"wal-append.run_cpu_time_us":38620,"wal-append.run_wall_time_us":3302156}
I20260709 13:16:40.320565 10322 rpcz_store.cc:276] 0709 13:16:35.555299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.396704 (+841405us) service_pool.cc:224] Handling call
0709 13:16:36.397233 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:36.431947 (+ 34714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.432008 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.907665 (+475657us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.909245 (+  1580us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:36.909673 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.206968 (+3297295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.207083 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.207136 (+    53us) raft_consensus.cc:1685] finished
0709 13:16:40.207149 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.207310 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7058446,"prepare.queue_time_us":253,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":3359407,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":21807,"thread_start_us":1025,"threads_started":1,"wal-append.queue_time_us":1083,"wal-append.run_cpu_time_us":3474,"wal-append.run_wall_time_us":1002533}
I20260709 13:16:40.207479 10316 raft_consensus.cc:1217] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-9.7]   Dedup: 8.6->[9.7-9.7]
I20260709 13:16:40.324081 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2577) took 4788 ms. Trace:
I20260709 13:16:40.324402 10316 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 13:16:40.324568 10242 rpcz_store.cc:276] 0709 13:16:35.535808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.536008 (+   200us) service_pool.cc:224] Handling call
0709 13:16:35.538066 (+  2058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.703526 (+1165460us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b4c00001f80. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c1db4a20 00007f58c1dc5a29 00007f58c1d8b644 00007f58c1db2f2d 00007f58c1db2b93 00007f58c3ae318b 00007f58c3ae3cb5 00007f58c3adef30 00007f58c3ae07de 00007f58c3aeab49 00007f58c3aeb416
0709 13:16:40.317945 (+3614419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.324007 (+  6062us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187271424}
I20260709 13:16:40.207928 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2317) took 4673 ms. Trace:
I20260709 13:16:40.326884 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2324) took 4784 ms. Trace:
I20260709 13:16:40.325881 10325 rpcz_store.cc:276] 0709 13:16:35.534819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.253196 (+718377us) service_pool.cc:224] Handling call
0709 13:16:36.259266 (+  6070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.346382 (+ 87116us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:36.382137 (+ 35755us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.207574 (+3825437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:40.207635 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:40.207694 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.207763 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.207868 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3181968,"prepare.queue_time_us":120213,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":3194276,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":33367,"threads_started":2,"wal-append.queue_time_us":597257,"wal-append.run_cpu_time_us":51870,"wal-append.run_wall_time_us":1734007}
I20260709 13:16:40.209534 10248 rpcz_store.cc:276] 0709 13:16:35.572723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.613011 (+ 40288us) service_pool.cc:224] Handling call
0709 13:16:35.613355 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.613672 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:35.970934 (+357262us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.533396 (+562462us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:36.877526 (+344130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.877659 (+   133us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:36.877795 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.877900 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.878076 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23839,"prepare.queue_time_us":459700,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":51472,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":13469,"spinlock_wait_cycles":16141184,"thread_start_us":449038,"threads_started":2,"wal-append.queue_time_us":222980,"wal-append.run_cpu_time_us":38024,"wal-append.run_wall_time_us":2660133}
I20260709 13:16:40.211505 10136 maintenance_manager.cc:643] P 07026dacaf3c454eb902b449c5c122fe: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.987s	user 0.196s	sys 0.053s Metrics: {"bytes_written":29472,"cfile_init":1,"dirs.queue_time_us":9374,"dirs.run_cpu_time_us":485,"dirs.run_wall_time_us":914,"drs_written":1,"lbm_read_time_us":385,"lbm_reads_lt_1ms":4,"lbm_write_time_us":13188,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":63,"thread_start_us":9598,"threads_started":1}
I20260709 13:16:40.327476 10316 rpcz_store.cc:276] 0709 13:16:35.542578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.370099 (+827521us) service_pool.cc:224] Handling call
0709 13:16:40.207298 (+3837199us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:40.325203 (+117905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.326599 (+  1396us) spinlock_profiling.cc:243] Waited 3.81 s on lock 0x7b54002c7ed0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:40.326802 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8760994048}
I20260709 13:16:37.158628 10288 leader_election.cc:400] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10.
I20260709 13:16:40.330757 10288 leader_election.cc:403] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:16:40.331456 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 3.17284e+06us
I20260709 13:16:40.331499 10137 maintenance_manager.cc:419] P 07026dacaf3c454eb902b449c5c122fe: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10660 bytes on disk
W20260709 13:16:40.214715 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800192440 after lost signal to thread 9150
W20260709 13:16:40.333352 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800192200 after lost signal to thread 10182
I20260709 13:16:40.217674 14074 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:40.334765 10271 debug-util.cc:398] Leaking SignalData structure 0x7b080010d460 after lost signal to thread 10274
W20260709 13:16:40.335153 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6420 after lost signal to thread 10275
W20260709 13:16:40.336273 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0560 after lost signal to thread 10349
W20260709 13:16:40.336550 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb100 after lost signal to thread 10350
I20260709 13:16:40.337035 14074 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.217957 14066 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:40.337687 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800408ac0 after lost signal to thread 10423
I20260709 13:16:40.338514 14353 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.339799 14066 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.340663 14066 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:40.344484 14269 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:40.344956 14269 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:40.346220 14226 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.346033 14269 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.347093 14226 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.347736 14269 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.334785 10136 maintenance_manager.cc:643] P 07026dacaf3c454eb902b449c5c122fe: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":480,"lbm_reads_lt_1ms":4}
I20260709 13:16:40.218098 10318 raft_consensus.cc:1275] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:40.221028 14097 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.355093 14097 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.357522 14097 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.225459 14396 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.358359 14396 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.360750 14396 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.361573 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2332) took 4737 ms. Trace:
I20260709 13:16:40.361935 10318 rpcz_store.cc:276] 0709 13:16:35.623881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.217266 (+4593385us) service_pool.cc:224] Handling call
0709 13:16:40.217660 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.361253 (+143593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.361482 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.227876 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2328) took 4665 ms. Trace:
I20260709 13:16:40.363092 10324 rpcz_store.cc:276] 0709 13:16:35.562949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.087064 (+1524115us) service_pool.cc:224] Handling call
0709 13:16:37.087540 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.227552 (+3140012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.227818 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:40.228217 10346 debug-util.cc:398] Leaking SignalData structure 0x7b0800208360 after lost signal to thread 9150
W20260709 13:16:40.364833 10346 debug-util.cc:398] Leaking SignalData structure 0x7b080020cdc0 after lost signal to thread 10182
I20260709 13:16:40.364599 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.365618 10243 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:16:40.229001 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.368232 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.368914 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.370174 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.371002 10245 raft_consensus.cc:2368] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
I20260709 13:16:40.371116 10246 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:16:40.371943 14342 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:40.372421 14342 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.372457 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.373113 14342 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:40.229313 14362 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:40.374670 14362 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.377262 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.229568 14367 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.377985 10248 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:40.229059 14339 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.379648 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 70917.3us
I20260709 13:16:40.379845 14339 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.230979 14357 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.230988 14373 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:40.240059 10393 rpcz_store.cc:269] 0709 13:16:34.305836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.306008 (+   172us) service_pool.cc:224] Handling call
0709 13:16:37.238708 (+2932700us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54004501d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:37.238912 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907773824}
I20260709 13:16:40.384034 14357 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:40.240732 10396 rpcz_store.cc:269] 0709 13:16:35.582367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.637138 (+ 54771us) service_pool.cc:224] Handling call
0709 13:16:37.178887 (+1541749us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b54003b97d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:37.179153 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218255744}
W20260709 13:16:40.242189 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 3.03837e+06us
I20260709 13:16:40.243147 14430 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:40.385157 14430 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:40.385743 14430 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.386387 10250 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.384068 14373 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:40.387881 10346 debug-util.cc:398] Leaking SignalData structure 0x7b080017e900 after lost signal to thread 10274
W20260709 13:16:40.389171 10346 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6200 after lost signal to thread 10349
W20260709 13:16:40.389428 10346 debug-util.cc:398] Leaking SignalData structure 0x7b080034eda0 after lost signal to thread 10350
I20260709 13:16:40.245362 14427 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:40.247853 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08000bfaa0 after lost signal to thread 10132
W20260709 13:16:40.390609 10346 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad8e0 after lost signal to thread 10423
W20260709 13:16:40.391103 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7400 after lost signal to thread 10182
W20260709 13:16:40.391815 10346 debug-util.cc:398] Leaking SignalData structure 0x7b08003d48a0 after lost signal to thread 11027
W20260709 13:16:40.391944 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003457a0 after lost signal to thread 10242
W20260709 13:16:40.392163 10346 debug-util.cc:398] Leaking SignalData structure 0x7b0800343100 after lost signal to thread 11028
W20260709 13:16:40.392357 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3ec0 after lost signal to thread 10248
I20260709 13:16:40.392390 14427 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:40.393162 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800423c80 after lost signal to thread 10274
I20260709 13:16:40.246589 14428 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:40.251106 10967 connection.cc:256] RPC call timeout handler was delayed by -1.2750112860001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:16:40.393771 10967 connection.cc:256] RPC call timeout handler was delayed by -1.2705112860001009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 13:16:40.394547 14429 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.201478 13812 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:40.411834 13812 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.414363 14429 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.414883 14226 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.416297 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.416620 14429 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:40.417223 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 79489.3us
W20260709 13:16:40.253577 10994 rpcz_store.cc:269] 0709 13:16:37.202051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.203145 (+  1094us) service_pool.cc:224] Handling call
0709 13:16:40.253021 (+3049876us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:40.254596 10290 connection.cc:256] RPC call timeout handler was delayed by -1.106231095999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:16:40.418529 10290 connection.cc:256] RPC call timeout handler was delayed by -1.0466853519999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 13:16:40.420143 14254 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:40.254711 14270 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.255802 14054 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.256645 14108 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:40.255802 14340 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.257902 14391 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:40.256423 11001 rpcz_store.cc:269] 0709 13:16:37.202354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.282047 (+ 79693us) service_pool.cc:224] Handling call
0709 13:16:40.255970 (+2973923us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.422248 14428 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.422537 14255 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:40.423300 14270 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.265292 14076 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.254189 10999 rpcz_store.cc:276] 0709 13:16:35.745031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.745140 (+   109us) service_pool.cc:224] Handling call
0709 13:16:35.745417 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.745738 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:36.803475 (+1057737us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b180045eda0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c74e03c7 00007f58c3af29a7 00007f58c3b020bf
0709 13:16:36.803708 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.121518 (+317810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.121614 (+    96us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:37.121704 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.121800 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.121954 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17929,"prepare.queue_time_us":83965,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3383,"raft.queue_time_us":969,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":7370624,"thread_start_us":425297,"threads_started":2,"wal-append.queue_time_us":40880,"wal-append.run_cpu_time_us":20215,"wal-append.run_wall_time_us":1928364}
W20260709 13:16:40.257939 10998 rpcz_store.cc:269] 0709 13:16:37.196129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.202204 (+  6075us) service_pool.cc:224] Handling call
0709 13:16:40.257415 (+3055211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.269544 14139 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:38.830366 14188 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.281454 14256 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:37.306078 14310 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.285665 14313 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:40.428428 14188 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.433246 14188 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.434491 11000 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:16:40.437441 11000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 822) took 3235 ms (client timeout 3164 ms). Trace:
I20260709 13:16:40.289688 14343 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.299082 14376 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:40.439627 14376 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.441174 14376 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.300418 14375 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:40.371851 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.443441 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.444796 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.378674 14367 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:40.228796 10317 rpcz_store.cc:269] 0709 13:16:35.608475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.715435 (+106960us) service_pool.cc:224] Handling call
0709 13:16:38.785197 (+3069762us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540020ab54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:38.785688 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3388337536}
W20260709 13:16:40.437968 11000 rpcz_store.cc:269] 0709 13:16:37.201730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.201866 (+   136us) service_pool.cc:224] Handling call
0709 13:16:40.437099 (+3235233us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001b8354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:40.437338 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426108160}
I20260709 13:16:40.385667 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:40.393427 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800423ec0 after lost signal to thread 10275
W20260709 13:16:40.448565 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800423d20 after lost signal to thread 10288
W20260709 13:16:40.448880 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800423ca0 after lost signal to thread 10289
W20260709 13:16:40.449471 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080038ce80 after lost signal to thread 10318
W20260709 13:16:40.449832 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0060 after lost signal to thread 10319
W20260709 13:16:40.450074 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080038b400 after lost signal to thread 10320
W20260709 13:16:37.154690 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.252334 14426 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.373962 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.377802 14362 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.399962 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.457614 14270 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.457973 11000 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:40.338068 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800408ae0 after lost signal to thread 10424
I20260709 13:16:40.459276 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:40.460403 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800393b20 after lost signal to thread 11027
W20260709 13:16:40.460829 10271 debug-util.cc:398] Leaking SignalData structure 0x7b080034d7c0 after lost signal to thread 11028
W20260709 13:16:40.461324 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800322960 after lost signal to thread 14054
W20260709 13:16:40.461614 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800345260 after lost signal to thread 14066
W20260709 13:16:40.461905 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003427c0 after lost signal to thread 14074
W20260709 13:16:40.194578 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 3.10742e+06us
I20260709 13:16:40.401719 10250 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:40.410423 14339 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.420527 10290 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:40.427901 14076 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.421900 14108 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.428411 14097 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:40.450302 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea9a0 after lost signal to thread 10321
I20260709 13:16:40.445958 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.451001 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.451342 10242 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
W20260709 13:16:40.471356 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003defc0 after lost signal to thread 14097
W20260709 13:16:40.473043 10271 debug-util.cc:398] Leaking SignalData structure 0x7b080023eba0 after lost signal to thread 14108
W20260709 13:16:40.473452 10271 debug-util.cc:398] Leaking SignalData structure 0x7b080039bb00 after lost signal to thread 14133
W20260709 13:16:40.473875 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003af7e0 after lost signal to thread 14226
I20260709 13:16:40.421801 14342 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:40.474937 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003da7e0 after lost signal to thread 10322
I20260709 13:16:40.475056 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:40.475695 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080022e920 after lost signal to thread 10323
W20260709 13:16:40.476069 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800323080 after lost signal to thread 10324
W20260709 13:16:40.476372 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080039aa60 after lost signal to thread 10325
W20260709 13:16:40.477075 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6060 after lost signal to thread 10349
W20260709 13:16:40.477383 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec640 after lost signal to thread 10350
W20260709 13:16:40.477727 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080038dd60 after lost signal to thread 10362
W20260709 13:16:40.477489 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 82817.8us
W20260709 13:16:40.478511 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58090.8us
W20260709 13:16:40.480774 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080034d3a0 after lost signal to thread 10390
W20260709 13:16:40.481225 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800391980 after lost signal to thread 10391
W20260709 13:16:40.481524 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800208ba0 after lost signal to thread 10393
W20260709 13:16:40.481820 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800392880 after lost signal to thread 10396
W20260709 13:16:40.474175 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800226720 after lost signal to thread 14230
W20260709 13:16:40.482501 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800173ec0 after lost signal to thread 14231
W20260709 13:16:40.482869 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800357d60 after lost signal to thread 14255
W20260709 13:16:40.483206 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003d97c0 after lost signal to thread 14263
W20260709 13:16:40.483506 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003910c0 after lost signal to thread 14270
W20260709 13:16:40.483796 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003bff40 after lost signal to thread 14279
W20260709 13:16:40.484062 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800376460 after lost signal to thread 14287
W20260709 13:16:40.484588 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800227200 after lost signal to thread 14353
W20260709 13:16:40.484910 10271 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac0e0 after lost signal to thread 14357
W20260709 13:16:40.485239 10271 debug-util.cc:398] Leaking SignalData structure 0x7b080036fa40 after lost signal to thread 14367
W20260709 13:16:40.485677 10271 debug-util.cc:398] Leaking SignalData structure 0x7b0800411680 after lost signal to thread 14391
W20260709 13:16:40.482107 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080035bb00 after lost signal to thread 10399
I20260709 13:16:40.425848 14400 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.472934 10242 pending_rounds.cc:85] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
W20260709 13:16:40.487180 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 101636us
I20260709 13:16:40.493783 10242 pending_rounds.cc:107] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 13:16:40.487767 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080030b720 after lost signal to thread 10423
I20260709 13:16:40.494187 10242 raft_consensus.cc:2889] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:40.494297 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7300 after lost signal to thread 10424
I20260709 13:16:40.494359 10246 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:40.494951 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800364480 after lost signal to thread 10965
W20260709 13:16:40.495389 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080038e380 after lost signal to thread 10968
I20260709 13:16:40.486472 14054 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.498322 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.498988 10399 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:40.499053 14108 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:40.499157 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 72a1fe75b2bc4fb698d13f9d0b2dda04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:40.499971 14270 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:40.500401 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.500603 14270 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:40.500991 10325 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:40.496310 10247 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:40.448046 14367 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.414222 13812 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:40.425652 14396 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:16:40.501995 14430 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.502684 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.503363 10322 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:40.504420 14430 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.504608 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.450183 14226 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:16:40.505283 10320 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:40.496495 14343 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.450488 14254 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:40.507537 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.507779 14343 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.508262 14343 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.508479 14254 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.510671 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.451582 14340 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.500025 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.519609 10316 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:40.520686 10245 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:40.512059 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:40.497416 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08001fbf60 after lost signal to thread 10994
W20260709 13:16:40.521342 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbfc0 after lost signal to thread 10998
W20260709 13:16:40.521838 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800293680 after lost signal to thread 10999
W20260709 13:16:40.522143 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800366940 after lost signal to thread 11000
I20260709 13:16:40.522200 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:40.522725 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800390440 after lost signal to thread 11001
I20260709 13:16:40.522854 10322 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:40.523406 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080032eb80 after lost signal to thread 11027
W20260709 13:16:40.523841 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800337040 after lost signal to thread 11028
I20260709 13:16:40.524461 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.526044 10396 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 7.
I20260709 13:16:40.525249 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:40.526490 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.526998 10393 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.527070 10318 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:40.527017 10390 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:40.528234 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.529067 10324 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:40.529120 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800351da0 after lost signal to thread 13812
I20260709 13:16:40.529695 10320 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:40.523295 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.521315 11000 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:16:40.535138 10246 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
W20260709 13:16:40.537111 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800064ec0 after lost signal to thread 14054
W20260709 13:16:40.537606 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003903a0 after lost signal to thread 14066
W20260709 13:16:40.537896 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800388920 after lost signal to thread 14068
W20260709 13:16:40.538182 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800398bc0 after lost signal to thread 14074
W20260709 13:16:40.538512 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800398fc0 after lost signal to thread 14097
W20260709 13:16:40.539152 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea840 after lost signal to thread 14108
W20260709 13:16:40.539513 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8dc0 after lost signal to thread 14133
W20260709 13:16:40.539805 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003a57a0 after lost signal to thread 14139
W20260709 13:16:40.540203 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce920 after lost signal to thread 14226
W20260709 13:16:40.540484 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080032f640 after lost signal to thread 14230
W20260709 13:16:40.544822 10967 connection.cc:256] RPC call timeout handler was delayed by -1.1841112860001886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 13:16:40.501576 14270 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:40.550477 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.551644 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1400 after lost signal to thread 14231
W20260709 13:16:40.552150 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc900 after lost signal to thread 14234
W20260709 13:16:40.552419 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9c00 after lost signal to thread 14250
W20260709 13:16:40.552759 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800367680 after lost signal to thread 14255
W20260709 13:16:40.553468 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf1a0 after lost signal to thread 14256
W20260709 13:16:40.553788 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce880 after lost signal to thread 14263
W20260709 13:16:40.554101 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003de380 after lost signal to thread 14269
W20260709 13:16:40.554386 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2ee0 after lost signal to thread 14270
W20260709 13:16:40.554699 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080028a1c0 after lost signal to thread 14279
W20260709 13:16:40.555006 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca980 after lost signal to thread 14287
W20260709 13:16:40.555384 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd100 after lost signal to thread 14335
W20260709 13:16:40.555624 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800391860 after lost signal to thread 14339
W20260709 13:16:40.555840 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003a31e0 after lost signal to thread 14340
W20260709 13:16:40.556061 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd5c0 after lost signal to thread 14342
W20260709 13:16:40.556382 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003baac0 after lost signal to thread 14353
W20260709 13:16:40.556618 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800388960 after lost signal to thread 14357
W20260709 13:16:40.556865 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003994a0 after lost signal to thread 14360
I20260709 13:16:40.557332 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.557624 10321 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:40.558148 10319 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:40.529909 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.559360 10317 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:40.560367 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.561092 10244 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:40.520453 14400 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.563185 11000 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:40.564168 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:40.565997 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080019d9e0 after lost signal to thread 14362
I20260709 13:16:40.557410 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:40.566435 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800234e80 after lost signal to thread 14365
W20260709 13:16:40.566690 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800343580 after lost signal to thread 14367
W20260709 13:16:40.567147 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800234e20 after lost signal to thread 14375
W20260709 13:16:40.567356 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800234d80 after lost signal to thread 14376
W20260709 13:16:40.567595 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002078c0 after lost signal to thread 14391
I20260709 13:16:40.566649 10399 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
W20260709 13:16:40.570672 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5f20 after lost signal to thread 14400
I20260709 13:16:40.570468 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:40.571043 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080038ae20 after lost signal to thread 14414
W20260709 13:16:40.572456 10965 connection.cc:256] RPC call timeout handler was delayed by -3.3295539899997948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:16:40.572897 10965 connection.cc:256] RPC call timeout handler was delayed by -3.3277539899997919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 13:16:40.574033 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.499087 14391 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.519716 14353 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10.
I20260709 13:16:40.563465 10998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:40.571837 14188 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.575364 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:40.582784 10998 raft_consensus.cc:606] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:40.594142 10321 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:40.594472 10998 raft_consensus.cc:614] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.582901 10390 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:40.585208 14188 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.595952 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.596237 10249 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:40.596645 10250 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:40.586503 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.597234 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.587401 14342 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.598073 10249 raft_consensus.cc:2410] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:40.563838 14400 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.588733 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:40.598508 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.598590 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.599368 10247 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:40.600265 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.601328 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.601534 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:40.589356 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:40.602555 10999 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:40.590545 10364 leader_election.cc:336] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.717s (SENT)
I20260709 13:16:40.591144 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:40.605834 11000 raft_consensus.cc:2368] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
I20260709 13:16:40.597270 14188 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:40.606149 14340 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.609126 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.610219 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.610822 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.610932 10391 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:40.611462 10397 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:40.612398 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.612954 11001 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:40.613113 10394 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:40.613564 10999 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:40.594152 10392 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:40.619895 10967 leader_election.cc:336] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.543s (SENT)
I20260709 13:16:40.620302 10246 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:40.620671 10395 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:40.620424 10325 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:40.620879 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:40.626940 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:40.627199 10394 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:40.575881 14076 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.634434 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52101.2us
I20260709 13:16:40.633363 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:40.635751 14430 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:40.636373 14430 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:40.637319 14430 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:40.639635 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.640369 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.641063 10288 connection.cc:256] RPC call timeout handler was delayed by -3.6196041769999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:16:40.641085 14108 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.641594 10288 connection.cc:256] RPC call timeout handler was delayed by -3.4846041769999374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:16:40.641788 14108 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.642584 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.643388 11001 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:40.643716 14340 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:40.644412 10323 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
W20260709 13:16:40.645133 10965 leader_election.cc:336] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.829s (SENT)
I20260709 13:16:40.646076 14108 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:40.646768 10965 connection.cc:256] RPC call timeout handler was delayed by -2.4924386089999189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:16:40.647161 10965 connection.cc:256] RPC call timeout handler was delayed by -2.4406767179998496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:16:40.647703 10965 connection.cc:256] RPC call timeout handler was delayed by -2.3403386089999003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:16:40.648015 10965 connection.cc:256] RPC call timeout handler was delayed by -2.1324386089997915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:16:40.648530 14400 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.649106 14400 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.635315 14343 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.651197 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.651561 14400 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.651784 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.652161 14400 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.653046 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.653784 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.654971 10322 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
W20260709 13:16:40.641974 10288 connection.cc:256] RPC call timeout handler was delayed by -3.4657041769999068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:16:40.656556 10288 connection.cc:256] RPC call timeout handler was delayed by -3.4513041769998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:16:40.656934 10288 connection.cc:256] RPC call timeout handler was delayed by -3.279404176999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:16:40.657243 10288 connection.cc:256] RPC call timeout handler was delayed by -3.2128041769999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:16:40.657557 10288 connection.cc:256] RPC call timeout handler was delayed by -3.0823041769999691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:16:40.657859 10288 connection.cc:256] RPC call timeout handler was delayed by -2.9842041769998104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 13:16:40.658161 10288 connection.cc:256] RPC call timeout handler was delayed by -2.9689041769997857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:16:40.658470 10288 connection.cc:256] RPC call timeout handler was delayed by -2.7547041769998941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24780000000000002s for a response
I20260709 13:16:40.658720 10316 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
W20260709 13:16:40.658805 10288 connection.cc:256] RPC call timeout handler was delayed by -2.3641041769999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2912s for a response
W20260709 13:16:40.659075 10965 connection.cc:256] RPC call timeout handler was delayed by -2.0923767179999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:16:40.660017 10965 connection.cc:256] RPC call timeout handler was delayed by -2.0019386089998079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:16:40.660392 10965 connection.cc:256] RPC call timeout handler was delayed by -1.880876717999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:16:40.660717 10965 connection.cc:256] RPC call timeout handler was delayed by -1.774653212999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 13:16:40.661021 10965 connection.cc:256] RPC call timeout handler was delayed by -1.774653212999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
I20260709 13:16:40.633111 14188 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:40.652814 14400 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.671238 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.671538 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.672122 10316 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:16:40.672235 10241 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:40.675120 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.676194 10998 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:40.676890 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.678731 11001 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:16:40.684136 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.673805 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.692585 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:40.677798 10994 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:40.654117 14076 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:40.696849 10390 raft_consensus.cc:2410] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:40.697062 10322 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:40.698681 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.699537 10993 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 5.
I20260709 13:16:40.644349 14340 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:40.714838 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 122992us
I20260709 13:16:40.703148 10398 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:40.698247  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:40.718117 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.704764 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:40.705612 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.718863 10996 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:40.644402 14376 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:40.710510 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 90643.6us
W20260709 13:16:40.719913 10967 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.573s (SENT)
I20260709 13:16:40.720639 10392 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
W20260709 13:16:40.721306 10967 leader_election.cc:336] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.657s (SENT)
I20260709 13:16:40.711021 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:40.722671 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 46102.3us
I20260709 13:16:40.718909 10997 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:40.702612 10213 connection.cc:256] RPC call timeout handler was delayed by -3.5186958409999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:16:40.724161 10213 connection.cc:256] RPC call timeout handler was delayed by -3.49799584099992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:16:40.724612 10213 connection.cc:256] RPC call timeout handler was delayed by -3.3755958409999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:16:40.725004 10213 connection.cc:256] RPC call timeout handler was delayed by -3.3584958409999217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:16:40.725361 10213 connection.cc:256] RPC call timeout handler was delayed by -3.1748958409998522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 13:16:40.725710 10213 connection.cc:256] RPC call timeout handler was delayed by -3.1478958409998086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 13:16:40.721868 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:40.713475 14343 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.727393 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.719372 11002 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:40.728302 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.727850 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.729061 11001 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:40.729074 10241 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
W20260709 13:16:40.726071 10213 connection.cc:256] RPC call timeout handler was delayed by -3.0173958409998249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:16:40.731630 10213 connection.cc:256] RPC call timeout handler was delayed by -3.0173958409998249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:16:40.732020 10213 connection.cc:256] RPC call timeout handler was delayed by -2.9696958409999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:16:40.732438 10213 connection.cc:256] RPC call timeout handler was delayed by -2.9696958409999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:16:40.732879 10213 connection.cc:256] RPC call timeout handler was delayed by -2.32979584099985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2838s for a response
W20260709 13:16:40.733302 10213 connection.cc:256] RPC call timeout handler was delayed by -2.32979584099985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2838s for a response
W20260709 13:16:40.733860 10213 connection.cc:256] RPC call timeout handler was delayed by -1.8743958409997958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33440000000000003s for a response
I20260709 13:16:40.735018 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.727198 14188 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:40.738503 10993 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:40.742810 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.743526 10321 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:40.746280 10999 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:40.751319 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.756323 10322 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:40.758327 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.759198 10241 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:40.758560 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.759689 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.747673 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.761155 10316 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:40.752040 10323 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:40.763130 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.763845 10319 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:40.764686 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.765161 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.765514 10317 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:40.766386 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.766583 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.767009 10242 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:40.767617 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.769556 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.771443 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.772226 10247 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:40.773276 10393 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:40.774396 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.774689 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:40.775342 10320 raft_consensus.cc:2410] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:40.776180 14076 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.775334 10246 raft_consensus.cc:2376] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12. Re-sending same reply.
I20260709 13:16:40.777026 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.777688 10996 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:40.727850 14353 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:40.785342 14353 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.787554 14353 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.738168 14313 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:40.788160 14313 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:40.781368 14091 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:40.781368 14156 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:40.788606 14313 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.792346  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:40.796663 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.818377 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:40.820590 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:40.827214 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.739074 14376 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:40.830014 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:40.832425 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.834419 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 113129us
I20260709 13:16:40.839237 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.841562 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.842474 10323 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:40.837911 10317 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:40.836320 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:40.847373 10967 connection.cc:256] RPC call timeout handler was delayed by -1.6392851509999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:16:40.847592 10319 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:40.849848 10316 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:16:40.851413 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.856051 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.861450 10321 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:40.848134 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:40.864027 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:40.865782 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 45915.3us
I20260709 13:16:40.867919 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:40.868364 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.869354 10324 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:40.871129 10317 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:40.804668 14091 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:40.875152 10319 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260709 13:16:40.885618 10322 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:16:40.888043 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.890875 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.906036 10247 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:40.959200 10317 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:40.866736 14400 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:40.872331 14343 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:40.887202 14367 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:40.896413 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:40.966754 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.967519 10322 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
W20260709 13:16:40.917271 10967 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.761s (SENT)
W20260709 13:16:40.919646 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 90965.5us
I20260709 13:16:40.920006 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:40.921428 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.969533 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.922798 10319 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:40.936247 14340 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:40.927784 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.971319 10316 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:40.972401 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.973765 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.975414 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.929600 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.976787 10321 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:40.930935 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.977511 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:40.935099 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.936874 10318 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:40.945253 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:40.948155 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.863188 14188 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:40.948560 14440 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:40.936097 10146 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:16:40.981405 10364 leader_election.cc:336] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.917s (SENT)
I20260709 13:16:40.982120 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:40.982877 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.985445 10317 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:40.963429 14343 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:40.998934 10244 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:40.990353 14188 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:41.001978 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 112791us
I20260709 13:16:40.997471 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:40.996227 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.012881 10322 raft_consensus.cc:2410] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:16:41.014386 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.015612 10317 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:41.004377 10319 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:40.988399 14340 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:40.993979 14367 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:41.029740 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47627.7us
I20260709 13:16:41.024499 10146 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.027186 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:41.003211 14343 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.010798 14376 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:41.046041 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.047343 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:41.040995 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 123773us
W20260709 13:16:41.052042 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 70351.4us
I20260709 13:16:41.053500 10244 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.050180 10319 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:41.060233 10146 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 8, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 8 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.065014 10364 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 2.001s (SENT)
I20260709 13:16:41.070832 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.049868 14076 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:41.093432 10323 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
W20260709 13:16:41.096688 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 43817.5us
W20260709 13:16:41.098062 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 153009us
I20260709 13:16:41.099728 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:41.104266 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.105350 10248 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:41.106433 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:41.107769 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.114995 10241 raft_consensus.cc:2368] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
W20260709 13:16:41.115069 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed5a0 after lost signal to thread 9147
W20260709 13:16:41.115777 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad040 after lost signal to thread 9150
W20260709 13:16:41.116122 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001db0c0 after lost signal to thread 10132
I20260709 13:16:41.069296 10146 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 10, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.122988 10146 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 10, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.124769 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800188100 after lost signal to thread 10136
I20260709 13:16:41.124612 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.126773 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.131076 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.132256 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:41.133713 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001db160 after lost signal to thread 10182
I20260709 13:16:41.134217 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:41.134894 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001db080 after lost signal to thread 10213
W20260709 13:16:41.135340 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800188580 after lost signal to thread 10216
I20260709 13:16:41.135869 10245 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:41.135888 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800188000 after lost signal to thread 10241
I20260709 13:16:41.134171 10249 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:16:41.136448 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800188ac0 after lost signal to thread 10242
I20260709 13:16:41.136091 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:41.137200 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.137465 14353 raft_consensus.cc:2764] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:41.138060 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:41.138514 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.139180 10246 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:41.134122 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.140314 10997 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
W20260709 13:16:41.142596 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001da600 after lost signal to thread 10248
W20260709 13:16:41.142947 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800188560 after lost signal to thread 10250
W20260709 13:16:41.143404 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800173240 after lost signal to thread 10271
I20260709 13:16:41.140648 10248 raft_consensus.cc:2376] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9. Re-sending same reply.
W20260709 13:16:41.155506 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001daf80 after lost signal to thread 10274
W20260709 13:16:41.155977 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001dafa0 after lost signal to thread 10275
W20260709 13:16:41.156327 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6fc0 after lost signal to thread 10288
W20260709 13:16:41.159096 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800198040 after lost signal to thread 10289
W20260709 13:16:41.159425 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080039bb60 after lost signal to thread 10290
I20260709 13:16:41.159677 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:41.160012 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800334de0 after lost signal to thread 10317
I20260709 13:16:41.131856 14367 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:41.160319 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0160 after lost signal to thread 10318
W20260709 13:16:41.163409 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0180 after lost signal to thread 10319
W20260709 13:16:41.163733 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0100 after lost signal to thread 10320
W20260709 13:16:41.163959 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800061ca0 after lost signal to thread 10321
I20260709 13:16:41.102734 14430 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:41.154795 14156 raft_consensus.cc:2764] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:16:41.165940 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800371260 after lost signal to thread 10322
W20260709 13:16:41.167328 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d00a0 after lost signal to thread 10323
W20260709 13:16:41.167654 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0300 after lost signal to thread 10324
W20260709 13:16:41.167861 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d01c0 after lost signal to thread 10325
I20260709 13:16:41.167991 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:41.168504 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d07c0 after lost signal to thread 10346
W20260709 13:16:41.168802 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d04a0 after lost signal to thread 10349
W20260709 13:16:41.169111 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0660 after lost signal to thread 10350
W20260709 13:16:41.169348 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4120 after lost signal to thread 10362
W20260709 13:16:41.171530 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7420 after lost signal to thread 10390
W20260709 13:16:41.171789 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d77e0 after lost signal to thread 10391
W20260709 13:16:41.171991 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080037fcc0 after lost signal to thread 10392
W20260709 13:16:41.172201 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7820 after lost signal to thread 10393
W20260709 13:16:41.166823 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.174937 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d76a0 after lost signal to thread 10396
I20260709 13:16:41.131676 14375 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:16:41.179380 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800296ce0 after lost signal to thread 10399
W20260709 13:16:41.180100 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003da620 after lost signal to thread 10423
W20260709 13:16:41.180460 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003a75e0 after lost signal to thread 10424
W20260709 13:16:41.180888 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800344260 after lost signal to thread 10967
W20260709 13:16:41.181329 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea9e0 after lost signal to thread 10968
W20260709 13:16:41.181852 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800281c40 after lost signal to thread 10994
W20260709 13:16:41.182119 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6920 after lost signal to thread 10998
W20260709 13:16:41.182408 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb5c0 after lost signal to thread 10999
W20260709 13:16:41.182600 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800399fa0 after lost signal to thread 11000
W20260709 13:16:41.182791 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080038c140 after lost signal to thread 11001
W20260709 13:16:41.183308 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800258aa0 after lost signal to thread 11027
W20260709 13:16:41.183540 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6960 after lost signal to thread 11028
W20260709 13:16:41.183753 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080035fb60 after lost signal to thread 13695
W20260709 13:16:41.183943 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080009c640 after lost signal to thread 13812
W20260709 13:16:41.184199 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800088220 after lost signal to thread 14066
W20260709 13:16:41.184381 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800372e60 after lost signal to thread 14068
W20260709 13:16:41.184572 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0be0 after lost signal to thread 14074
W20260709 13:16:41.184784 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecfe0 after lost signal to thread 14097
W20260709 13:16:41.184966 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080031bd20 after lost signal to thread 14108
I20260709 13:16:41.174924 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:41.185586 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080038fe40 after lost signal to thread 14133
W20260709 13:16:41.185868 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4ec0 after lost signal to thread 14139
W20260709 13:16:41.186270 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003d21a0 after lost signal to thread 14156
W20260709 13:16:41.186502 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb5a0 after lost signal to thread 14188
I20260709 13:16:41.179704 10146 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:16:41.186734 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080035d9a0 after lost signal to thread 14219
W20260709 13:16:41.187012 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea400 after lost signal to thread 14226
I20260709 13:16:41.180889 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:41.187271 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080034e280 after lost signal to thread 14230
W20260709 13:16:41.187558 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1740 after lost signal to thread 14231
W20260709 13:16:41.187913 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9fe0 after lost signal to thread 14234
W20260709 13:16:41.188208 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0d80 after lost signal to thread 14250
I20260709 13:16:41.162492 14367 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:41.190204 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.170675 13812 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:41.192555 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 84806.7us
I20260709 13:16:41.193531 14091 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.193980 14091 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.194473 14091 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.198562 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.199268 10249 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.207612 10146 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 11 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:16:41.210578 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 70700.5us
I20260709 13:16:41.212213 14156 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:41.213847  9152 debug-util.cc:398] Leaking SignalData structure 0x7b08003db7e0 after lost signal to thread 10288
I20260709 13:16:41.209179 10146 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 5, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 5 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.166775 14076 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:16:41.191776 14367 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:41.216758 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52306.5us
W20260709 13:16:41.188465 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6880 after lost signal to thread 14257
I20260709 13:16:41.218168 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:41.221983 14353 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:41.220528 14340 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.226748 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.228063 14376 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.228508 14376 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:41.228888 14376 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.224715 10244 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:41.224795 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:41.225263 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003c00e0 after lost signal to thread 14263
I20260709 13:16:41.226863 14340 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.251034 14340 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.233570 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:16:41.234416 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 104564us
I20260709 13:16:41.262812 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:41.263767 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.221074 10146 catalog_manager.cc:5697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.240402 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:41.230252 14353 consensus_queue.cc:1243] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:41.218374 14313 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:41.248878 10148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 310) took 25274 ms (client timeout 15000 ms). Trace:
I20260709 13:16:41.250451 14270 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:41.232664 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad0e0 after lost signal to thread 14269
W20260709 13:16:41.270375 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7d80 after lost signal to thread 14270
W20260709 13:16:41.270980 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9820 after lost signal to thread 14279
I20260709 13:16:41.267789 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 8, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 8 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:16:41.280591 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800407160 after lost signal to thread 14287
W20260709 13:16:41.281104 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08004074a0 after lost signal to thread 14310
I20260709 13:16:41.279526 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:41.281440 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080029da20 after lost signal to thread 14313
W20260709 13:16:41.281786 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08004074e0 after lost signal to thread 14335
W20260709 13:16:41.282107 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800407520 after lost signal to thread 14339
W20260709 13:16:41.282377 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800407040 after lost signal to thread 14340
W20260709 13:16:41.282668 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08004072c0 after lost signal to thread 14342
W20260709 13:16:41.282958 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080039a8e0 after lost signal to thread 14343
W20260709 13:16:41.283294 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080039dd80 after lost signal to thread 14353
W20260709 13:16:41.283562 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003047c0 after lost signal to thread 14357
W20260709 13:16:41.283872 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080038fd80 after lost signal to thread 14360
W20260709 13:16:41.284165 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800224c40 after lost signal to thread 14362
W20260709 13:16:41.284451 10420 debug-util.cc:398] Leaking SignalData structure 0x7b0800337280 after lost signal to thread 14365
W20260709 13:16:41.287561 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3c20 after lost signal to thread 14367
I20260709 13:16:41.288224 14461 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:41.288857 14456 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:41.288089 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08001797a0 after lost signal to thread 14373
I20260709 13:16:41.280687 10146 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:16:41.292232 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08003cac60 after lost signal to thread 14375
I20260709 13:16:41.296569 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.281273 14076 raft_consensus.cc:2764] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:41.305498 10244 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:41.298686 10146 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.308796 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.280388 14270 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:41.309168 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68835.6us
I20260709 13:16:41.311842 10146 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.314064 10146 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 12, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.306025 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080038b360 after lost signal to thread 14376
W20260709 13:16:41.318727 10420 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8f20 after lost signal to thread 14391
W20260709 13:16:41.319327 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080033b040 after lost signal to thread 14400
W20260709 13:16:41.319813 10420 debug-util.cc:398] Leaking SignalData structure 0x7b080024f140 after lost signal to thread 14414
I20260709 13:16:41.268530 14367 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.325627 10249 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:41.285666 14375 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:16:41.304451 14456 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:41.330083 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 109956us
W20260709 13:16:41.328176 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 115431us
I20260709 13:16:41.309726 14188 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:41.334453 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.317060 14270 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:41.335769 14400 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:16:41.339283 14400 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:41.331028 14456 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.334664 10965 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:41.355878 14400 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:41.356823 14400 raft_consensus.cc:697] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:41.358646 14400 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.363271 14313 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:41.368849 14353 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.369387 14353 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:41.369786 14353 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.370327 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.372236 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.372982 10398 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:41.374503 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.375366 10398 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:41.375800 14367 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:41.376626 10250 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:41.376966 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:41.378525 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.381644 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:41.382858 10998 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:16:41.381904 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 62284.6us
I20260709 13:16:41.384479 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:41.386644 14367 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:41.387296 14367 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.387763 14367 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.387835 14428 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:41.388352 14428 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:41.269657 10148 rpcz_store.cc:269] 0709 13:16:15.944402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.944673 (+   271us) service_pool.cc:224] Handling call
0709 13:16:41.189249 (+25244576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:35.740843 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:35.959033 (+218190us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:35.961924 (+  2891us) write_op.cc:435] Acquired schema lock
0709 13:16:35.967946 (+  6022us) tablet.cc:662] Decoding operations
0709 13:16:36.066764 (+ 98818us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:36.066830 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:36.066867 (+    37us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:36.093205 (+ 26338us) tablet.cc:701] Row locks acquired
0709 13:16:36.093236 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:16:36.093482 (+   246us) write_op.cc:270] Start()
0709 13:16:36.093656 (+   174us) write_op.cc:276] Timestamp: P: 1783602996093414 usec, L: 0
0709 13:16:36.093693 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:16:36.448154 (+354461us) log.cc:844] Serialized 1312 byte log entry
0709 13:16:37.137897 (+689743us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c09de0ac 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b
0709 13:16:40.294678 (+3156781us) op_driver.cc:464] REPLICATION: finished
0709 13:16:40.296238 (+  1560us) write_op.cc:301] APPLY: starting
0709 13:16:40.296372 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:40.301683 (+  5311us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:40.301728 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:40.304425 (+  2697us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:40.304744 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:16:40.304893 (+   149us) write_op.cc:312] APPLY: finished
0709 13:16:40.305190 (+   297us) log.cc:844] Serialized 41 byte log entry
0709 13:16:40.315091 (+  9901us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae3e28 00007f58c751e581 00007f58c751dd58 00007f58c75229f1 00007f58c75229a9 00007f58c7522939 00007f58c7522901 00007f58c7521b2d 000000000038f354 000000000038f199
0709 13:16:40.343969 (+ 28878us) spinlock_profiling.cc:243] Waited 3.15 s on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae532a 00007f58c3a6af14 00007f58c3a6aec3 00007f58c3a6ae38 00007f58c3a6adf3 00007f58c3a6a0dc 00007f58c3a93e16 00007f58c3a7bcbb 00007f58c3a6639d 00007f58c3a69d75
0709 13:16:40.568948 (+224979us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:40.618734 (+ 49786us) write_op.cc:454] Released schema lock
0709 13:16:40.634020 (+ 15286us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:40.717862 (+ 83842us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:40.734198 (+ 16336us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":623406,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":1230,"apply.run_cpu_time_us":158012,"apply.run_wall_time_us":393331,"cfile_cache_hit":10,"cfile_cache_hit_bytes":10455,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":1,"lbm_read_time_us":848,"lbm_reads_lt_1ms":8,"num_ops":3,"prepare.queue_time_us":357593,"prepare.run_cpu_time_us":21232,"prepare.run_wall_time_us":4603853,"raft.queue_time_us":1027,"raft.run_cpu_time_us":14296,"raft.run_wall_time_us":3201998,"replication_time_us":4200748,"spinlock_wait_cycles":7637783552,"thread_start_us":4173600,"threads_started":5,"wal-append.queue_time_us":898471,"wal-append.run_cpu_time_us":3218,"wal-append.run_wall_time_us":1003252}]]}
I20260709 13:16:41.389357 14428 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.392030 10146 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:41.390086 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:41.336277 14188 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.392884 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:41.320286 14091 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.403942 10146 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.406535 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:41.403661 14188 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:41.406683 14461 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.407536 10996 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:41.398157 14343 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:41.406658 10146 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 4 to 8, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 8 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.410771 10250 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:41.411175 10250 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:41.411909 10250 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.412961 10250 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.411619 10146 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 8, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 8 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.414448 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.416190 10146 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 9, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 9 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:41.362107 14376 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.420363 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.420738 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.421314 10242 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.421557 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.421941 14376 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:41.418036 14428 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.422883 10241 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:41.423301 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.423843 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.424322 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.425120 10248 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:41.419431 10249 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:41.419749 14343 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:41.426975 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.427824 10244 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:41.429114 14091 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:41.422755 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.430615 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.431994 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.432310 10146 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 10, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 10 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:41.390779 14462 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.419982 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.434801 10246 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:41.433248 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:41.403576 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 141977us
I20260709 13:16:41.442945 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:41.443913 10290 leader_election.cc:400] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
I20260709 13:16:41.444303 10290 leader_election.cc:403] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:16:41.444131 10242 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:41.453804 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:41.441175 10146 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.455951 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.456964 10242 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:41.459599 10250 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:41.460232 10250 pending_rounds.cc:85] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:41.460568 10250 pending_rounds.cc:107] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:41.460953 10250 raft_consensus.cc:2889] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.462071 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:41.462931 10998 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.462761 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.463987 10245 raft_consensus.cc:2376] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8. Re-sending same reply.
I20260709 13:16:41.462810 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:41.465533 10146 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:41.469696 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 65441.8us
I20260709 13:16:41.468560 10146 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 9, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.475550 10362 connection.cc:256] RPC call timeout handler was delayed by -3.1224913679998281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:16:41.475682 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:41.481696 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.479019 10146 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:41.441097 14462 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:41.477066 10362 connection.cc:256] RPC call timeout handler was delayed by -3.0279913679999026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:16:41.501149 10362 connection.cc:256] RPC call timeout handler was delayed by -2.9118913679999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:16:41.502972 10362 connection.cc:256] RPC call timeout handler was delayed by -2.7723913679999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 13:16:41.503458 10362 connection.cc:256] RPC call timeout handler was delayed by -2.6670913680000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 13:16:41.503818 10362 connection.cc:256] RPC call timeout handler was delayed by -2.6499913679999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:16:41.504179 10362 connection.cc:256] RPC call timeout handler was delayed by -2.6094913679999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 13:16:41.504528 10362 connection.cc:256] RPC call timeout handler was delayed by -2.1297913679998146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2715s for a response
W20260709 13:16:41.504868 10362 connection.cc:256] RPC call timeout handler was delayed by -1.9110913679999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2958s for a response
W20260709 13:16:41.505203 10362 connection.cc:256] RPC call timeout handler was delayed by -1.7256913679998434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3164s for a response
W20260709 13:16:41.490420 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 100467us
W20260709 13:16:41.498245 10364 leader_election.cc:336] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 2.182s (SENT)
I20260709 13:16:41.498956 10146 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 9, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.500113 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.499046 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.507735 10146 catalog_manager.cc:5697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.510569 10996 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:16:41.512423 10146 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:41.476425 14452 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.524495 14456 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.523875 14471 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:41.525629 14471 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.526033 14471 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.527077 14456 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:41.530874 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.531523 10250 raft_consensus.cc:2376] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8. Re-sending same reply.
I20260709 13:16:41.531939 10394 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:41.533046 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:16:41.534868 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 84789.9us
I20260709 13:16:41.535077 10390 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:41.536257 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:41.536651 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 73902us
I20260709 13:16:41.510032 14466 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:41.538514 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.539285 10394 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:41.542203 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:41.544759 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.545053 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.545822 10242 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:41.544579 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:41.551156 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.556543 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.557476 10242 raft_consensus.cc:2376] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7. Re-sending same reply.
I20260709 13:16:41.530786 14452 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:41.571555 10394 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:16:41.573221 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:41.586141 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 53408.3us
I20260709 13:16:41.575407 14376 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:41.613010 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:41.613649 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 69130us
I20260709 13:16:41.614883 10242 raft_consensus.cc:2376] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8. Re-sending same reply.
I20260709 13:16:41.615342 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:41.612416 14376 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.616411 14376 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:41.618512 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.623566 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.625814 10325 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:41.628561 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:41.629361 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.631071 10242 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:16:41.631372 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.633517 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.633762 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.634202 10320 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:41.634258 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.634615 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.635481 10319 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:41.635572 10323 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:41.636308 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.636904 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:41.568902 14340 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.593041 14460 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:41.652513 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:41.648409 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.658515 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.677899 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.679123 10242 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:41.644915 14460 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.686136 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.700807 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.602124 14471 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:41.671955 14461 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:41.721313 10998 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:41.726734 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.735642 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:41.736668 10998 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
I20260709 13:16:41.676293 14367 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:41.751804 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.686457 14460 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:41.755848 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 107209us
I20260709 13:16:41.756505 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:41.760728 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.763568 10998 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.763688 10396 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:41.766484 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.127s (SENT) [suppressed 46 similar messages]
I20260709 13:16:41.766219 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:41.706686 14452 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:41.779577 11002 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:41.686736 14188 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:41.789127 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.680012 14475 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:16:41.800992 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.813398 10321 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:41.766746 14462 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:41.804579 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:41.786798 10245 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
W20260709 13:16:41.811555 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.812570 10250 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:16:41.803791 10998 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:41.874413 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:41.908413  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:41.910889 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.947594 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:41.949848 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.954969 14467 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:41.955508 14467 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:41.956585 14467 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:41.787153 14313 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:16:41.814033 14473 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:16:41.959345 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.972362 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:41.972136 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:41.979174 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.973199 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:41.979283 10967 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:41.992758 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.996095 10318 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:41.881033 14353 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:41.994743 14481 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:16:42.033664 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:41.958192 14467 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.992517 14475 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.938120 14452 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:16:42.039877 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:42.041965 10318 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.998977 14461 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:41.912129 14270 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:42.045241 14461 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:41.979645 14463 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:16:42.039892 14472 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.980641 14400 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:16:42.083566 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.070789 10323 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.992349 14156 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:42.038362 14340 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:42.073694 14491 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
W20260709 13:16:42.096606 14470 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.422s	user 0.001s	sys 0.000s
I20260709 13:16:42.126436 10316 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:42.129462 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 150177us
I20260709 13:16:42.132040 10390 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.079660 14367 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:42.107700 14471 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:42.096576 14188 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:42.119913 14452 consensus_queue.cc:1243] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:42.070746 14483 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.165735 14270 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:42.151885 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.153802 10967 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.149748 10399 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:42.127126 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 159863us
I20260709 13:16:42.145874 10323 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:42.156616 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.165271 14483 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.063709 14475 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:42.168001 10288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.006s	sys 0.004s
I20260709 13:16:42.167943 10396 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:42.173329 10967 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:42.182389 10288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.006s	sys 0.005s
I20260709 13:16:42.208557 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.213035 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.220562 14375 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:42.221769 14375 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:42.224726 10323 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:16:42.237741 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.240156 10390 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:42.243734 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:42.244786 10399 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:42.245132 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.245599 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:42.245788 10391 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:42.246290 10399 raft_consensus.cc:2368] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:16:42.243734 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.246634 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.257720 10395 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.256850 14483 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:42.260088 14475 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:42.253242 14460 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.267113 10399 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:42.245695 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:42.282557 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 69622us
I20260709 13:16:42.181005 14502 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:42.321892 10965 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.573s (SENT)
I20260709 13:16:42.331357 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:42.334072 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49685.5us
I20260709 13:16:42.215123 14188 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:42.336629 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 169459us
W20260709 13:16:42.342342 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 96785.8us
I20260709 13:16:42.343428 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:42.344849 14313 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.346621 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:42.347915 14313 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:42.348541 14313 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:42.349752 14313 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.354655 14353 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:42.355041 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:42.364279 14460 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:42.370645 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 851533us
I20260709 13:16:42.215378 14477 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 13:16:42.373919 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:42.396221 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.403836 14376 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.787s	user 0.014s	sys 0.000s
I20260709 13:16:42.404532 14376 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.406262 10325 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:42.409051 14376 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:42.398890 14466 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.853s	user 0.008s	sys 0.005s
I20260709 13:16:42.430996 14466 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
I20260709 13:16:42.432050 10324 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
W20260709 13:16:42.437600 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.448364 14343 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:42.448853 14343 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:42.449702 14343 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.451004 14343 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:42.455901 10318 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:42.458675 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 123717us
W20260709 13:16:42.458984 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 120482us
I20260709 13:16:42.459408 14510 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:42.459872 14510 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.460263 14510 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:42.462543 14477 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:42.463548 14477 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:42.464563 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.474599 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 152752us
W20260709 13:16:42.480908 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.481850 10317 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.034s	sys 0.066s
W20260709 13:16:42.482213 10317 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.034s	sys 0.066s
I20260709 13:16:42.491262 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:42.493214 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.501865 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:42.510145 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:42.512630 14479 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.698s	user 0.010s	sys 0.003s
I20260709 13:16:42.512835 14313 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:42.513234 14313 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.513593 14313 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.514310 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 784) took 1079 ms. Trace:
W20260709 13:16:42.515602 10213 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.016s	sys 0.018s
I20260709 13:16:42.514686 10393 rpcz_store.cc:276] 0709 13:16:41.434914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.436048 (+  1134us) service_pool.cc:224] Handling call
0709 13:16:41.453837 (+ 17789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.454203 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.454253 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.466942 (+ 12689us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.645278 (+178336us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:41.645321 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.645400 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.512008 (+866608us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:42.513984 (+  1976us) raft_consensus.cc:1685] finished
0709 13:16:42.514003 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.514250 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":333,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":7719,"spinlock_wait_cycles":8343296,"thread_start_us":158372,"threads_started":1,"wal-append.queue_time_us":259592}
W20260709 13:16:42.515959 10213 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.016s	sys 0.018s
W20260709 13:16:42.516295 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 749788us
I20260709 13:16:42.522470 14510 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.520170 14508 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:42.524288 14508 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.524832 14510 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:42.508929 14477 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:16:42.528395 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 154575us
I20260709 13:16:42.538686 10250 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:42.539078 10364 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:42.539963 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:42.538640 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 183701us
I20260709 13:16:42.553051 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:42.547648 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:42.520272 14502 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.528278 14340 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.517939 14188 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:16:42.576108 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46850.5us
I20260709 13:16:42.576490 10391 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.577613 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.556504 14076 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:42.582050 14488 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:42.586606 14493 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:42.598305 14493 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:42.598712 14493 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.599181 14508 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:42.598822 14343 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:42.610594 14343 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:42.591832 14515 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:42.592093 14499 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:42.593803 14513 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 13:16:42.597918 14076 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.588186 14478 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:42.587304 14460 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.633531 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2268) took 1047 ms. Trace:
I20260709 13:16:42.607250 14493 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:42.611879 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.611559 14480 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:42.591377 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.557091 14516 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.559816 14091 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:42.638278 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 80968.6us
I20260709 13:16:42.634382 10394 rpcz_store.cc:276] 0709 13:16:41.586577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.610190 (+ 23613us) service_pool.cc:224] Handling call
0709 13:16:41.610656 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.613375 (+  2719us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:41.802884 (+189509us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.331025 (+528141us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.633158 (+302133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.633206 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.633260 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.633334 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.633461 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166358,"prepare.queue_time_us":402661,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":117,"raft.queue_time_us":333420,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":221,"thread_start_us":549104,"threads_started":3,"wal-append.queue_time_us":338872}
I20260709 13:16:42.627399 14515 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:42.641332 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.638420 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 90858.4us
I20260709 13:16:42.613085 14340 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:42.648854 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:42.650115 10243 raft_consensus.cc:2410] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:42.652104 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:42.652807 10250 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.653864 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:42.655202 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 63914.8us
I20260709 13:16:42.641441 14516 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:42.659590 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:42.647604 14515 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:42.666340 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:42.666976 10249 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:42.667578 14343 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:42.670434 14483 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:42.675997 10249 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:42.677346 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:42.678114 10249 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:42.650619 14507 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:42.640010 14452 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:42.678263 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:42.658102 14340 consensus_queue.cc:1243] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:42.659184 14516 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.680429 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:42.685045 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:42.646754 14313 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:42.652503 14478 consensus_queue.cc:1048] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:16:42.679651 14367 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.694947 10243 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:42.696969 10249 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:16:42.651098 14091 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:42.703449 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 47553.1us
I20260709 13:16:42.704303 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.705361 14091 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:42.705438 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.687638 14340 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:42.701319 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:42.707549 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.728576 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.756088 10250 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:42.757771 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:42.780745 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 70997.9us
I20260709 13:16:42.786500 14343 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:42.789319 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 117255us
W20260709 13:16:42.794029 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.706810 14499 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.801499 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.802474 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.806121 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.699640 14367 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:42.791523 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 236642us
I20260709 13:16:42.818015 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.818077 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.820399 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.706853 14340 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:42.822549 14532 raft_consensus.cc:2764] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:16:42.833940 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.834142 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:42.826758 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:42.834692 10997 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:42.827976 14475 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:42.828282 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:42.842339 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:42.842873 11001 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:42.842960 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2455) took 1190 ms. Trace:
I20260709 13:16:42.828967 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:42.826439 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:42.790504 14476 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:42.830329 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2445) took 1197 ms. Trace:
I20260709 13:16:42.794571 14376 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:16:42.826435 14520 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:16:42.834837 10996 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:42.887615 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.791442 14507 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:42.791126 14353 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:42.794806 14471 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:42.844019 10993 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.843545 10320 rpcz_store.cc:276] 0709 13:16:41.642154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.642385 (+   231us) service_pool.cc:224] Handling call
0709 13:16:41.649990 (+  7605us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.952778 (+302788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.952807 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:41.971553 (+ 18746us) log.cc:844] Serialized 52 byte log entry
0709 13:16:42.483364 (+511811us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.499574 (+ 16210us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.569791 (+ 70217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.569873 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.575301 (+  5428us) spinlock_profiling.cc:243] Waited 936 us on lock 0x7b18003b7880. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb557 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:42.822924 (+247623us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b18003b7880. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:42.830876 (+  7952us) raft_consensus.cc:1685] finished
0709 13:16:42.830905 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.831102 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":503547,"prepare.queue_time_us":16206,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1280,"raft.queue_time_us":385601,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":50791,"spinlock_wait_cycles":22097152,"thread_start_us":776310,"threads_started":3,"wal-append.queue_time_us":506531}
W20260709 13:16:42.851680 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 70157.5us
I20260709 13:16:42.852092 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:42.855299 10324 rpcz_store.cc:276] 0709 13:16:41.632712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.633528 (+   816us) service_pool.cc:224] Handling call
0709 13:16:42.830074 (+1196546us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b540021e3d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:42.830247 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834492160}
I20260709 13:16:42.858824 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:42.902458 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 43728.1us
W20260709 13:16:42.859402 10288 connection.cc:256] RPC call timeout handler was delayed by -1.0608477090001998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 13:16:42.871414 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.842571 14475 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:42.803004 14499 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:16:42.877453 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59489.1us
I20260709 13:16:42.909356 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:42.821238 14367 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.827526 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:42.915004 11000 raft_consensus.cc:2368] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8.
W20260709 13:16:42.871887 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.876909 14466 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.882548 14512 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:42.855258 14476 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:42.877442 14456 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:42.914912 14462 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:42.913975 14499 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.886963 14400 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:16:42.916693 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64746.5us
I20260709 13:16:42.897048 14376 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:42.931646 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.931988 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.941159 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:42.931273 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.937716 11001 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:16:42.963387 10393 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:42.931691 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:42.920279 14492 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.801s	user 0.003s	sys 0.000s
I20260709 13:16:42.932355 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:42.960641 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51369us
I20260709 13:16:42.964888 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:42.974598 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.972365 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:42.972611 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:42.927124 14536 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:42.972096 10394 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:42.920152 14531 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:42.976001 10391 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:42.921547 14313 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:42.919484 14523 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.919565 14525 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:42.920644 14476 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.920809 14524 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:42.899410 14522 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:16:42.925962 14512 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:42.923657 14452 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:42.977464 10288 leader_election.cc:400] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12.
I20260709 13:16:42.921790 14493 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:42.916837 14526 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.925769 14515 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.931126 14340 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:42.999051 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:43.000698 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.003237 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:43.013013 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.002292 10993 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:42.981658 14478 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.008955 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:42.920274 14466 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:42.979379 14531 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.015802 10390 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:42.920729 14504 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.216s
I20260709 13:16:43.024919 10391 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:42.999316 14524 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:43.011593 14452 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:43.032795 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.029110 14531 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:43.038559 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53176.7us
I20260709 13:16:43.031816 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:43.039359 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64844.9us
I20260709 13:16:42.926896 14475 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.045666 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:43.045959 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:43.027132 14478 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.047269 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:43.047187 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:43.054355 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:43.048826 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.001449 14523 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.036845 14493 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.064030 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:43.039371 14526 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.045400 14467 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.002738 14525 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.052131 14313 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:43.047432 14534 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.071221 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:43.074208 14545 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:43.074601 14512 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.075702 14461 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:43.076319 14533 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:43.052574 14478 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.069877 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:43.072886 14467 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:43.052565 14507 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:43.065531 14487 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.097242 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:43.116319 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.117481 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:43.070869 14475 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.116519 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.072153 14460 raft_consensus.cc:2764] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:16:43.040601 14376 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.124125 10393 raft_consensus.cc:2368] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8.
I20260709 13:16:43.045224 14542 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:43.126639 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 163374us
I20260709 13:16:43.120813 14313 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:43.186543 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 70116.6us
I20260709 13:16:43.130569 14467 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:43.276405 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.335732 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.163205 14507 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:43.467140 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.467432 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.160804 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.121021 14532 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:16:43.127713 14538 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.121232 14461 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:43.124528 14533 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.158757 14462 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:43.091081 14524 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.131731 14487 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.084967 14526 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.122021 14493 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:43.469240 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 308697us
I20260709 13:16:43.508894 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:43.474462 14532 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:43.496102 14533 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.510134 10393 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:43.509768 14313 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.511159 14514 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.511729 14514 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.514034 14460 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.514611 14460 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.515712 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:43.475183 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:43.476874 14549 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.234s	user 0.006s	sys 0.009s
W20260709 13:16:43.466707 14499 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.017s
I20260709 13:16:43.462455 14483 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:43.480051 14525 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:43.482499 14550 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 13:16:43.499550 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:43.525421 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 478198us
I20260709 13:16:43.473788 14340 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:43.487054 14538 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:43.500634 14487 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:43.522984 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 47857.4us
I20260709 13:16:43.494438 14353 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:43.527928 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.520543 14532 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:43.464036 14542 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:43.576107 10244 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:43.504019 14515 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.578583 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:43.493266 14461 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:43.533190 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.535640 14475 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:43.602098 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 147705us
I20260709 13:16:43.577245 14462 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:43.610553 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:43.611408 14541 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:16:43.522727 14499 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.612672 14560 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:43.605261 14367 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.665s	user 0.016s	sys 0.001s
I20260709 13:16:43.592338 14483 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:43.614347 14507 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.614802 14483 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.586753 14538 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.611609 14562 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:43.612721 14514 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:43.617336 10965 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.598s (SENT)
I20260709 13:16:43.618760 14562 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.613890 14367 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.619499 14562 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.611344 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:43.621516 10242 raft_consensus.cc:2410] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:16:43.622627 14523 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:43.622924 14462 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.624617 14567 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:43.614885 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:43.617623 14476 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.011s
I20260709 13:16:43.625972 10244 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:43.625860 14476 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.626307 14554 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:43.626951 14554 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:43.627841 14554 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.630657 14562 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.632220 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:43.633589 14559 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:43.635545 10965 leader_election.cc:336] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.665s (SENT)
I20260709 13:16:43.636382 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:43.586412 14340 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:43.641302 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 62794us
I20260709 13:16:43.639487 14340 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:43.593534 14460 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.644963 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:43.654250 10965 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.834s (SENT)
I20260709 13:16:43.664180 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2616) took 1009 ms. Trace:
I20260709 13:16:43.664775 10248 rpcz_store.cc:276] 0709 13:16:42.654593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.654791 (+   198us) service_pool.cc:224] Handling call
0709 13:16:42.667266 (+ 12475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.841880 (+174614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.841925 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.856540 (+ 14615us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.963838 (+107298us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:42.963897 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.963978 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.663864 (+699886us) raft_consensus.cc:1685] finished
0709 13:16:43.663894 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.664094 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4674,"raft.queue_time_us":24075,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9263,"thread_start_us":231556,"threads_started":2,"wal-append.queue_time_us":194567}
I20260709 13:16:43.655014 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:43.603180 14542 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:43.609424 14475 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:43.661293 14478 consensus_meta.cc:287] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.005s
I20260709 13:16:43.601390 14353 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:43.661466 14471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.023s	sys 0.013s
W20260709 13:16:43.673458 10965 leader_election.cc:336] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.202s (SENT)
I20260709 13:16:43.698397 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:43.690837 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:43.660096 14515 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.670562 14460 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:43.703258 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 187605us
I20260709 13:16:43.707356 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:43.706825 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:43.708033 10318 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:43.725091 10994 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:43.689188 14475 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.741837 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.732105 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.750723 10319 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:43.679740 14559 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:43.695611 14501 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:43.748116 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:43.698215 14471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.024s	sys 0.014s
I20260709 13:16:43.756492 10320 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:43.717935 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.751847 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.759645 10324 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:43.701515 14515 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.743467 14567 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:43.763924 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.764894 10319 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 8: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:43.765884 14559 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:43.766182 14538 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:43.756235 14531 consensus_meta.cc:287] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.006s
I20260709 13:16:43.771857 14499 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:43.772178 14531 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.773605 14538 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.773716 14499 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:43.761375 14516 consensus_meta.cc:287] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.070s	user 0.013s	sys 0.006s
I20260709 13:16:43.767174 14553 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:43.767547 14566 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.699532 14478 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:43.761698 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 173527us
I20260709 13:16:43.770799 14462 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.792163 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.793787 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:43.806090 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:43.812263 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.813427 10320 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:43.709635 14466 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.826050 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.826813 10321 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.827772 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:43.777073 14452 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.726s	user 0.009s	sys 0.013s
I20260709 13:16:43.831585 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.829005 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.826180 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:43.832208 10324 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:43.829708 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.831640 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:43.826572 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.833485 10319 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:43.833751 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:43.841398 11000 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:43.841607 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.760377 14156 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.842605 10325 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:43.774794 14476 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:43.760620 14471 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:43.778627 14515 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.814574 14499 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.881439 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.818868 14567 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:43.817751 14508 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:43.888496 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:43.880694 14581 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:43.889461 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:43.842852 14483 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:43.849910 14531 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:43.890486 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:43.890961 10321 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:43.890988 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.893580 10316 raft_consensus.cc:2376] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13. Re-sending same reply.
W20260709 13:16:43.896651 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 223206us
I20260709 13:16:43.928129 10319 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:43.929039 10320 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:43.810488 14516 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.897949 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:43.935477 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.007035 10321 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.937873 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:43.938977 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:43.850106 14452 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:43.942358 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.931104 14483 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:43.944406 14507 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.944693 14538 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:43.946209 14499 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:43.947295 14353 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.949796 14524 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:43.962687 14564 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:43.978390 14526 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:43.958020 14473 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:43.959506 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.960602 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:44.031605 10248 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:44.031874 10396 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.889540 14156 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:43.905462 14508 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.981696 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:43.964588 10244 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:43.962159 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:43.995695 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:43.997483 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:44.035837 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:44.036757 10316 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:43.998178 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:43.991699 10317 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:16:44.037087 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.008708 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:44.010787 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 112959us
I20260709 13:16:44.038661 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:44.012099 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.013509 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.039801 11000 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:44.016578 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:44.014396 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.042346 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:44.017644 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.043215 10391 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:44.043546 10997 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:16:43.965322 14574 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:43.929533 14557 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:16:44.020655 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 180400us
I20260709 13:16:43.929661 14562 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:44.028301 14561 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.984467 14472 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:44.036324 14508 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.985575 14076 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:43.956678 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:43.990666 14534 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:43.961884 14533 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.017673 14462 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.044576 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.020526 14507 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.045879 10321 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:44.047693 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:43.956550 10393 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:44.028687 14564 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:44.091045 14564 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.093451 10250 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:44.031231 14473 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:44.094743 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47140.6us
I20260709 13:16:44.094873 14473 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:44.095868 10965 leader_election.cc:336] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.576s (SENT)
I20260709 13:16:44.096073 14156 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.096804 14478 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:44.061627 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.097673 14585 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:44.098991 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.099720 11000 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:44.102638 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.103461 11002 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:44.104365 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.105029 10999 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:44.067660 10394 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:44.105563 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:44.107545 14507 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:44.109362 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 64860.6us
I20260709 13:16:44.109623 14156 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:44.110762 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.111330 14156 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:44.111908 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:44.113880 14556 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.987s	user 0.006s	sys 0.011s
I20260709 13:16:44.048568 14480 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:44.074928 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.026496 14538 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:44.075491 10213 connection.cc:256] RPC call timeout handler was delayed by -2.2787319600001865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:16:44.143162 10213 connection.cc:256] RPC call timeout handler was delayed by -2.15273196000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:16:44.143610 10213 connection.cc:256] RPC call timeout handler was delayed by -2.0861319600001025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:16:44.144032 10213 connection.cc:256] RPC call timeout handler was delayed by -1.9970319600001858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 13:16:44.144449 10213 connection.cc:256] RPC call timeout handler was delayed by -1.9745319600001494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:16:44.144861 10213 connection.cc:256] RPC call timeout handler was delayed by -1.9115319600000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 13:16:44.023476 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.079083 10246 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:43.986658 14471 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.051991 14353 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:44.145205 10213 connection.cc:256] RPC call timeout handler was delayed by -1.8719319600002109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:16:44.146404 10213 connection.cc:256] RPC call timeout handler was delayed by -1.8710319600002094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 13:16:44.146709 10213 connection.cc:256] RPC call timeout handler was delayed by -1.7873319600000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:16:44.053272 14554 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.057965 14526 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.085917 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:44.086511 14462 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.054448 14557 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:43.987215 14567 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.088958 14452 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:44.089334 14483 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.090546 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 902) took 1568 ms. Trace:
I20260709 13:16:44.097623 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.109863 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:44.121165 10324 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:44.016037 14340 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.071444 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.321758 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:44.058822 14472 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:16:44.137400 14569 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.303s	user 0.003s	sys 0.000s
I20260709 13:16:44.137604 14576 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.139464 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:44.335286 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:44.336135 10999 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:44.336261 11001 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:43.989421 14532 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.341068 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.045073 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:44.341964 10323 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.342725 11002 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:44.343207 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.344058 10392 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:44.080706 14534 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.172370 10243 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:44.146989 10213 connection.cc:256] RPC call timeout handler was delayed by -1.7603319600000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:16:44.145922 10320 raft_consensus.cc:2376] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10. Re-sending same reply.
W20260709 13:16:44.348969 10213 connection.cc:256] RPC call timeout handler was delayed by -1.665831960000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:16:44.302307 10321 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
W20260709 13:16:44.349354 10213 connection.cc:256] RPC call timeout handler was delayed by -1.6307319600000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:16:44.349799 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2905319600001803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26030000000000003s for a response
I20260709 13:16:44.350286 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.351310 10321 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:44.312507 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:44.319876 10245 rpcz_store.cc:276] 0709 13:16:42.521800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.522107 (+   307us) service_pool.cc:224] Handling call
0709 13:16:42.544692 (+ 22585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.551907 (+  7215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.551955 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.552610 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.650292 (+ 97682us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:42.650336 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.650404 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.073165 (+1422761us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b2400115238. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a39fb0 00007f58c36b0488 00007f58c36b0be8 00007f58c3688398 00007f58c368376a 00007f58c3682bb6
0709 13:16:44.074577 (+  1412us) raft_consensus.cc:1685] finished
0709 13:16:44.074598 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.090476 (+ 15878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8120,"raft.queue_time_us":7762,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4716,"spinlock_wait_cycles":37666048,"thread_start_us":80726,"threads_started":1,"wal-append.queue_time_us":254519}
W20260709 13:16:44.323400 10965 leader_election.cc:336] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.065s (SENT)
I20260709 13:16:44.180404 14091 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:44.305990 14545 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:16:44.330789 10324 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:44.376722 10321 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:44.377190 10213 connection.cc:256] RPC call timeout handler was delayed by -1.0412319600000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.288s for a response
I20260709 13:16:44.327790 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:44.142639 14585 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:44.333084 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.140637 14480 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:44.298990 14551 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.348080 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:44.439347 10399 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:44.354104 14467 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.878s	user 0.012s	sys 0.000s
I20260709 13:16:44.355041 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:44.356753 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.363451 10316 raft_consensus.cc:2368] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11.
W20260709 13:16:44.363611 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 318593us
I20260709 13:16:44.457592 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:44.364233 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:44.375464 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 241029us
W20260709 13:16:44.337453 14582 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
W20260709 13:16:44.434410 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.378566 10321 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:44.354839 10246 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:44.363129 14091 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:44.444207 14493 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:44.459838 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.325948 14523 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:16:44.436003 10319 raft_consensus.cc:2376] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9. Re-sending same reply.
W20260709 13:16:44.453421 14542 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
W20260709 13:16:44.522439 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 144583us
I20260709 13:16:44.635399 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1843) took 1515 ms. Trace:
W20260709 13:16:44.579790 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 118191us
I20260709 13:16:44.440263 14480 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.453125 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.610554 10392 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:44.607784 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:44.638587 10320 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.639025 10321 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:44.636075 10390 rpcz_store.cc:276] 0709 13:16:43.120131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.120328 (+   197us) service_pool.cc:224] Handling call
0709 13:16:43.128454 (+  8126us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.128827 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.128872 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.130900 (+  2028us) log.cc:844] Serialized 52 byte log entry
0709 13:16:43.579438 (+448538us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:43.889933 (+310495us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.890335 (+   402us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.890513 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.890580 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.102448 (+211868us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b18002a4360. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:44.113766 (+ 11318us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:44.635059 (+521293us) raft_consensus.cc:1685] finished
0709 13:16:44.635093 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.635309 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24940,"prepare.queue_time_us":368496,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":2099,"raft.queue_time_us":376155,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":23560,"spinlock_wait_cycles":35715200,"thread_start_us":358855,"threads_started":2,"wal-append.queue_time_us":467464}
I20260709 13:16:44.659293 10323 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:44.655107 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2617) took 1999 ms. Trace:
I20260709 13:16:44.661800 10319 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.665067 14598 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:44.666355 14595 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.667173 14600 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:16:44.666986 14595 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.669144 14091 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:44.671121 14597 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:16:44.675218 14601 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:16:44.666393 14599 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:16:44.677506 14554 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:44.680783 10323 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:44.661837 10241 rpcz_store.cc:276] 0709 13:16:42.655766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.655913 (+   147us) service_pool.cc:224] Handling call
0709 13:16:42.666695 (+ 10782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.833040 (+166345us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:42.962656 (+129616us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.041311 (+ 78655us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.041811 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.041965 (+   154us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:43.041997 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.042063 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.113271 (+1071208us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:44.654797 (+541526us) raft_consensus.cc:1685] finished
0709 13:16:44.654881 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.655039 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21986,"prepare.queue_time_us":99187,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":160352,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":11031,"spinlock_wait_cycles":244213632,"thread_start_us":255365,"threads_started":3,"wal-append.queue_time_us":90622}
I20260709 13:16:44.532017 14467 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:44.693483 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 57359.8us
I20260709 13:16:44.694690 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:44.688998 10321 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:44.701655 10321 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:44.700222 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 900) took 2179 ms. Trace:
I20260709 13:16:44.705006 10321 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:44.709252 10323 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:44.703759 10247 rpcz_store.cc:276] 0709 13:16:42.521032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.521994 (+   962us) service_pool.cc:224] Handling call
0709 13:16:42.547173 (+ 25179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.572298 (+ 25125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.572351 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.592735 (+ 20384us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.668365 (+1075630us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003b5900. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:43.915117 (+246752us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:43.915182 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.915268 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.683508 (+768240us) raft_consensus.cc:1685] finished
0709 13:16:44.683542 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.700133 (+ 16591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13343,"raft.queue_time_us":13496,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9752,"spinlock_wait_cycles":47765888,"thread_start_us":246473,"threads_started":1,"wal-append.queue_time_us":1427799}
I20260709 13:16:44.665695 14598 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.699224 14091 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.698357 14523 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:44.723397 14538 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:44.724177 14589 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.631s	user 0.000s	sys 0.001s
W20260709 13:16:44.724536 14596 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:16:44.724401 14340 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.643868 14542 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:44.711678 14487 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.109s	user 0.004s	sys 0.007s
I20260709 13:16:44.723546 10323 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.740679 10320 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:44.745507 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50943.1us
I20260709 13:16:44.748746 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:44.750434 14599 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.530752 14472 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.751822 14472 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.727473 14577 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.728153 14523 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:44.745013 14533 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:44.760242 14462 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:44.772414 14561 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:16:44.795795 10323 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:44.785008 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:44.781219 14461 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.134s	user 0.011s	sys 0.002s
I20260709 13:16:44.775811 14557 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:44.717705 14585 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.758288 14487 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:44.817922 14603 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
I20260709 13:16:44.819146 14595 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:44.820362 14604 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:44.821760 14467 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:44.830770 14564 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
I20260709 13:16:44.831300 14564 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.832499 10244 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:44.835244 14508 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.002s
I20260709 13:16:44.835741 14508 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.836938 10250 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:44.803165 14076 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.804566 14561 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:44.838160 14508 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:44.855862 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 70955.2us
W20260709 13:16:44.849910 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.856863 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.856815 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:44.861088 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:44.864943 10399 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:44.866063 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:44.867194 10241 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:16:44.866549 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:44.867617 10241 pending_rounds.cc:85] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:44.868710 10241 pending_rounds.cc:107] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:16:44.869061 10241 raft_consensus.cc:2889] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.870469 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:44.866456 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:44.874693 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:44.875345 10397 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:44.845139 14524 consensus_meta.cc:287] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.003s
I20260709 13:16:44.879487 10248 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:44.879678 10390 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.885844 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:44.881032 14592 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.856s	user 0.013s	sys 0.024s
I20260709 13:16:44.895308 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.882787 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.890936 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.887363 14487 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.847734 14564 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.898451 10399 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:44.899649 10250 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:44.851450 14598 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.902966 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.903707 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.807997 14461 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.905452 14542 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:44.905571 14615 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:16:44.911741 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.913254 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.906138 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:44.881727 14478 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.914820 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.941381 10397 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:16:44.947487 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.949246 14367 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:44.952140 14537 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:44.954309 14572 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 1.020s	user 0.010s	sys 0.026s
I20260709 13:16:44.948700 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.958081 14576 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.958276 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.959210 14576 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:44.960084 14576 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:44.961061 14524 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.961463 14524 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:44.961644 14576 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:44.962347 14524 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.963302 14516 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:44.963371 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:44.963763 14524 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.964046 14516 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:44.965045 14516 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:44.965914 14516 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.967621 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:44.971751 14514 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:44.972487 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2466) took 1177 ms. Trace:
I20260709 13:16:44.973088 14616 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:44.973002 14524 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:44.973683 14616 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:44.974618 14616 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.976547 14616 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:44.977349 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.979300 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 655895us
I20260709 13:16:44.980989 14270 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:44.981402 10965 leader_election.cc:336] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.116s (SENT)
I20260709 13:16:44.982623 14463 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:44.985544 14473 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.985780 14581 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.986429 14581 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:44.988651 14452 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:44.989518 14460 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.990038 14460 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:44.992252 14460 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:44.993568 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 351270us
I20260709 13:16:44.997422 14353 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:44.998490 14340 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:44.999089 14340 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:45.000313 14340 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.003228 14532 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.003443 14376 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:45.004375 14376 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.006650 14376 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.007601 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:44.964323 14551 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:45.008352 14551 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:45.008810 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.008821 14551 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.012616 10248 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 13:16:45.013532 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.981238 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 523733us
I20260709 13:16:44.988665 14581 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.982125 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.014595 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.016758 14553 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:45.019611 10965 leader_election.cc:336] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.210s (SENT)
I20260709 13:16:45.021023 14474 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.035933 10250 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:45.023156 10393 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:45.036114 14474 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.026567 14477 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:45.025913 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:44.972934 10318 rpcz_store.cc:276] 0709 13:16:43.795125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.817052 (+ 21927us) service_pool.cc:224] Handling call
0709 13:16:43.817410 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.898771 (+ 81361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.898803 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.911601 (+ 12798us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.304484 (+392883us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.347517 (+ 43033us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.971864 (+624347us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800477dc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c0975c0a 00007f58ca0b5219 00007f58c09fda40 00007f58c09f84e4 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287 00007f58c3b03208
0709 13:16:44.972070 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.972147 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.972185 (+    38us) raft_consensus.cc:1685] finished
0709 13:16:44.972281 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.972421 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93162,"prepare.queue_time_us":36071,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":13867,"raft.queue_time_us":715654,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":7184,"spinlock_wait_cycles":33271680,"thread_start_us":291782,"threads_started":1,"wal-append.queue_time_us":375537}
W20260709 13:16:45.036501 10965 leader_election.cc:336] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.220s (SENT)
I20260709 13:16:45.037102 14477 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:45.039486 14553 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:45.039561 14477 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.031988 14581 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:45.040875 14477 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.041225 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.038796 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.042256 14553 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.042829 10245 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:45.042285 14474 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:45.044775 14340 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.046497 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:45.047654 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.048163 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.048516 14472 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:45.049403 14472 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:45.016285 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:45.052754 10393 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:45.053368 14460 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.053886 14460 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:45.054347 14460 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.055285 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.055452 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:45.033676 14551 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.071573 10998 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:45.059760 14516 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.060607 14566 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:45.063251 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 150055us
I20260709 13:16:45.075872 10322 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:45.076447 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.064800 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.068334 10247 raft_consensus.cc:2410] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:45.072455 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:44.923290 14475 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.164s	user 0.012s	sys 0.000s
W20260709 13:16:45.074616 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.075457 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 799) took 1108 ms. Trace:
I20260709 13:16:45.079252 10395 rpcz_store.cc:276] 0709 13:16:43.967473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.969778 (+  2305us) service_pool.cc:224] Handling call
0709 13:16:43.970117 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.327548 (+357431us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:44.333074 (+  5526us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.728086 (+395012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.728144 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:44.728193 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.075209 (+347016us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540021b454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:45.075258 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.075389 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10892,"prepare.run_cpu_time_us":7608,"prepare.run_wall_time_us":65670,"raft.queue_time_us":78468,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":6790,"spinlock_wait_cycles":821494656,"thread_start_us":394616,"threads_started":1,"wal-append.queue_time_us":444175}
I20260709 13:16:45.080603 14551 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:44.926470 14557 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:44.933960 14598 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:45.083869 10362 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:45.084220 10362 leader_election.cc:403] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:45.085976 10213 leader_election.cc:400] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:16:45.086479 10213 leader_election.cc:403] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:45.088461 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:44.930452 14478 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:44.941582 14564 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.809608 14523 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.066758 14526 raft_consensus.cc:3055] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:45.069289 14524 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.106559 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:45.106258 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:45.106366 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.071164 14313 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.071345 14367 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:45.163488 10999 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:45.163827 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 57673.7us
I20260709 13:16:45.158315 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.165956  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:45.157938 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.167917 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.168535 10318 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:45.168567 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.170955 10288 leader_election.cc:400] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8.
I20260709 13:16:45.171285 10288 leader_election.cc:403] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:45.172057 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.172883 10318 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:45.175189 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80348.9us
I20260709 13:16:45.095518 14542 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:45.110441 14515 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.207s	user 0.006s	sys 0.006s
W20260709 13:16:45.180284 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 73999.4us
I20260709 13:16:45.180066 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.181085 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:45.162979 14627 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:16:45.183305 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 706) took 1347 ms. Trace:
I20260709 13:16:45.185185 10316 rpcz_store.cc:276] 0709 13:16:43.836367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.043971 (+207604us) service_pool.cc:224] Handling call
0709 13:16:45.183096 (+1139125us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002bcd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:45.183232 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589864192}
I20260709 13:16:45.179025 10318 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:45.179567 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.073122 14576 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:16:45.184311 10320 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:45.104193 14478 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.162735 14501 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.113304 14270 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.100725 14577 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:45.095417 14560 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7.
I20260709 13:16:45.190189 14504 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:16:45.189649 10318 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:45.180043 14570 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.192380 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:45.103662 14564 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:45.222478 14564 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.100472 14612 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:16:45.164228 14581 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:45.227917 14504 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:45.228389 14504 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:45.229287 14504 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.230918 14504 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:45.194581 10999 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:45.174443 14376 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.198133 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.181428 14091 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:45.243186 14546 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 2.310s	user 0.012s	sys 0.014s
I20260709 13:16:45.244063 10325 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:45.244563 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2625) took 1739 ms. Trace:
I20260709 13:16:45.200687 10316 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.245024 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 905) took 2543 ms. Trace:
I20260709 13:16:45.103569 14558 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:16:45.166885 14526 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:45.245568 10249 rpcz_store.cc:276] 0709 13:16:42.701992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.702765 (+   773us) service_pool.cc:224] Handling call
0709 13:16:42.703076 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.756997 (+ 53921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.757026 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.803107 (+ 46081us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.890536 (+ 87429us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.892013 (+  1477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.893483 (+  1470us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.242495 (+2349012us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:45.244753 (+  2258us) raft_consensus.cc:1685] finished
0709 13:16:45.244772 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.244968 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49167,"raft.queue_time_us":130501,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":268,"spinlock_wait_cycles":18051456,"thread_start_us":61611,"threads_started":1,"wal-append.queue_time_us":104431}
I20260709 13:16:45.096916 14475 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.246913 14375 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:45.184188 14531 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:45.203801 14270 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:45.247366 14375 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:45.247584 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:45.190086 14353 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.247845 14531 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:45.248713 10242 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:45.180824 14493 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.206888 10323 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:45.191583 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:45.250168 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 58643.8us
I20260709 13:16:45.250888 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.252095 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.252876 10247 raft_consensus.cc:2410] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:45.254472 10993 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:45.246925 14526 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.256654 14526 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.256932 14461 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.257696 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.258978 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.212901 14567 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:45.260828 14567 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.261737 14567 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.213503 10362 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
I20260709 13:16:45.190559 14575 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:16:45.264086 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50763.6us
I20260709 13:16:45.264422 14575 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.264850 14575 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:45.264891 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.183910 14452 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:45.266816 14622 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:16:45.185108 14462 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8.
I20260709 13:16:45.282698 10248 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:45.276095 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:45.204212 14576 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:45.241349 10241 raft_consensus.cc:2410] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:45.242020 14376 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.244946 10243 rpcz_store.cc:276] 0709 13:16:43.505203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.505460 (+   257us) service_pool.cc:224] Handling call
0709 13:16:43.513743 (+  8283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.362621 (+848878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.244353 (+881732us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002ebb54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:45.244507 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514114816}
I20260709 13:16:45.247751 14270 consensus_queue.cc:1243] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:45.197938 14537 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:45.309497 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.259218 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2632) took 1191 ms. Trace:
I20260709 13:16:45.310689 10242 rpcz_store.cc:276] 0709 13:16:44.067260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.088815 (+ 21555us) service_pool.cc:224] Handling call
0709 13:16:44.089121 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.249154 (+1160033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.258997 (+  9843us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400101dd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:45.259169 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666402688}
I20260709 13:16:45.259816 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.266902 14452 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:45.213928 14463 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:45.267666 14400 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:45.256958 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.315436 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:45.322614 10320 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:45.265789 14575 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.178349 14313 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.254455 14599 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:45.269757 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.270308 14612 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:45.210758 14621 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 13:16:45.209995 14619 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:16:45.285693 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.239566 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2364) took 1166 ms. Trace:
I20260709 13:16:45.287230 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:45.174242 14524 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.288404 10999 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:45.289633 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:45.199328 14577 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:45.358199 14577 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:45.358561 14473 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.359151 14473 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.359591 14313 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.360625 14575 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.187345 14367 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:16:45.275115 14480 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.007s
I20260709 13:16:45.362141 14480 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.343322 14599 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:45.307119 10317 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:45.363760 14599 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.364398 10996 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:45.368178 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.342890 10319 rpcz_store.cc:276] 0709 13:16:44.072869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.683053 (+610184us) service_pool.cc:224] Handling call
0709 13:16:44.706001 (+ 22948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.997853 (+291852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.997910 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.009717 (+ 11807us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.027760 (+ 18043us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:45.028123 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.028217 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.239394 (+211177us) raft_consensus.cc:1685] finished
0709 13:16:45.239407 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.239517 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291295,"raft.queue_time_us":291927,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":17591,"threads_started":1,"wal-append.queue_time_us":17940}
I20260709 13:16:45.372169 10250 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:45.308362 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.187811 14515 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.248301 14375 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.316440 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:45.318302 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.331300 14452 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.320176 10321 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:45.300925 14625 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.240s	user 0.004s	sys 0.000s
W20260709 13:16:45.289247 14534 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.855s	user 0.006s	sys 0.006s
I20260709 13:16:45.248332 14531 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:45.402197 14577 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.402973 14531 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.404564 14531 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.405225 14577 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.406670 14534 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.408916 14534 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.329310 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.409960 10325 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:45.289196 14576 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.410956 14576 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.412058 14576 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.421088 10246 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.301126 14091 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.238092 14564 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.332531 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:45.310518 14483 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.309641 14542 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.341737 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 72060.7us
W20260709 13:16:45.348685 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 160577us
I20260709 13:16:45.377259 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.319535 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 691) took 1579 ms. Trace:
I20260709 13:16:45.428478 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.428885 10322 rpcz_store.cc:276] 0709 13:16:43.740020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.741423 (+  1403us) service_pool.cc:224] Handling call
0709 13:16:45.319338 (+1577915us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400187ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:45.319478 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038665472}
I20260709 13:16:45.328506 14463 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.381570 10245 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:16:45.321316 14616 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:16:45.483222 10245 pending_rounds.cc:85] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
W20260709 13:16:45.390376 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82103us
I20260709 13:16:45.485534 14616 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:45.485975 14616 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.486976 14616 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.488533 14616 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:45.330089 14400 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.492077 14400 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.371824 14537 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.431231 14483 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.495949 14483 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.496696 10247 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:16:45.496603 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:45.497161 10247 pending_rounds.cc:85] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 9
I20260709 13:16:45.497424 10247 pending_rounds.cc:107] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:16:45.497646 10247 raft_consensus.cc:2889] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.398787 14515 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:45.499996 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.367030 14475 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:45.432303 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.436314 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:45.501878 14566 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:45.436800 14524 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:45.436688 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:45.438923 14463 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.440644 14473 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.441330 14631 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.392273 14516 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:16:45.444010 14552 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:45.448465 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.449335 14610 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:45.393499 14595 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.452145 14534 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.465034 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:45.529600 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 81257.6us
I20260709 13:16:45.469002 14376 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.472267 14564 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.466796 14452 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.399657 10394 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.500031 10993 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:45.500866 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.477239 14542 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:45.505661 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 69089.3us
I20260709 13:16:45.511406 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:45.516368 10998 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:45.520661 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.505055 10245 pending_rounds.cc:107] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:16:45.523897 14552 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:45.506464 14483 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:45.520112 14504 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:45.430091 14091 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.545539 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:45.545840 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.546439 10245 raft_consensus.cc:2889] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.548559 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 710) took 1595 ms. Trace:
I20260709 13:16:45.557849 10324 rpcz_store.cc:276] 0709 13:16:43.953152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.453555 (+500403us) service_pool.cc:224] Handling call
0709 13:16:44.459975 (+  6420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.991435 (+531460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.991484 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.992241 (+   757us) log.cc:844] Serialized 52 byte log entry
0709 13:16:45.064468 (+ 72227us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:45.177113 (+112645us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.182422 (+  5309us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.184730 (+  2308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.184803 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.258150 (+ 73347us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b2400180ed8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a3a09d 00007f58c366c10e 00007f58c368388c 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221
0709 13:16:45.258863 (+   713us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b4800270cd8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f 00007f58c8afff37 00007f58c8b1455c 00007f58c8b14508 00007f58c8b14488 00007f58c8b14443 00007f58c8b136ec 00007f58c7a3da96
0709 13:16:45.468820 (+209957us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b1800424180. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:45.548311 (+ 79491us) raft_consensus.cc:1685] finished
0709 13:16:45.548334 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.548480 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":458116,"prepare.queue_time_us":412037,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":5861,"raft.queue_time_us":458755,"raft.run_cpu_time_us":1375,"raft.run_wall_time_us":82719,"spinlock_wait_cycles":24536064,"thread_start_us":140993,"threads_started":2,"wal-append.queue_time_us":68208}
I20260709 13:16:45.535915 14515 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:45.549098 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.564787 10250 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:45.556288 10244 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:45.559656 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.520895 14566 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.549049 14560 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:45.543977 14462 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.553287 14504 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.544533 14617 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:16:45.572019 14564 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:45.547247 14612 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:16:45.574733 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.551101 14577 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:16:45.578404 10993 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:45.539044 14537 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:16:45.550918 14483 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.538790 14534 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.582959 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.559083 14475 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.561349 14461 raft_consensus.cc:2764] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:45.586290 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:45.567832 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.595453 14483 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:45.598502 14566 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.599421 14612 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:45.600210 14537 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:45.601200 14501 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10.
W20260709 13:16:45.602492 14340 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.557s	user 0.001s	sys 0.009s
I20260709 13:16:45.638440 14475 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.581305 14526 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.641158 14526 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.576696 14551 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:16:45.576761 14462 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.610558 14542 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.612072 14091 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.652863 14462 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.612767 14478 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.599438 14523 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.638885 14564 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.658735 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.659301 14564 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:45.659793 10246 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:45.660236 14564 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.660791 14487 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:45.616103 14535 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.660828 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.662433 14535 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.639032 14476 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:45.618321 10398 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:45.663362 14493 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:45.619006 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.639971 14537 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.620097 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.665216 10395 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:45.663404 14535 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.665091 14537 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.666425 14537 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.666476 14535 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.610016 10250 pending_rounds.cc:85] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 4
I20260709 13:16:45.622478 14375 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:45.573464 14353 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:45.550192 14631 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:45.668298 14631 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:45.632421 14625 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:45.668646 14631 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:45.670760 10250 pending_rounds.cc:107] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:45.671120 10250 raft_consensus.cc:2889] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.673164 10245 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.662631 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:45.675127 10241 raft_consensus.cc:2410] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:45.623128 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:45.627732 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.628190 14076 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:45.629546 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2359) took 1576 ms. Trace:
I20260709 13:16:45.681965 10317 rpcz_store.cc:276] 0709 13:16:44.053421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.105293 (+ 51872us) service_pool.cc:224] Handling call
0709 13:16:45.617381 (+1512088us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540020ab54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:45.629471 (+ 12090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760713984}
I20260709 13:16:45.682369 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:45.631206 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47461.7us
W20260709 13:16:45.631583 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 63824.3us
I20260709 13:16:45.683844 10248 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:45.684728 10242 raft_consensus.cc:2393] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 6: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:45.685164 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:45.631732 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 57071.8us
I20260709 13:16:45.582881 14504 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.698107 14565 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:45.698530 14343 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:45.636610 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 53732.4us
I20260709 13:16:45.699615 14516 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:45.700066 14516 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.700225 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.700873 10316 raft_consensus.cc:2376] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12. Re-sending same reply.
I20260709 13:16:45.700927 10362 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:45.701014 14516 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.701798 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.639349 14612 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.645090 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2368) took 1471 ms. Trace:
I20260709 13:16:45.702617 10319 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:45.702575 10321 rpcz_store.cc:276] 0709 13:16:44.173929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.706195 (+532266us) service_pool.cc:224] Handling call
0709 13:16:45.319933 (+613738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.389483 (+ 69550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.644874 (+255391us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400187ed0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:45.645028 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410501376}
I20260709 13:16:45.645615 14526 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:45.658491 14551 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:45.616966 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.663169 14476 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:45.620816 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.730345 10249 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.678794 10323 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
I20260709 13:16:45.685786 10318 raft_consensus.cc:2376] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10. Re-sending same reply.
I20260709 13:16:45.731755 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.584807 14560 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:45.686828 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:45.681779 14076 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:45.695678 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.696404 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.670408 14480 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.709671 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:45.669642 14631 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.713822 10321 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:45.721702 10393 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: [8.7-12.9]
W20260709 13:16:45.742736 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 55992.9us
I20260709 13:16:45.635084 14156 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:45.731665 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:45.682344 10246 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:45.670797 14576 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:45.736181 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.743846 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:45.744088 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:45.756624 10317 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.756965 10319 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:45.755968 10999 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:45.747857 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.759703 11002 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:45.702962 14612 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.752393 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:45.761868 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:45.762347 10325 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:45.762532 10997 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.747785 10249 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:45.718004 14343 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:16:45.750715 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.751590 11001 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:45.744263 10998 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:45.752074 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:45.755950 10318 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:45.762043 10996 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:45.763118 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:45.727836 10288 connection.cc:256] RPC call timeout handler was delayed by -1.1634262279999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:16:45.772991 10288 connection.cc:256] RPC call timeout handler was delayed by -1.0671262279997791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:16:45.773713 10998 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:45.773844 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:45.723621 14475 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:45.775655 10288 leader_election.cc:400] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 7 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 7. Current term is 8.
I20260709 13:16:45.781028 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.768409 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.777839 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.722374 14551 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.729640 14188 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:45.783586 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.735705 14538 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.787897 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.788337 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.789628 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.743222 14501 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.735127 14570 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.793226 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.785908 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:45.794363 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.752041 14542 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:45.754104 14156 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.829362 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:45.779531 14343 consensus_queue.cc:1243] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:45.745450 14428 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:16:45.798252 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.798347 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:45.766497 14516 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.764076 14353 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:45.811575 10397 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.814424 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:45.819410 10391 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:45.819290 10247 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:45.779879 14462 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.786791 14558 raft_consensus.cc:2764] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:16:45.887352 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 89099us
I20260709 13:16:45.889361 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:45.751668 14270 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:16:45.890738 10397 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:45.797592 14474 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:45.792822 14599 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:45.761515 14553 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:16:45.838901 10395 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:16:45.869158 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 54832.8us
I20260709 13:16:45.942021 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:45.836555 14460 consensus_meta.cc:287] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.002s
I20260709 13:16:45.943614 14460 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.883522 14551 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.781061 14091 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:16:45.837224 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.802867 14475 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:45.815948 14585 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:45.816226 14595 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.793835 14340 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:45.829504 14471 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.588485 14552 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.816152 14542 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:45.961580 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:45.797797 14480 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:16:45.834918 14156 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:45.886400 14650 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:16:45.832253 14501 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:45.808849 14575 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:16:45.912490 14270 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:45.917444 10396 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:45.810103 14538 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.921958 14612 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.804720 14188 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.908533 14560 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.904078 14570 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.891974 14532 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:45.907410 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:45.927073 14487 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:45.927956 14534 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:45.930799 10997 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:45.936120 10317 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:45.940824 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:45.910542 14473 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:45.907534 14474 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:45.902627 14462 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:45.978720 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:45.941309 14599 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:45.987808 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 112210us
I20260709 13:16:45.964286 14542 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:45.991837 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:45.998843 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.905916 14076 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:46.007396 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.999831 11001 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.930589 14476 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:45.962005 14523 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:45.962257 14576 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:45.965266 14472 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:16:46.002624 10390 pending_rounds.cc:85] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 4
I20260709 13:16:46.017936 10390 pending_rounds.cc:107] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:16:46.018356 10390 raft_consensus.cc:2889] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.968449 14460 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.016650 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:45.987735 14595 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:46.022080 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:46.009073 14532 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:46.001509 14473 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.045743 10995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:45.968171 14471 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.002045 14478 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.020047 10395 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:46.011462 14599 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.072471 10244 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:46.082588 14645 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:16:46.084398 14647 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:46.086544 10398 raft_consensus.cc:2410] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
W20260709 13:16:46.086755 14642 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:16:46.049122 14524 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:46.088881 14524 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:46.090212 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2648) took 1020 ms. Trace:
I20260709 13:16:46.090077 14524 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.090713 10243 rpcz_store.cc:276] 0709 13:16:45.069998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.312988 (+242990us) service_pool.cc:224] Handling call
0709 13:16:45.320989 (+  8001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.558349 (+237360us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:45.577467 (+ 19118us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.777788 (+200321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.799319 (+ 21531us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.808109 (+  8790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:45.808167 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.873095 (+ 64928us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002ec554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:45.873160 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.089870 (+216710us) raft_consensus.cc:1685] finished
0709 13:16:46.089986 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.090146 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14429,"prepare.queue_time_us":18955,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":12339,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":20532,"spinlock_wait_cycles":545611520,"thread_start_us":128341,"threads_started":1,"wal-append.queue_time_us":211821}
I20260709 13:16:46.078794 14474 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.069878 14501 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.098852 10395 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:16:46.105290 14532 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:46.109076 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.108929 14504 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.078579 14076 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.116325 14471 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.051062 14473 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.120117 14188 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:46.030992 10397 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:46.164562 10399 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:46.073026 14553 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.178069 11000 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:46.211300 10391 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
W20260709 13:16:46.213774 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 271805us
I20260709 13:16:46.216094 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:46.234344 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:46.071626 14483 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.192291 14480 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.178992 14188 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:46.286103 10997 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:16:46.292021 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 400716us
I20260709 13:16:46.292639 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:46.293327 10399 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:46.296092 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:46.297055 10999 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:46.299306 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:46.301633 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:46.302357 10998 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:16:46.304523 10399 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:46.306465 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:46.239202 14375 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.231205 14478 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.313879 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.318188 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:46.322145 11002 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.237744 14558 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:46.318698 10399 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:16:46.326481 10399 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 9
I20260709 13:16:46.326820 10399 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:16:46.327106 10399 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.266403 14595 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:46.197664 14553 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.373481 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:46.337670 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:16:46.330598 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.380071 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:46.375926 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:46.376770 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:46.380885 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:46.381538 10395 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:46.390883 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.400315 14313 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.403834 14091 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:46.403679 14313 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.404784 14091 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:46.405305 14091 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:46.406757 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:46.412101 10242 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:46.412629 10242 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:46.323827 14343 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:46.415673 10242 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.293572 14480 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.419782 10996 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:46.467361 10242 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.435040 10395 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:46.438371 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:46.442775 10396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2294) took 1552 ms (client timeout 1713 ms). Trace:
I20260709 13:16:46.443919 14595 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.445779 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2654) took 1066 ms. Trace:
I20260709 13:16:46.471794 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:46.485440 10998 raft_consensus.cc:2368] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
W20260709 13:16:46.489331 10396 rpcz_store.cc:269] 0709 13:16:44.890246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.890390 (+   144us) service_pool.cc:224] Handling call
0709 13:16:46.442480 (+1552090us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540040f454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:46.442683 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346978176}
W20260709 13:16:46.491232 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 198192us
I20260709 13:16:46.492312 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:46.324658 14375 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.423774 14343 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:46.460233 14340 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:46.504014 14340 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:46.504819 14461 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:46.504884 14340 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:46.461318 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.462355 14462 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.463538 14504 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.324108 14558 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:46.308799 14188 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.479732 14654 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.502044 14535 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.005s
I20260709 13:16:46.481807 10244 rpcz_store.cc:276] 0709 13:16:45.379411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.583364 (+203953us) service_pool.cc:224] Handling call
0709 13:16:45.633448 (+ 50084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.074561 (+441113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.445416 (+370855us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54003b3dd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:46.445696 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001374464}
I20260709 13:16:46.332247 14478 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.453117 14156 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:46.539556 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.449153 14599 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.498775 14653 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:46.499228 10317 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:16:46.516322 14542 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.001s
I20260709 13:16:46.500540 14665 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:46.480603 14648 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 13:16:46.468988 14516 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:16:46.505251 14483 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:46.428884 14649 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.262s	user 0.003s	sys 0.000s
I20260709 13:16:46.465052 14376 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:46.508487 11002 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 6.
W20260709 13:16:46.480017 14651 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:16:46.486865 14575 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:46.492213 14538 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:46.513878 14658 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:16:46.628193 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.501211 14660 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.500108 14656 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:16:46.406188 14091 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.491608 14661 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.162s
I20260709 13:16:46.622383 14662 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.630311 14474 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:46.632323 14570 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:46.636449 14665 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:46.668491 14532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.029s
I20260709 13:16:46.526124 14654 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.644461 14542 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.688655 14575 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:46.704453 14655 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:46.723284 14668 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:16:46.722873 14655 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:46.725337 14657 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:46.726157 14655 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:46.727077 14655 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.727742 14655 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.691803 14662 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.695724 14570 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.692116 14558 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.800743 10242 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:46.802157 10243 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:46.802481 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2659) took 1097 ms. Trace:
I20260709 13:16:46.551369 10249 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:46.803895 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2657) took 1298 ms. Trace:
W20260709 13:16:46.806957 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 314559us
W20260709 13:16:46.630018 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 100416us
I20260709 13:16:47.017612 14575 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.518656 10322 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:46.817595 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2489) took 1097 ms. Trace:
I20260709 13:16:47.020470 10320 rpcz_store.cc:276] 0709 13:16:45.720116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.736699 (+ 16583us) service_pool.cc:224] Handling call
0709 13:16:45.737020 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.737582 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.737628 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.752022 (+ 14394us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.969423 (+217401us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:46.014416 (+ 44993us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.461956 (+447540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.462019 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.816921 (+354902us) raft_consensus.cc:1685] finished
0709 13:16:46.816971 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.817317 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":448072,"prepare.queue_time_us":42768,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":450143,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":15973,"thread_start_us":209666,"threads_started":1,"wal-append.queue_time_us":403667}
I20260709 13:16:46.818692 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 712) took 1134 ms. Trace:
I20260709 13:16:47.026901 14683 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.025219 10324 rpcz_store.cc:276] 0709 13:16:45.684429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.684555 (+   126us) service_pool.cc:224] Handling call
0709 13:16:45.696867 (+ 12312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.705274 (+  8407us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:45.735086 (+ 29812us) log.cc:844] Serialized 14 byte log entry
0709 13:16:45.925408 (+190322us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b180038a640. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:46.460843 (+535435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.461343 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.461489 (+   146us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:46.461707 (+   218us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.461904 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.461968 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.817995 (+356027us) raft_consensus.cc:1685] finished
0709 13:16:46.818033 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.818455 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":684905,"prepare.queue_time_us":40119,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":505494,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":30188,"spinlock_wait_cycles":19793792,"thread_start_us":173280,"threads_started":1,"wal-append.queue_time_us":396074}
I20260709 13:16:46.817600 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2490) took 1097 ms. Trace:
I20260709 13:16:47.027844 14683 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.653378 10394 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:47.017635 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.630676 10392 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:16:46.867655 14375 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:46.868361 14188 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:46.868456 14156 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:47.016860 10250 rpcz_store.cc:276] 0709 13:16:45.504823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.609522 (+104699us) service_pool.cc:224] Handling call
0709 13:16:45.609839 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.704222 (+ 94383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.704254 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.704680 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.010963 (+306283us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:46.011014 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.011114 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.803136 (+792022us) raft_consensus.cc:1685] finished
0709 13:16:46.803184 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.803594 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":244440,"threads_started":1,"wal-append.queue_time_us":426627}
I20260709 13:16:47.031706 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.032245 14313 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.656062 14343 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.033694 14683 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.034597 14343 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:47.028591 10321 rpcz_store.cc:276] 0709 13:16:45.720427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.759996 (+ 39569us) service_pool.cc:224] Handling call
0709 13:16:45.760306 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.760633 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.760661 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.761135 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.931101 (+169966us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:45.931141 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.931209 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.428266 (+497057us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:46.816941 (+388675us) raft_consensus.cc:1685] finished
0709 13:16:46.816981 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.817413 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":216,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":3928960,"thread_start_us":169607,"threads_started":1,"wal-append.queue_time_us":288901}
I20260709 13:16:46.870157 14462 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:46.870296 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:47.039021 10397 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:46.870383 14353 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.041283 14428 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:47.041870 14353 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.044917 14353 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.042152 14428 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.048647 14428 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:47.059270 10213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.013s	sys 0.031s
W20260709 13:16:47.059803 10213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.013s	sys 0.031s
W20260709 13:16:47.061757 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 680923us
I20260709 13:16:46.880889 14472 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:47.071828 14472 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.881968 10391 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:47.075906 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:46.888005 14473 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.004s
I20260709 13:16:47.077852 10999 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:46.891348 14478 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.892072 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 910) took 1574 ms. Trace:
I20260709 13:16:46.892483 14480 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:46.893587 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 854) took 1156 ms. Trace:
I20260709 13:16:46.893754 14501 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.079308 11000 rpcz_store.cc:276] 0709 13:16:45.317646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.317821 (+   175us) service_pool.cc:224] Handling call
0709 13:16:46.891526 (+1573705us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400660154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:46.891748 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164193024}
I20260709 13:16:47.080228 14501 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.901793 14535 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.081884 11000 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:47.081779 14535 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.084540 14535 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:46.904927 14542 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:46.906663 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:47.079710 11001 rpcz_store.cc:276] 0709 13:16:45.736615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.779720 (+ 43105us) service_pool.cc:224] Handling call
0709 13:16:45.999578 (+219858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.008053 (+  8475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.892999 (+884946us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400525650. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:46.893270 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450061056}
I20260709 13:16:46.907732 14515 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:47.089279 14515 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.092162 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1855) took 1372 ms. Trace:
I20260709 13:16:47.092651 10394 rpcz_store.cc:276] 0709 13:16:45.719212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.719330 (+   118us) service_pool.cc:224] Handling call
0709 13:16:45.751322 (+ 31992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.029608 (+1278286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.091715 (+ 62107us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540010c554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:47.091957 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073974016}
W20260709 13:16:47.093302 14612 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.100s	user 0.010s	sys 0.007s
I20260709 13:16:47.094983 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:46.917237 14537 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.718748 14599 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.096379 14537 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:46.746135 14654 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:46.749815 14655 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.099579 10395 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:47.101138 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.061952 14631 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.689110 14660 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.107077 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 851) took 1399 ms. Trace:
W20260709 13:16:47.107163 14643 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 1.116s	user 0.000s	sys 0.014s
I20260709 13:16:46.755988 14662 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:46.720834 14665 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:46.715656 14553 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:46.988159 14534 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:47.110036 14534 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:47.110839 14695 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:16:46.990660 14570 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:46.973305 14076 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.802s	user 0.014s	sys 0.007s
I20260709 13:16:47.003289 10245 rpcz_store.cc:276] 0709 13:16:45.704991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.710435 (+  5444us) service_pool.cc:224] Handling call
0709 13:16:45.710859 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.714913 (+  4054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.715046 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.719299 (+  4253us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.016894 (+297595us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:46.016936 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.017017 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.801786 (+784769us) raft_consensus.cc:1685] finished
0709 13:16:46.801882 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.802256 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3471,"raft.queue_time_us":3692,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":17404,"thread_start_us":237756,"threads_started":1,"wal-append.queue_time_us":739443}
I20260709 13:16:46.693375 14474 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:47.113704 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.078406 14473 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.118480 14473 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:46.907228 14340 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:46.907752 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.120895 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.112176 14673 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.122624 14673 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.126112 14076 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:47.127137 14076 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.131208 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.133661 14565 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:47.134181 14565 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.134666 14565 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.107584 10993 rpcz_store.cc:276] 0709 13:16:45.707835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.707971 (+   136us) service_pool.cc:224] Handling call
0709 13:16:45.708272 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.718801 (+ 10529us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:45.765582 (+ 46781us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.899229 (+1133647us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b18002b02a0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c368823a 00007f58c3af2a2a
0709 13:16:47.070386 (+171157us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.071241 (+   855us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.071526 (+   285us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:47.072746 (+  1220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.072890 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.106486 (+ 33596us) raft_consensus.cc:1685] finished
0709 13:16:47.106630 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.106836 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8815,"prepare.queue_time_us":30581,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":54470,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":15148,"spinlock_wait_cycles":5656320,"thread_start_us":77552,"threads_started":1,"wal-append.queue_time_us":1279239}
I20260709 13:16:47.147341 14472 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:47.147933 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 84677.3us
I20260709 13:16:47.148115 14660 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.149030 14515 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.151604 14501 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:47.152940 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 134049us
I20260709 13:16:47.153144 14534 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.155185 14535 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:47.157045 14653 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:47.203682 14535 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:47.158691 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 127269us
W20260709 13:16:47.189939 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.191339 14683 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:47.192821 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:47.193122 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.193769 14660 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:47.194670 14662 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:47.158864 14471 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:47.151508 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:47.198753 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.202210 14515 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:47.216913 10243 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.203809 14653 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.218340 14353 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.219231 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:47.219291 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.220238 14535 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.220593 14691 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:47.172309 14076 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.164148 14537 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.158113 14474 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.169147 14313 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.234489 14313 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.234678 14683 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.237161 14683 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.234527 14662 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:47.239163 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87799.6us
I20260709 13:16:47.228611 14691 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.207293 14660 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.237075 14313 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.252581 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.234054 14653 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.258566 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:47.259696 10250 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.261282 14471 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:47.262014 14471 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.262693 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.263902 14376 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.264496 14376 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:47.264863 14471 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.255389 10246 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:47.258430 14353 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.266389 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.280848 10243 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:47.282977 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.266182 14076 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.291064 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.291545 14353 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.296376 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:47.297245 14531 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:16:47.298034 14531 consensus_queue.cc:1243] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:47.302073 10324 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:47.302497 10392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 812) took 1665 ms (client timeout 2162 ms). Trace:
W20260709 13:16:47.302996 10392 rpcz_store.cc:269] 0709 13:16:45.620314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.620546 (+   232us) service_pool.cc:224] Handling call
0709 13:16:47.270654 (+1650108us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000bc7d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:47.285636 (+ 14982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829256448}
I20260709 13:16:47.301995 10321 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:47.282434 14683 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.265738 14471 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:47.284682 14599 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:47.307492 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.265720 14376 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.310381 14076 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.312824 14076 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.313678 14599 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:47.314975 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.314905 14599 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.316414 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.284000 14473 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.318708 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:47.319636 10324 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.319262 14473 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.318784 14662 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.318972 14691 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:47.308462 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 60747.2us
I20260709 13:16:47.330294 10320 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:47.338012 10393 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:47.332099 14683 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.346100 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:47.334543 14188 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:47.350958 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.333214 14340 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.353063 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.353657 10242 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:47.356544 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:47.360423 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.360682 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.362574 14473 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.365016 14313 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:47.365520 14535 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:47.367658 14428 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:47.368131 14428 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:47.369347 14428 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.371225 14428 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.372198 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:47.373245 10393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1860) took 1611 ms (client timeout 1566 ms). Trace:
W20260709 13:16:47.373682 10393 rpcz_store.cc:269] 0709 13:16:45.761737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.762849 (+  1112us) service_pool.cc:224] Handling call
0709 13:16:47.373063 (+1610214us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540010b654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:47.373186 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038415616}
I20260709 13:16:47.374271 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.379711 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.380057 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.381516 14558 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.389257 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1865) took 1583 ms. Trace:
I20260709 13:16:47.389765 10316 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:47.391964 14552 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:47.392230 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:47.392467 10965 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.761s (SENT) [suppressed 6 similar messages]
I20260709 13:16:47.402824 10324 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:47.408185 10243 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:47.408993 10322 raft_consensus.cc:2410] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:16:47.392688 14551 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:47.415899 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.416199 14535 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.415663 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:47.389734 10390 rpcz_store.cc:276] 0709 13:16:45.805937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.806331 (+   394us) service_pool.cc:224] Handling call
0709 13:16:45.835057 (+ 28726us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.019135 (+184078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.019166 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:46.019916 (+   750us) log.cc:844] Serialized 52 byte log entry
0709 13:16:46.238992 (+219076us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:46.357663 (+118671us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.371981 (+ 14318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.387107 (+1015126us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400301954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:47.387179 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.388724 (+  1545us) raft_consensus.cc:1685] finished
0709 13:16:47.388814 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.389064 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13706,"prepare.queue_time_us":187035,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":26697,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":33592,"spinlock_wait_cycles":384684288,"thread_start_us":231990,"threads_started":2,"wal-append.queue_time_us":590634}
I20260709 13:16:47.415778 14538 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.418699 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.350376 14471 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.422153 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:47.407948 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 59391.7us
I20260709 13:16:47.421077 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.431409 14565 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.432022 10322 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [8.7-11.8]
I20260709 13:16:47.432961 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:47.434141 10323 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:47.436503 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.441598 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.448897 10317 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:47.449720 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:47.449842 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.452081 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:47.452600 14535 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:47.454623 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.462883 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.465817 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.466667 10394 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:47.469866 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.470209 10250 raft_consensus.cc:2410] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:47.473706 10391 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:47.470347 14665 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:47.482211 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.397343 14188 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.461237 14673 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.483837 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.499547 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:47.481598 14660 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.505012 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:47.505347 11000 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:47.505738 10999 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.506273 11001 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:47.509728 14683 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.510335 14501 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:47.511395 14471 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.513355 14501 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.497875 14691 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.515012 14691 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.515726 14523 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:47.517390 14691 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.528028 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2306) took 1229 ms. Trace:
I20260709 13:16:47.528522 10397 rpcz_store.cc:276] 0709 13:16:46.298899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.299049 (+   150us) service_pool.cc:224] Handling call
0709 13:16:47.527745 (+1228696us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400102054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:47.527937 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816076160}
I20260709 13:16:47.537845 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.538825 10318 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:47.543303 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.543954 10316 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:47.545028 14188 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.549057 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:47.553015 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.553352 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.503891 14599 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:47.555853 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.565907 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.575839 10325 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:47.578159 10316 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:47.587356 14680 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.587597 10364 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:47.588135 14680 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:47.588330 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.589542 14537 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:47.589334 14680 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.589948 14537 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.590029 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:47.591020 14705 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:47.563932 14599 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:47.591679 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 92271.1us
I20260709 13:16:47.593981 14375 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.595705 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:47.499704 14538 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.555138 14471 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:47.600638 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 208372us
I20260709 13:16:47.600689 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.596977 10996 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:47.624027 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.623334 10999 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:47.633519 14428 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:47.633706 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.634428 14428 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.634802 10398 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:47.635003 14428 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.601928 14537 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.639279 10250 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:47.640682 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.646178 10397 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:47.646600 14610 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:47.647975 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.648741 10390 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:47.649873 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:47.633569 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.652951 10996 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:47.653012 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:47.653651 14567 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.654558 14156 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:47.654361 14567 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.655043 14156 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:47.655167 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.655463 14156 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:47.654386 14535 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:47.658599 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:47.659021 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:47.659323 10394 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.659340 14567 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:47.659696 10999 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.661695 14565 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:47.663909 14343 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.006s
I20260709 13:16:47.664934 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.665864 10243 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:47.666810 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:47.667675 14631 consensus_meta.cc:287] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.004s
I20260709 13:16:47.667882 10243 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:47.668422 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2662) took 1364 ms. Trace:
I20260709 13:16:47.582885 14501 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.669045 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.668874 14375 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.669828 14471 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.671039 10395 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:47.654145 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:47.672094 10318 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:47.672037 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.675489 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.676074 10321 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:47.665129 14538 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:47.683144 10396 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:47.605917 14599 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:47.675562 10249 rpcz_store.cc:276] 0709 13:16:46.232242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.233329 (+  1087us) service_pool.cc:224] Handling call
0709 13:16:46.233689 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.029958 (+796269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.573937 (+543979us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540009d654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:47.596166 (+ 22229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730033536}
I20260709 13:16:47.690973 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.706851 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.708993 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.711364 10996 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:47.712226 10246 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:16:47.713500 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.712085 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.722906 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:47.730433 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.719249 10392 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:47.751602 10390 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:47.697547 14376 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.716046 14683 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.716866 14313 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.806005 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:47.758265 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.749826 10391 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
W20260709 13:16:47.793781 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69686.6us
I20260709 13:16:47.785741 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:47.809893 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.774884 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.810364 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.800724 14537 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.819415 10393 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:47.818997 10244 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:47.754279 14343 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.822091 14343 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.820852 14537 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:47.822391 14376 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.740420 14501 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.823477 14313 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.768725 14557 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.219s
I20260709 13:16:47.754552 10999 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:47.832620 10996 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:47.837733 10394 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:16:47.792431 14700 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.350s	user 0.004s	sys 0.000s
I20260709 13:16:47.768944 14512 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.853175 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.784386 14375 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.856851 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.859036 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.858884 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.860433 10243 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:47.837123 14653 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.864830 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.801673 14428 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.860191 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:47.863767 14542 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:47.875499 14542 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.878579 14585 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.878861 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.880256 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.880457 14585 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.880990 14585 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.858860 14512 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.842190 14523 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:47.799793 14156 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.884215 14471 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.884837 14471 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:47.885622 14156 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.841115 14631 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.872319 14504 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.886564 14631 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.886945 14504 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.887642 10364 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:47.888684 14631 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.888969 14504 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.889166 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:47.886577 10995 raft_consensus.cc:606] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.889875 10995 raft_consensus.cc:614] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:47.890543 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.873100 14653 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.891345 10242 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:47.892149 14477 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.882012 14340 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:47.892191 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:47.877940 14542 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.893882 10246 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:47.913930 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.881603 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.850884 14683 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.892797 14653 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.868353 14537 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:16:47.925384 14557 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.924233 14610 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:47.892683 14477 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:47.938632 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:47.945895 10246 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
W20260709 13:16:47.946836 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 52945.3us
W20260709 13:16:47.956269 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 107049us
I20260709 13:16:47.964848 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:47.966732 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:47.967391 10364 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:47.950623 14557 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.976241 14428 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.957716 14523 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.974612 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:32924 (request call id 6) took 1930 ms. Trace:
I20260709 13:16:47.978595 14683 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:47.979285 14676 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:47.980854 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:47.981406 14091 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:47.986577 14551 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:47.950131 14538 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:48.022545 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.003166 10996 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:47.990257 10993 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:47.968463 14660 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:47.991374 14340 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:47.994911 10995 rpcz_store.cc:276] 0709 13:16:46.019171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.019306 (+   135us) service_pool.cc:224] Handling call
0709 13:16:47.944071 (+1924765us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54004f42d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae2853 00007f58c8ab060a 00007f58c20367d4 00007f58c2036762 00007f58c2036691 00007f58c203660c 00007f58c20358c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:47.949741 (+  5670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4231534464}
I20260709 13:16:47.991026 14376 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:47.993361 14557 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.032747 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:47.994825 14313 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:47.997433 14523 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:47.989624 14599 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.003257 14676 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.058674 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:48.060457 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 89440.2us
I20260709 13:16:48.023809 14610 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:48.083844 14599 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.084316 14474 raft_consensus.cc:2764] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:48.084731 14691 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.068017 14676 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.065204 14575 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.058458 14551 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:48.093415 14660 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:48.094574 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 213038us
I20260709 13:16:48.095700 10245 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
W20260709 13:16:48.101091 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 120334us
I20260709 13:16:48.106493 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:48.100143 14575 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:48.116688 10213 leader_election.cc:400] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:16:48.117121 10213 leader_election.cc:403] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:48.115191 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:48.120087 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.110339 14585 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.111979 14091 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:48.117304 14575 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.121065 14599 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
W20260709 13:16:48.124070 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 241423us
I20260709 13:16:48.123143 14474 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.117007 14691 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.126416 14091 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:48.146381 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 181644us
I20260709 13:16:48.136696 14552 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.147372 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.140518 14474 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:48.155012 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.150166 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:48.147876 14091 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:48.157918 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:48.153595 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:48.160591 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:48.152045 14565 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:48.162886 14376 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.164443 14376 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.164911 14376 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.166343 14558 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:48.173238 14343 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.149778 14585 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:48.156917 14474 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.183378 14343 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:48.184175 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:48.158496 14428 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.173992 14660 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.152706 10996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:48.195199 10996 raft_consensus.cc:606] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.195667 10996 raft_consensus.cc:614] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:48.189219 14599 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:48.194864 14428 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.202587 14731 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.204358 14512 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.204237 14732 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:48.210163 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.201771 14575 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.149660 14551 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.205597 14599 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:48.220863 10316 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:16:48.225881 10316 pending_rounds.cc:85] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 8
I20260709 13:16:48.190940 14343 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.221385 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.201246 14557 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.221369 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.230850 10249 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:48.227496 10320 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.216527 14428 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.234496 10999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:32924
I20260709 13:16:48.235071 10999 raft_consensus.cc:606] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.235431 10999 raft_consensus.cc:614] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:48.226164 10316 pending_rounds.cc:107] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:16:48.236593 10316 raft_consensus.cc:2889] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.237902 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.222026 14732 consensus_queue.cc:1243] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:48.241542 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.246877 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.217196 14731 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.247515 14091 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.249290 14731 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.233013 14523 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.229924 14343 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:48.250339 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 74216.8us
I20260709 13:16:48.251147 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.251574 14575 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.205883 14585 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.252460 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:48.253782 14585 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:48.240511 14716 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 13:16:48.254956 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.255620 10242 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:48.258956 10244 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:48.232532 14512 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.262703 14512 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.265025 14512 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.267393 10324 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:48.268558 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.269713 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.270606 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.271418 10318 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.274121 14557 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.274503 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.275172 10325 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.278090 10320 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:16:48.278481 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 128497us
I20260709 13:16:48.278623 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.279479 10319 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.279397 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:48.280413 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.280999 14575 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.281242 14680 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:48.281527 14575 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:48.281785 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.282485 10322 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:48.283495 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.282124 14575 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.284408 10249 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:16:48.285236 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.273167 14728 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.286702 14728 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:48.287106 14728 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.290546 14653 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:48.291450 14653 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:48.290997 14599 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.292143 14653 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:48.293116 14683 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:48.293475 14683 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:48.294487 14683 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:48.296567 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.274121 10317 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:48.249671 14091 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.319048 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.319957 10321 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.320811 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.323011 10322 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:48.324117 14565 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.324317 14376 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.324785 14565 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.326589 14376 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.327054 14565 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.327425 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.328472 14552 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:48.328609 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:48.328981 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 91212.7us
I20260709 13:16:48.329339 10318 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:48.330992 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:48.331350 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.331547 10393 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.331681 14537 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:48.332332 14537 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:48.333271 14537 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.334750 10998 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:48.333977 14654 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:48.335019 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:48.338430 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:48.339902 10397 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:48.341804 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.345538 10397 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.322180 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.346180 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.350055 10319 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.309222 14680 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:48.351648 14680 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.352586 14683 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:48.354827 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.355540 10324 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.349349 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.356720 10318 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:48.338536 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.357822 10394 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:48.343900 14726 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:16:48.332667 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.361408 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:48.375897 10322 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:48.376139 10320 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.363197 10325 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:16:48.379887 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 47315.4us
I20260709 13:16:48.387539 10245 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:48.388535 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:48.390551 10393 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:16:48.358716 14724 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.283s	user 0.004s	sys 0.000s
I20260709 13:16:48.391397 14552 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.407630 14552 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.410856 14428 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.413291 14428 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.393252 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.435608 14471 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.436058 14471 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.436385 14471 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.439673 14676 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.400264 14654 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:16:48.400796 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:48.476540 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 75820.2us
I20260709 13:16:48.401069 14653 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:48.402475 10395 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:48.403522 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.404410 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.406473 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.502635 10391 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:48.503357 10321 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:48.406560 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.504693 10396 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:48.418645 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:48.419230 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 107434us
I20260709 13:16:48.419075 14575 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.419710 14091 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:48.346204 14534 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.424479 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.513118 10394 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:48.424927 14725 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:16:48.426262 14535 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:48.427866 14719 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.350s	user 0.001s	sys 0.002s
I20260709 13:16:48.406028 14477 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.413913 14428 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:48.434516 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:48.397897 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.517695 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.445443 14501 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.519999 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:48.445526 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 52350us
I20260709 13:16:48.521727 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.446816 14471 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.393776 10290 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:48.524296 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 130596us
I20260709 13:16:48.480109 10320 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:48.525671 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.511751 10318 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:48.512065 10397 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:48.509284 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:48.410106 14552 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.509471 14585 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:48.516199 10995 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:48.436483 14691 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:48.528223 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:48.530339 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 95930.9us
I20260709 13:16:48.481909 14558 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:48.544751 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.535175 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.543102 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.546687 10318 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:48.549589 10319 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:48.539302 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.551335 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.542729 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.553800 10244 raft_consensus.cc:2410] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:16:48.516979 14535 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:48.556684 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.558718 10999 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:48.561477 10245 pending_rounds.cc:85] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 3
I20260709 13:16:48.555476 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:48.565231 10245 pending_rounds.cc:107] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:48.536752 14653 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:48.552124 10249 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:48.548225 14091 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:48.586478 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.586277 14667 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:16:48.536571 14340 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:48.513967 14343 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.544018 14585 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.510998 14474 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.594722 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.527794 14428 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.542634 14504 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:48.544275 14501 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.616325 10144 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 6 to 8, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 8 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.583871 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.566121 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.619258 10321 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:48.584864 10245 raft_consensus.cc:2889] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.619868 10245 pending_rounds.cc:107] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:48.593336 14653 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.597252 14654 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:48.621598 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 457476us
I20260709 13:16:48.624253 10242 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:48.558086 14523 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.583261 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.551468 14631 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:16:48.627863 10993 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:48.639448 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56287.4us
I20260709 13:16:48.618950 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:48.640324 10249 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.628772 10245 raft_consensus.cc:2889] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.628755 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:48.605371 14585 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.640498 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:48.607932 14557 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:48.642532 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.646039 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.616426 14428 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.651021 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.659823 10999 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 6.
I20260709 13:16:48.663806 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.635632 14653 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:48.637020 14654 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.675379 10392 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.679926 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:48.680892 10394 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:48.690976 14471 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.694805 14575 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.696599 14474 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.698534 10249 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:48.647176 14610 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:48.626669 14558 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.701702 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:48.652838 14156 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:48.698812 14654 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.745397 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 969) took 1071 ms. Trace:
I20260709 13:16:48.745955 10994 rpcz_store.cc:276] 0709 13:16:47.593544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.593770 (+   226us) service_pool.cc:224] Handling call
0709 13:16:47.594171 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.594757 (+   586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.594785 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.595326 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.844465 (+249139us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:47.844528 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.844626 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.427107 (+582481us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:48.653585 (+226478us) raft_consensus.cc:1685] finished
0709 13:16:48.653614 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.664640 (+ 11026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29630,"raft.queue_time_us":8054,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":27205,"spinlock_wait_cycles":17930496,"thread_start_us":242583,"threads_started":1,"wal-append.queue_time_us":481836}
I20260709 13:16:48.639000 14523 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.698427 14313 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:48.725844 10993 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:48.737265 14156 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.778964 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.707314 14557 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.784787 14667 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:48.787185 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.766857 14676 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.807121 10393 raft_consensus.cc:1217] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Deduplicated request from leader. Original: 7.7->[8.8-12.10]   Dedup: 8.8->[10.9-12.10]
I20260709 13:16:48.807781 10393 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [8.8-12.10]
I20260709 13:16:48.659232 14535 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.781956 14156 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.792461 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:48.816615 10248 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
W20260709 13:16:48.819947 10965 leader_election.cc:336] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.579s (SENT)
I20260709 13:16:48.821570 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.792321 14474 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.739037 14091 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:48.890609 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 351382us
I20260709 13:16:48.891702 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:48.892618 14654 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.895928 10248 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:48.894338 14156 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.897418 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:48.847716 14376 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:16:48.903784 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 257841us
W20260709 13:16:48.907207 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44798.3us
I20260709 13:16:48.906246 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:48.868148 14728 consensus_meta.cc:287] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
I20260709 13:16:48.847354 14557 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.911891 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:48.917171 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:48.919816 14471 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:48.920485 14471 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:48.867533 14676 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:48.946296 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.918393 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:48.962951 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:48.963042 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44751.9us
I20260709 13:16:48.964460 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:48.975662 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.976173 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:48.904630 14376 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:48.978708 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.979415 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:48.981315 10319 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:48.981511 10316 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.981458 10321 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:48.914894 14515 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.988834 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:48.991035 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64367.8us
I20260709 13:16:48.992125 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:48.992655 10325 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:48.994550 10247 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:48.848721 14474 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.922269 14654 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:48.921612 14471 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.986027 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:48.986083 14343 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:48.932796 14313 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:48.988104 10250 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:48.861758 14585 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:48.985312 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:49.020390 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 205675us
I20260709 13:16:48.990278 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.021142 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.021425 10321 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:48.932060 14537 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:48.962688 14504 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:16:49.025997 14743 log.cc:927] Time spent T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:16:49.027280 14742 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:16:49.030490 11000 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:49.030062 14585 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:49.009469 10324 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:48.989563 14501 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:49.017463 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:48.925997 14728 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:48.980824 14538 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:49.014518 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:48.997563 14515 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.041908 14515 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.042021 10247 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:49.043555 14504 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:49.043977 14504 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:48.980249 14557 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:49.040987 14340 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:49.041373 14538 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.017701 14313 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:49.061153 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 46719.6us
I20260709 13:16:49.059203 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:49.062125 10995 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:49.065424 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 72a1fe75b2bc4fb698d13f9d0b2dda04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:49.067816 10320 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
W20260709 13:16:49.054967 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 402729us
I20260709 13:16:49.018147 14599 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.018419 14731 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:49.070190 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.037701 14156 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:49.073316 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:49.077382 10325 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:49.055159 14538 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.055275 14557 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:49.057924 14534 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:49.056928 14523 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:49.094530 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:49.094888 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:49.097539 10244 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.097643 10248 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.068292 14313 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:49.100630 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.101884 10247 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:49.111042 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.113552 10998 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:49.057602 14654 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:16:49.115327 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:49.118880 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.090731 14340 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.120321 10241 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:49.126932 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.090413 14501 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:49.136384 10325 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:49.128595 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 103902us
I20260709 13:16:49.139284 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:49.141038 10995 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:49.134326 10241 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:49.144335 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.145045 10397 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:49.145876 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.146546 10395 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:49.150604 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:49.152655 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:49.153283 10322 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.153401 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:49.143585 10364 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:49.157899 10324 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:49.080399 14731 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.160871 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.164095 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.164594 10999 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:49.164763 10995 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:49.076359 14599 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.156359 10241 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.182477 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.172015 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:49.202543 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.080192 14376 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.205852 10325 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 7: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:49.204725 10317 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:49.206837 10241 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.100044 14504 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.171468 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:49.158694 14565 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:49.157864 14537 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:49.275067 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 124580us
I20260709 13:16:49.222671 14512 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:49.278122 10325 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:49.166481 14740 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:49.306583 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 869) took 1125 ms. Trace:
I20260709 13:16:49.307044 10993 rpcz_store.cc:276] 0709 13:16:48.180817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.399501 (+218684us) service_pool.cc:224] Handling call
0709 13:16:49.306390 (+906889us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54004f3654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:49.306496 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279887616}
I20260709 13:16:49.291004 10316 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:49.202605 14534 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:49.298548 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:49.300015 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.309531 10325 raft_consensus.cc:2368] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12.
I20260709 13:16:49.158051 14501 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.309894 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.315588 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.296126 14474 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:49.315543 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:49.318882 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:49.166666 14340 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.224371 14375 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:16:49.297340 14376 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:49.323994 10399 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:49.326895 14535 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:49.337030 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.338610 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.339411 10317 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:49.311786 14740 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.335181 14512 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:49.343212 14512 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:49.344004 14653 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.605s	user 0.000s	sys 0.010s
I20260709 13:16:49.295233 14557 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.344470 14653 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.346148 10323 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:49.312171 14534 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:49.347507 14534 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.349960 14751 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:49.350471 14751 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:49.350642 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.351854 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.352422 10316 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:49.353199 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:49.332969 14764 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:49.354626 10316 raft_consensus.cc:2368] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12.
I20260709 13:16:49.354071 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.356482 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.358009 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.358235 14740 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:49.358700 10320 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:16:49.328140 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:49.331717 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.359339 10396 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.300498 14091 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:16:49.331772 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:49.362150 10244 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:49.369204 11000 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:49.371335 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.377578 10396 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:49.377846 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.311554 14610 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:16:49.356621 14501 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:49.357264 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:49.384397 10317 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:49.359791 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.358073 10316 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:49.362032 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 190675us
I20260709 13:16:49.385490 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:49.383771 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.362546 10324 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:49.361905 10322 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:49.278373 14565 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.379595 10320 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:16:49.387982 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:49.370838 14754 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 13:16:49.358935 14340 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:49.392536 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:49.360404 14762 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:49.393460 10322 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:49.393643 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.394483 10395 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:49.398970 14501 raft_consensus.cc:2764] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:16:49.399411 14760 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:16:49.403710 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.404452 10994 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 6.
I20260709 13:16:49.405308 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 868) took 1225 ms. Trace:
W20260709 13:16:49.405488 14752 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:16:49.408951 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.409206 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.333842 14537 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.390810 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:49.392740 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.401894 14762 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:49.415166 10993 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:49.415344 14762 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.311851 14680 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:16:49.416133 14680 consensus_queue.cc:1243] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:49.416710 14501 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:49.405752 11001 rpcz_store.cc:276] 0709 13:16:48.180192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.184731 (+  4539us) service_pool.cc:224] Handling call
0709 13:16:48.185077 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.613198 (+428121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.613227 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:48.631620 (+ 18393us) log.cc:844] Serialized 52 byte log entry
0709 13:16:48.867969 (+236349us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:48.869614 (+  1645us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.870429 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.870538 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.405065 (+534527us) raft_consensus.cc:1685] finished
0709 13:16:49.405104 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.405252 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1076,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":49,"raft.queue_time_us":56196,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":295,"thread_start_us":589849,"threads_started":2,"wal-append.queue_time_us":364244}
I20260709 13:16:49.417310 14501 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:49.418553 14501 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.421607 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.422421 10320 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:49.423549 10248 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:16:49.423807 14759 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:16:49.418999 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.425515 11001 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:49.427038 10995 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:16:49.428725 14753 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.338s	user 0.003s	sys 0.001s
W20260709 13:16:49.429102 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.429847 14653 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:49.431242 14758 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:16:49.423453 14731 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:49.432003 14665 raft_consensus.cc:2764] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:49.392087 14565 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.441439 10317 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:49.452894 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:49.454085 10993 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.454463 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:49.452910 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.463568 10394 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:49.464675 10317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
W20260709 13:16:49.465224 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 166755us
I20260709 13:16:49.465554 10317 raft_consensus.cc:606] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.479380 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.480211 10394 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
W20260709 13:16:49.479562 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 174812us
I20260709 13:16:49.490209 10993 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
W20260709 13:16:49.471019 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 264082us
I20260709 13:16:49.495148 10248 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:49.495146 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:49.413769 14769 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:16:49.500447 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.503145 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:49.504510 10243 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.500146 14654 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:49.510661 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:49.514376 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.515483 10394 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:49.520249 14750 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:49.520756 14750 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:49.522496 14665 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:49.525202 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:49.526350 14665 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:49.526942 14665 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:49.526906 10144 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.528337 14665 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.528759 10144 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 9 to 10, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:49.531328 14504 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.533704 14091 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:16:49.539131 10146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 316) took 12021 ms (client timeout 15000 ms). Trace:
I20260709 13:16:49.491506 14340 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.546521 14340 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.550498 10243 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:16:49.551224 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:49.553408 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 99072.9us
I20260709 13:16:49.554289 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:49.555416 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44665.9us
I20260709 13:16:49.556376 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.545888 14728 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:49.461738 14538 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.565425 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:49.568550 10144 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.574677 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:49.575311 10244 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:49.566960 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:49.580021 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:49.581728 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:49.574018 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:49.582857 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.585067 10246 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 17: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:49.583210 10290 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:49.595181 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:49.596819 10395 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:49.503075 14683 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 13:16:49.608953 10250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54378 (request call id 940) took 1746 ms (client timeout 1788 ms). Trace:
W20260709 13:16:49.609601 10250 rpcz_store.cc:269] 0709 13:16:47.847094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.847222 (+   128us) service_pool.cc:224] Handling call
0709 13:16:49.593701 (+1746479us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540006e5d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:49.593847 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608304512}
I20260709 13:16:49.611054 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.611828 10322 raft_consensus.cc:2368] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:16:49.614575 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.615680 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.617640 10244 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:49.576346 14535 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.624984 10320 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:49.628054 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:49.578709 14740 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.667361 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:49.587231 14749 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:49.585214 14736 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.679854 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:49.686803 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 72319.9us
W20260709 13:16:49.687704 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 72103.1us
I20260709 13:16:49.689836 10317 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.552488 14771 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:16:49.692137 10324 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:49.610203 14585 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.698513 10242 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:49.699744 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:49.623296 14340 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:49.704355 10241 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:16:49.706218 10144 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 10 to 11, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 11 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.705344 10241 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 9
I20260709 13:16:49.709501 10241 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:49.704684 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.672386 14683 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:49.710388 10241 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:49.539716 10146 rpcz_store.cc:269] 0709 13:16:37.517845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.518101 (+   256us) service_pool.cc:224] Handling call
0709 13:16:40.318375 (+2800274us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a52090 00007f58c3af0f3a 00007f58c98a71cc 00007f58c99a537e 00007f58c7e662a4 00007f58c7e66232 00007f58c7e66161 00007f58c7e660dc 00007f58c7e65392 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:49.538889 (+9220514us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:42.001264 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:42.091864 (+ 90600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:42.091931 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:16:42.091958 (+    27us) tablet.cc:662] Decoding operations
0709 13:16:42.157242 (+ 65284us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:42.196543 (+ 39301us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:42.204368 (+  7825us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:16:42.397065 (+192697us) tablet.cc:701] Row locks acquired
0709 13:16:42.397128 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:16:42.397348 (+   220us) write_op.cc:270] Start()
0709 13:16:42.397530 (+   182us) write_op.cc:276] Timestamp: P: 1783603002397274 usec, L: 0
0709 13:16:42.397562 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:16:42.400040 (+  2478us) log.cc:844] Serialized 10619 byte log entry
0709 13:16:42.706846 (+306806us) op_driver.cc:464] REPLICATION: finished
0709 13:16:43.463286 (+756440us) write_op.cc:301] APPLY: starting
0709 13:16:43.470669 (+  7383us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.883132 (+1412463us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.887663 (+  4531us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:45.925950 (+1038287us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:45.948625 (+ 22675us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 13:16:45.959309 (+ 10684us) write_op.cc:312] APPLY: finished
0709 13:16:46.162109 (+202800us) log.cc:844] Serialized 236 byte log entry
0709 13:16:46.478923 (+316814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.503796 (+ 24873us) write_op.cc:454] Released schema lock
0709 13:16:46.503862 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:46.504318 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.504349 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9958,"reported_tablets":45,"spinlock_wait_cycles":6422066432,"child_traces":[["op",{"apply.queue_time_us":350395,"apply.run_cpu_time_us":107694,"apply.run_wall_time_us":3341559,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117041,"num_ops":27,"prepare.queue_time_us":328876,"prepare.run_cpu_time_us":17798,"prepare.run_wall_time_us":529756,"raft.queue_time_us":48391,"raft.run_cpu_time_us":18142,"raft.run_wall_time_us":269431,"replication_time_us":309107,"thread_start_us":662668,"threads_started":5,"wal-append.queue_time_us":598023,"wal-append.run_cpu_time_us":14507,"wal-append.run_wall_time_us":2291826}]]}
I20260709 13:16:49.718770 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.689193 14428 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:49.695029 14512 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:49.695099 14523 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:49.726845 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:49.726972 10321 raft_consensus.cc:1217] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[8.7-13.9]   Dedup: 8.7->[11.8-13.9]
I20260709 13:16:49.734714 10321 pending_rounds.cc:85] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 7
I20260709 13:16:49.730659 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:49.735432 10321 pending_rounds.cc:107] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:16:49.735800 10321 raft_consensus.cc:2889] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.667797 14535 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:49.715020 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 135843us
I20260709 13:16:49.741008 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:49.741621 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.748978 10393 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:49.752133 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:49.726639 14557 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:49.756910 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:49.748286 14515 consensus_meta.cc:287] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.004s
I20260709 13:16:49.729619 14683 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:49.731381 14768 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:49.725410 14585 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:49.731294 14512 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.703531 14736 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.768651 10245 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:49.769578 10317 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:49.730532 14749 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:16:49.773510 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:49.804118 10393 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.783955 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.815285 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:49.817838 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 208540us
I20260709 13:16:49.754523 14665 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:49.820797 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:49.765695 14537 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.823382 14340 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:49.824193 14788 raft_consensus.cc:2764] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:16:49.824398 14773 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:16:49.825366 14774 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:49.815532 14680 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:49.809561 10144 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:49.761929 14557 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:49.829365 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:49.829797 10396 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:49.831825 10394 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:16:49.832516 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 89813.9us
I20260709 13:16:49.807547 14512 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:49.971134 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 214281us
I20260709 13:16:49.785660 14768 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:49.774044 14471 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:49.825433 10317 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:49.856315 10393 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:49.857738 10994 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:16:49.878026 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.927089 10398 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:49.836301 14538 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:49.930763 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:49.931777 10399 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:49.936805 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:49.837879 14749 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:49.829113 14558 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:49.981964 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 152666us
I20260709 13:16:49.771847 14515 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.983646 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.003887 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:50.004796 10396 raft_consensus.cc:2368] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13.
I20260709 13:16:49.781129 14585 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.013203 14515 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:49.928884 10391 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.014106 14585 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:49.997905 10993 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.020061 14523 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:50.020776 14523 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:50.032933 14599 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:49.997556 14680 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:49.971623 14557 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.008445 14551 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:50.011317 14779 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
W20260709 13:16:50.012108 14783 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:16:50.035490 14750 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:49.996039 14654 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.068951 14654 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:49.989527 14471 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:50.071211 14471 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.071364 14654 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:50.074430 14768 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.083220 14771 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:50.084035 14771 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.063182 14665 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.086803 14665 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:50.087282 14665 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.043046 14535 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:50.043957 10144 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:50.093576 14565 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.004s
I20260709 13:16:50.044960 14736 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:49.969441 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.045286 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:50.094458 10144 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.983230 14428 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:16:50.095517 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 50330.7us
I20260709 13:16:50.095613 14558 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.095939 14428 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.096544 14558 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:50.096254 10144 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 7 to 11, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 11 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.097048 14558 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:49.987046 14788 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.097856 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.097944 14558 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:50.095665 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 126352us
I20260709 13:16:50.106566 14736 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:50.108117 14734 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:50.108673 14474 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:50.109593 14734 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.109759 14474 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:50.046173 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.055891 14762 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.640s	user 0.000s	sys 0.009s
W20260709 13:16:50.052691 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.055757 14751 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:50.047287 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 63708us
I20260709 13:16:50.110159 14734 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.118892 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.119954 14091 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.120152 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:50.120625 14734 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.066470 14551 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.121475 14091 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:50.121858 14534 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:50.122685 14551 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.059578 14680 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.124620 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.127151 14786 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:50.127744 14786 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.110548 14375 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:50.118676 14751 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.129135 14375 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:50.130769 14788 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:50.132354 11001 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:16:50.132834 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.132757 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:50.133469 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:50.132398 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:50.134757 14534 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:50.135030 10994 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:50.135366 14534 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.112912 10243 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.138693 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.138862 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:50.139036 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.139398 10249 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:16:50.139537 10244 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:50.141642 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.142895 10249 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:50.141677 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:50.150916 10324 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:50.155584 10316 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:50.156049 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.129923 14786 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:50.162484 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:50.157500 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.167073 10316 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:50.155601 14504 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:16:50.065924 10993 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:50.098145 14428 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.166551 10999 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:50.163529 14792 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.189002 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.122077 14091 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:50.175941 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.204820 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.205894 10324 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:16:50.177457 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 52905.5us
I20260709 13:16:50.177619 14800 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.155206 14762 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:50.101691 14313 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.986s	user 0.009s	sys 0.000s
W20260709 13:16:50.101733 14784 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.319s	user 0.000s	sys 0.002s
W20260709 13:16:50.147182 14376 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.004s
I20260709 13:16:50.170881 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.211784 10320 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.213328 10965 leader_election.cc:400] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12.
I20260709 13:16:50.213681 10965 leader_election.cc:403] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:16:50.137712 14565 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.214435 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.215843 14565 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.179308 14788 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.216536 14805 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.217087 14740 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12.
I20260709 13:16:50.217584 14790 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.191004 10144 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 5 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 11 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.218068 14790 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.218510 14790 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.219103 10144 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:50.195684 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.188515 14585 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.197033 14523 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.198705 14792 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:50.163555 14534 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:50.199131 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:50.252065 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.200690 14806 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:50.202816 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.262063 10318 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:50.130041 14375 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:50.207736 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.208432 10316 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:50.208786 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.214469 14474 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.225620 10320 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:50.219231 10393 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:50.230500 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 212639us
I20260709 13:16:50.232764 14750 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.260004 10322 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:16:50.275599 10322 pending_rounds.cc:85] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 5
I20260709 13:16:50.275898 10322 pending_rounds.cc:107] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:16:50.276204 10322 raft_consensus.cc:2889] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.847680 14683 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.265942 10249 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:50.217149 14805 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.234473 14313 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.268466 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:50.269033 14471 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.273933 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:50.281962 10319 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:16:50.257678 14792 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:50.286012 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 86992.6us
I20260709 13:16:50.294463 14806 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:50.301239 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:50.303256 14558 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:50.262220 14771 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.283895 14376 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:16:50.271755 14474 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:50.261682 14565 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:16:50.270292 14534 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:50.321111 10397 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:16:50.357184 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.314481 10243 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:50.316522 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.372493 10248 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:50.305884 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.314666 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:50.373476 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 67680us
I20260709 13:16:50.315397 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:50.308871 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:50.374548 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:50.376199 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 67395.6us
I20260709 13:16:50.376902 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:16:50.379825 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.380487 10993 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.381361 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.381981 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.382020 10316 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:50.382664 10321 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.383855 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.384500 10395 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:50.385831 10994 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:50.386451 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.387065 10324 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:50.305140 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68575.5us
I20260709 13:16:50.389423 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 838) took 1076 ms. Trace:
I20260709 13:16:50.391816 10397 rpcz_store.cc:276] 0709 13:16:49.312808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.313000 (+   192us) service_pool.cc:224] Handling call
0709 13:16:49.329451 (+ 16451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:50.371063 (+1041612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.389139 (+ 18076us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540010bb54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:50.389363 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279843712}
I20260709 13:16:50.397517 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:16:50.366941 14537 consensus_meta.cc:287] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.002s
I20260709 13:16:50.410039 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.418677 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.425547 10318 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:50.421202 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:50.422086 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.423107 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:50.391352 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:16:50.436050 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 178968us
I20260709 13:16:50.437222 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.437876 10319 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:50.307405 14504 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:50.439451 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.446862 10999 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:50.320694 14313 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.333853 14762 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.318938 14805 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:50.368984 14471 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.319192 14786 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:50.375427 14474 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.377338 14565 consensus_queue.cc:1243] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:50.356375 14523 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.450997 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.453915 10993 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 7.
I20260709 13:16:50.448542 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.447608 14771 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.523226 14771 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:50.523829 14771 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.329504 14665 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.526300 14814 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.332861 14091 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.449898 14537 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:50.530913 10390 raft_consensus.cc:2368] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:16:50.531833 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.532382 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.530649 10323 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:50.533879 14793 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:50.534824 14793 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:50.535193 14793 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:50.479444 14786 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:50.535964 14786 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.536239 14793 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.542063 14790 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.544955 14790 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:50.545785 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:50.448269 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.387671 14340 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:50.296785 14557 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.309865 14806 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:50.390924 14809 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:50.396418 14736 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.483935 10213 leader_election.cc:400] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13.
I20260709 13:16:50.499271 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:50.499271 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:50.504475 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56011.5us
I20260709 13:16:50.308813 14654 raft_consensus.cc:2764] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:50.345487 14512 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.512379  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:50.512918 14805 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.513561 14313 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:50.465519 14504 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.348662 14792 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.463743 14599 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.464437 14795 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:16:50.546164 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:50.546491 10244 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.580511 10324 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
W20260709 13:16:50.548720 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.555078 10249 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:50.557385 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:50.549144 10399 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:50.568214 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:50.568557 10392 raft_consensus.cc:2368] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11.
I20260709 13:16:50.578001 10996 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.555255 10213 leader_election.cc:403] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:50.537899 14793 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.595263 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:50.593217 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 109434us
W20260709 13:16:50.627281 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 81233.8us
I20260709 13:16:50.628433 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:50.629442 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47726.5us
I20260709 13:16:50.630049 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:50.632441 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.633121 10319 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:50.633720 10322 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.634258 10317 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:50.564152  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:50.640406 10320 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:50.644472 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.648629 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:50.651573 10324 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:50.652473 10321 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:50.625037 14819 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13.
I20260709 13:16:50.554519 14806 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:50.554127 14340 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.555088 14736 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:50.659348 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.661952 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.663545 10244 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:50.565322 14504 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:50.512436 14375 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.653457 10318 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:50.526183 14665 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.567544 14792 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:50.567564 14557 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:50.625234 14762 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:50.685978 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:50.687978 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:50.554926 14809 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:50.689141 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.695444 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.680048 14504 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.691249 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.683754 14736 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.635746 14376 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:50.565709 14680 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:16:50.502785 14800 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 13:16:50.635349 14471 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.707839 10967 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:50.594017 14734 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:16:50.557243 14733 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.206s
I20260709 13:16:50.657524 14797 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.664819 14523 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:50.670799 14340 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.564684 14805 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.718992 10317 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:50.702379 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.669130 14654 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:50.720570 14512 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:50.692230 14762 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.716867 14653 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:50.771870 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:50.775216 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 67472.6us
I20260709 13:16:50.716501 14816 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
W20260709 13:16:50.792622 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 90368.1us
I20260709 13:16:50.795845 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.781694 14790 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.794147 10244 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:50.800911 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.807512 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.789203 14762 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:50.787587 14797 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:50.782230 14313 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:50.823410 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.785739 14768 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:16:50.789870 14653 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:50.805702 14471 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.835268 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:50.843870 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:50.845088 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:50.808313 14810 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.869436 10996 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:50.869663 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.801692 14376 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.811414 14512 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:50.849220 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.874650 10317 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.832441 14750 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.809592 14790 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:50.871754 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.879765 10324 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.880172 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.833375 14788 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:50.835834 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.874641 10395 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:50.877661 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:50.788727 14809 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.802363 14786 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.836123 14653 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:50.885797 10393 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
W20260709 13:16:50.889314 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 53657.2us
I20260709 13:16:50.871589 14731 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:50.892663 10324 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:50.876016 14808 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:50.871381 14428 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:50.832551 14812 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:16:50.841540 14523 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:16:50.895840 10397 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:50.876662 14512 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.898094 10317 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:50.928054 14512 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:50.899206 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 432918us
I20260709 13:16:50.895035 10288 leader_election.cc:400] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11.
I20260709 13:16:50.883257 14788 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.894824 14683 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:50.904747 14751 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.001s
I20260709 13:16:50.891074 14504 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:50.909847 14805 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:50.910084 14786 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:50.916952 14806 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.926932 14808 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:50.931458 10288 leader_election.cc:403] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:16:50.974604 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 83756.3us
I20260709 13:16:50.976533 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.929538 14428 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:50.933177 14375 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:16:50.935982 14825 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:16:50.936729 10997 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:16:50.936864 10996 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:50.996394 10320 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:50.902081 14537 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:16:50.938516 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.938869 14790 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.939826 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:50.940589 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.941524 10999 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.942364 14797 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:50.944927 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:50.946738 10393 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:50.946514 14821 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:50.947610 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:50.949146 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:50.950839 14340 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:50.952499 14788 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.963730 14814 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:50.969996 10325 raft_consensus.cc:2410] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:50.902415 14731 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:50.977475 10324 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 17: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:50.977802 10317 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:51.017828 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.018743 10317 raft_consensus.cc:2368] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12.
I20260709 13:16:51.019629 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.907681 10321 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:50.978515 10316 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.995417 10288 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.021654 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.022701 10316 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:51.023604 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:50.997377 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.025098 10320 raft_consensus.cc:2393] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:51.026645 10320 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [8.7-12.9]
I20260709 13:16:50.936944 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:51.027961 11002 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:50.968250 14683 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:51.003402 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:50.994655 14786 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.003759 10394 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:51.004532 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.004993 10994 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.009193 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:50.978570 14474 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.035552 14683 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:51.037298 14474 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.037678 14821 consensus_queue.cc:1243] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:51.038257 10995 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.012061 10250 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:16:51.038854 10250 pending_rounds.cc:85] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:51.039206 10250 pending_rounds.cc:107] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:51.039551 10250 raft_consensus.cc:2889] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.035604 10398 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.040434 10248 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:51.040822 10248 pending_rounds.cc:85] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:16:51.041118 10248 pending_rounds.cc:107] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:51.041414 10248 raft_consensus.cc:2889] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:50.994542 14504 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11.
I20260709 13:16:51.044946 10317 raft_consensus.cc:2368] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
I20260709 13:16:51.024339 10316 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.029371 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.003667 10390 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:51.014214 10249 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:16:51.047972 10249 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:51.048336 10249 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.049317 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:51.044443 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 96926us
I20260709 13:16:51.050002 10247 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.043294 10245 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:16:51.050280 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.057369 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.064519 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.071744 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:51.065935 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.032675 14565 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.015465 14728 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.077085 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.081959 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:51.082732 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.078083 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:51.083416 10996 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:51.008642 14471 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 13:16:51.097882 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 209152us
I20260709 13:16:51.098752 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.101609 10999 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:51.079129 14821 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.079298 14750 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:51.065128 14828 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:51.082756 14751 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.115305 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:51.145267 14821 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.146476 10999 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.146828 14750 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.148425 14821 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:51.149789 14731 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.046931 14786 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.137486 10316 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
W20260709 13:16:51.154106 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 91301.3us
I20260709 13:16:51.080470 14792 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.138530 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:51.110810 14375 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.111526 14740 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.116416 14343 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.137995 14828 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:51.156176 14771 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.002s
I20260709 13:16:51.086762 14565 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.089038 14728 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.205871 10996 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:16:51.174464 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 75798us
W20260709 13:16:51.187398 10325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 735) took 1838 ms (client timeout 2211 ms). Trace:
I20260709 13:16:51.163293 14375 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.158732 14834 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:51.156006 14805 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:51.196549 10213 leader_election.cc:400] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:16:51.167301 14343 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.212827 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.155522 14653 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.214346 10213 leader_election.cc:403] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.221594 10996 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:51.209960 14806 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.226070 14565 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.111735 14428 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.214684 14375 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.169102 14828 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:51.225611 14537 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:51.207525 10325 rpcz_store.cc:269] 0709 13:16:49.348500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.353827 (+  5327us) service_pool.cc:224] Handling call
0709 13:16:51.187135 (+1833308us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54002be154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:51.187281 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3711426432}
I20260709 13:16:51.097918 14808 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.236793 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:51.172179 14771 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.271242 10319 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:51.209668 14751 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:16:51.233345 14599 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:16:51.278368 10392 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.277642 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:51.234056 14805 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:51.211863 14837 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:16:51.296253 14805 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:51.297081 14842 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:51.292800 14340 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:51.298929 14841 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:51.305770 10247 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:51.236636 14680 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:16:51.308633 10243 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.239454 14793 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 13:16:51.290748 14840 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:16:51.283051 14831 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:51.283080 14762 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.270815 14838 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:16:51.318150 14762 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.319625 14788 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.313267 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.335141 10398 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:51.306500 14843 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.339424 10994 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:51.308564 14340 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:51.311743 14816 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:51.341866 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 259961us
I20260709 13:16:51.364229 14833 consensus_queue.cc:1059] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:16:51.367214 14831 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:51.391052 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:51.391121 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 77046.8us
I20260709 13:16:51.396991 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:51.397920 10994 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.379971 14816 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:51.417814 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:51.378973 14793 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:51.409004 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:51.418556 10996 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:51.408624 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.426060 11002 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
W20260709 13:16:51.402402 14832 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:16:51.422963 10997 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:51.380880 14340 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.406000 14812 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.366878 14843 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.447623 14831 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.435478 14343 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.442893 14821 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:51.451001 14846 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:16:51.446075 10994 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:51.453308 10319 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:16:51.455758 10395 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:51.456259 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47774.9us
I20260709 13:16:51.461342 10965 leader_election.cc:400] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12.
I20260709 13:16:51.428433 14665 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:16:51.468268 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 60063.5us
I20260709 13:16:51.469763 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.430642 14814 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:16:51.477267 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.483837 10324 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:51.485138 10324 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.485390 10321 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:51.486115 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:51.486596 10321 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.488792 10324 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:51.490588 14814 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:51.491047 14814 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:51.491997 14814 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.493108 10322 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:16:51.494854 14850 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:51.497380 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.498642 10213 leader_election.cc:400] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:16:51.499862 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.436165 14852 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:51.493409 14814 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.504369 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:51.501214 14740 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.510906 14816 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.517782 10323 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:51.478621 14843 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.479956 14792 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.488299 14771 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:51.473405 14821 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:16:51.516940 14847 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:16:51.496234 14788 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.474429 14790 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:16:51.506865 14793 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.504631 14833 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.542980 14792 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:51.543686 14771 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:51.543258 14852 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:51.542183 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44894.6us
I20260709 13:16:51.550781 14790 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.551335 14790 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:51.552289 14790 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.553668 14790 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.544137 14771 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.562433 14812 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.578619 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.575739 14771 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:51.546119 14863 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:16:51.592491 14859 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:16:51.592752 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.592945 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:51.598654 10323 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:51.596113 10965 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 2.211s (SENT)
I20260709 13:16:51.581629 14585 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.599805 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:51.544648 14833 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:51.607496 14512 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.004s
I20260709 13:16:51.608161 14512 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.608973 14833 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:51.609841 10399 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:51.610566 14343 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.611120 14343 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.613466 14343 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.610553 14793 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.614651 14793 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:51.615518 14793 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.616484 14793 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.617331 14375 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.585862 14654 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:51.618505 14819 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:51.619150 14819 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:51.620471 14819 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.618530 14654 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.625046 14654 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.619216 14340 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.625128 14843 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:51.608973 14728 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.635805 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:51.636480 10993 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.621918 14819 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.641348 14788 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:51.644094 14851 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.441s	user 0.003s	sys 0.000s
W20260709 13:16:51.644251 14736 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.915s	user 0.010s	sys 0.001s
W20260709 13:16:51.645573 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49502us
I20260709 13:16:51.646191 14786 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:51.651714 14683 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.002s
I20260709 13:16:51.654922 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.659385 14788 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:51.656853 14585 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.657377 14474 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:51.657611 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.660763 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.667201 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.667586 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.677847 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.678393 11002 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:51.696506 10241 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:51.700135 10997 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:51.698069 10243 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:51.702389 14865 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:51.688388 14474 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:51.703277 10323 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:51.703523 14768 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.704774 10993 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:16:51.709435 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.688755 14788 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:51.714071 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 189346us
I20260709 13:16:51.701260 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:51.679368 14736 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.675740 14828 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.722690 10290 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:51.713927 14728 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:51.725240  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:51.696578 14683 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.726643 10323 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:51.726694 10290 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:51.719926 14340 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:51.727943 14654 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:51.750487 14654 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.751031 14654 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:51.751971 14736 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.723569 14512 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.756029 14771 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.756629 14512 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:51.757436 14808 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:51.712124 14768 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.758483 14343 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.758996 14343 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.722136 14599 raft_consensus.cc:3055] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.763875 10397 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:51.760161 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.758040 14808 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.766602 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:51.767264 10319 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:51.760161 10391 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.751523 14788 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.762918 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.757275 14512 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.724944 14740 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.764328 10242 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:51.764744 10999 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:51.761201 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.769753 10324 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:51.709313 14865 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.770593 14728 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:51.770730 14787 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.771184 14375 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.771407 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:51.773521 14808 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.777336 10393 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:16:51.764216 14599 raft_consensus.cc:740] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:51.810539 11000 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:51.778537 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.778846 10396 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:51.773944 14734 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:51.730020 14751 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:51.803516 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 87201.6us
W20260709 13:16:51.804489 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.807418 10390 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:51.808816 10398 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 13:16:51.770610 14871 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:51.775507 14680 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.778203 14750 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.827775 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49346.2us
I20260709 13:16:51.838371 14788 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.839938 14665 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:51.782641 14843 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:51.810369 14787 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:51.842351 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.846130 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.845278 14879 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:16:51.827013 14734 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.853569 14874 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:16:51.849771 14793 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:16:51.854450 14734 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:51.840725 14865 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:51.856377 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:51.835260 14816 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:16:51.826942 14751 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.861930 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.826475 14814 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:51.834381 14821 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.842314 14831 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:51.861897 14787 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.831619 14680 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.843647 14872 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:51.934510 14771 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:51.931420 14880 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:16:51.940059 14877 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
W20260709 13:16:51.942530 14873 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:16:51.943015 14828 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.862449 14585 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:16:51.834601 14750 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.877332 14814 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.948323 14872 consensus_queue.cc:1243] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:51.948923 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 847) took 1002 ms. Trace:
I20260709 13:16:51.949821 14844 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.951331 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:51.960767 10395 rpcz_store.cc:276] 0709 13:16:50.946605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.946753 (+   148us) service_pool.cc:224] Handling call
0709 13:16:50.947029 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.458269 (+511240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.948678 (+490409us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54001aa754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:51.948853 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169520384}
I20260709 13:16:51.951817 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.952487 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.953007 14835 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.813874 14474 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.971724 14474 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:51.884559 14831 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:51.962168 14844 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:51.972945 14844 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.973726 14831 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:51.973969 14844 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:51.978626 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.979547 14878 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:51.982031 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2333) took 1133 ms. Trace:
I20260709 13:16:51.970005 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.946569 14820 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:51.970556 14835 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:51.971108 10248 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:16:52.000494 10248 pending_rounds.cc:85] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:16:52.000816 10248 pending_rounds.cc:107] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:52.001096 10248 raft_consensus.cc:2889] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.966650 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:51.946331 14471 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.931056 14768 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:51.984778 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.996086 10392 rpcz_store.cc:276] 0709 13:16:50.848666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.848961 (+   295us) service_pool.cc:224] Handling call
0709 13:16:50.878079 (+ 29118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.291323 (+413244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.981762 (+690439us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54000109d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:51.981951 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920042752}
I20260709 13:16:51.969827 14680 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.013455 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.021540 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.023367 10250 raft_consensus.cc:2410] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:16:52.019857 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53320us
I20260709 13:16:52.025789 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:52.025866 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:51.946720 14599 consensus_queue.cc:260] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:52.026247 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 265097us
I20260709 13:16:52.000988 14762 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:52.007575 14872 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:52.006336 14343 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:51.885622 14728 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.017123 14585 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.023765 14808 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:52.057687 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.023715 14340 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:16:52.080405 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 240860us
I20260709 13:16:52.037101 14821 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:52.112411 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:52.019243 14820 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.060276 14599 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.121028 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:52.058434 14762 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:52.129889 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.132995 10244 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:16:52.133438 10244 pending_rounds.cc:85] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:52.133684 10244 pending_rounds.cc:107] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:16:52.133916 10244 raft_consensus.cc:2889] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:52.043247 14872 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:52.044600 14809 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:16:52.059774 14471 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:16:52.085210 14343 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:16:52.125348 14828 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.113927 14831 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:16:52.149205 14809 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:52.142329 14885 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:16:52.140193 14376 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:16:52.149930 14820 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.086006 14585 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.113665 14819 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:16:52.136859 14859 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:52.200358 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.147156 14512 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:52.143653 14821 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.189795 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 156087us
I20260709 13:16:52.215953 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.216660 10998 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:52.219285 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:52.219973 10397 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:52.219316 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:52.220820 11001 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:52.187750 14809 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:52.202296 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 160956us
W20260709 13:16:52.181632 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 60702.2us
W20260709 13:16:52.223006 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 196362us
I20260709 13:16:52.223923 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:52.225208 10321 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:52.258661 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:52.265712 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.266485 10392 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:52.269654 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.268620 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:52.270262 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:52.271263 10318 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [8.7-12.9]
I20260709 13:16:52.271916 10399 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:52.275152 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:52.275779 10325 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:52.198643 14894 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.277926 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:52.188982 14828 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.279518 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.190119 14887 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:16:52.283504 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:52.190461 14340 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.290189 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.290406 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:52.291417 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.292064 11000 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:52.292362 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.282788 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:51.983493 14812 consensus_queue.cc:1175] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73825599c2644b898cebaafbccd86e99" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [10.8-12.9]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:52.272835 14847 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:16:52.289443 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.334194 10993 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:52.334910 10319 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:52.283747 14891 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:16:52.337435 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.339610 10397 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
W20260709 13:16:52.345136 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 74970.7us
I20260709 13:16:52.347826 10993 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.280411 14888 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.287197 14736 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.351881 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.222594 14821 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.355329 10319 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:52.362015 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:52.363236 10993 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:52.294622 14471 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.368255 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.368970 10320 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:52.369037 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.369755 10243 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:52.370568 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.294080 14808 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:52.369064 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.341102 14899 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.386373 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.387305 10319 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:52.231421 14762 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.366029 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:52.379572 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.381029 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.399264 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.389112 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.396256 10325 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:16:52.355957 14736 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.364696 14833 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.231524 14872 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:52.390360 14881 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.532s	user 0.003s	sys 0.000s
W20260709 13:16:52.368273 14884 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:16:52.431855 11000 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:52.433475 10243 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:52.397119 14788 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.416123 14736 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.425479 14768 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.391112 14471 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.424139 14750 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.361100 14888 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.429936 14844 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:52.477451 14844 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.450977 14788 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.468717 14907 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:52.470703 14585 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:52.471212 14896 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:52.473781 14888 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.474494 10321 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:52.476353 11002 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:16:52.466369 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.515219 10322 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:52.483749 14808 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.479501 14901 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.480167 14909 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.385563 14809 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.435097 14894 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:16:52.459683 14819 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:16:52.488598 14835 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.403120 14899 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.487488 14833 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:16:52.535223 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.460528 14768 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.493818 11001 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:52.538769 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2433) took 1054 ms. Trace:
I20260709 13:16:52.542922 10324 rpcz_store.cc:276] 0709 13:16:51.484731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.489589 (+  4858us) service_pool.cc:224] Handling call
0709 13:16:51.517531 (+ 27942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.780724 (+263193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.538451 (+757727us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54002df354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:52.538686 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579577728}
I20260709 13:16:52.537096 14821 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:52.544282 14828 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.526968 14901 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.560693 14833 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.570794 14833 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.571777 14833 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:52.573766 14904 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:16:52.590673 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 244064us
W20260709 13:16:52.595434 14654 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.002s
I20260709 13:16:52.614712 14471 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.619014 14899 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:52.620725 14915 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:52.609429 14909 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:16:52.625164 14654 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.626303 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:52.627141 10322 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:52.627526 14474 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.000s
I20260709 13:16:52.627588 14654 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.628525 14751 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:52.628904 14920 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:52.629088 14768 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:52.601714 14653 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.603121 14788 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.632990 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.633736 10993 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
W20260709 13:16:52.633910 14599 consensus_meta.cc:287] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.003s
I20260709 13:16:52.635993 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:52.626508 14787 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.004s
I20260709 13:16:52.636644 10998 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:52.638928 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.639906 10318 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:16:52.638821 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:52.648581 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.649118 10325 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:52.648178 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.639907 10993 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:16:52.650414 10318 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:52.651535 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.652240 10997 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:52.652856 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:52.653884 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:52.654757 10998 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:52.656030 10319 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:52.659139 10324 raft_consensus.cc:1240] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.611203 14833 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:52.658257 14793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.003s	sys 0.002s
W20260709 13:16:52.661846 14793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.003s	sys 0.002s
I20260709 13:16:52.662828 14843 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.665330 14792 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:52.666460 14863 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:52.666894 14863 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.661132 10288 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:52.661067 14599 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.641148 14653 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.675757 14653 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.665927 14792 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:52.678426 14792 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.680050 14792 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:52.680914 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.673439 14736 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.659683 14654 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.683869 14654 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.684226 14654 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.684433 14736 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.678040 14653 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.674759 14599 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.688298 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.688736 14599 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.693523 14844 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:52.689114 10250 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:52.699697 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.700428 10248 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:16:52.698863 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:52.710127 10967 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:52.723596 14863 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.724953 14863 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:52.726788 14922 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:16:52.728108 14869 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.728735 14869 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.729220 14869 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:52.733477 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.735205 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.708575 14874 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:52.738651 14874 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:52.739090 14874 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.742403 14819 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:52.743427 14901 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:52.747833 10998 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:52.704216 14376 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:52.756894 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.651396 14787 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.773068 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:52.763443 14751 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.762912 14819 consensus_queue.cc:1243] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:52.765678 14340 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.763113 14793 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:16:52.771497 14653 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.767387 14907 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:16:52.784317 14888 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.817456 14869 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.806505 14889 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:52.807344 14787 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.789572 14471 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.821625 14816 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.824332 14810 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.825194 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.788733 14927 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:16:52.826977 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.831808 14653 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.862353 14471 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.824363 14654 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.864203 14653 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.865036 14800 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:52.805315 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:52.842522 14786 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:16:52.866345 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 61173.1us
I20260709 13:16:52.867463 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.867765 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:52.784639 14843 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:52.865228 14907 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:52.869042 14907 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.868966 14843 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.870119 14907 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.870756 14927 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:52.871281 14927 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.848747 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:52.871709 14843 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.872001 10392 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:52.789269 14751 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.850267 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.826052 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.871428 14907 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:52.874454 14751 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.851619 14810 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:52.848778 14816 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.851963 10398 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:52.871711 14927 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:52.877321 14816 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.877262 14810 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.878612 14816 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.878957 14810 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.865875 14654 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:52.858022 14928 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:52.886366 10320 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:52.856251 10397 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:16:52.845423 14888 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.858292 14869 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.859229 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:52.888609 10248 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.848681 14879 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:52.890442 14879 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.891408 14879 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.892848 14879 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:52.796703 14340 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.889959 14888 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.895219 14800 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.870648 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:52.896669 11000 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.896243 14800 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.897696 14800 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:52.861984 14875 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.000s	sys 0.011s
W20260709 13:16:52.902482 14875 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.000s	sys 0.011s
I20260709 13:16:52.896271 14340 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.904244 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:52.906248 14895 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.527s	user 0.003s	sys 0.000s
I20260709 13:16:52.907922 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2740) took 1151 ms. Trace:
I20260709 13:16:52.908320 10245 rpcz_store.cc:276] 0709 13:16:51.756711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.758327 (+  1616us) service_pool.cc:224] Handling call
0709 13:16:51.758635 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.758991 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:51.759020 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.759470 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.125772 (+366302us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:52.125904 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.126104 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.905520 (+779416us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:52.907634 (+  2114us) raft_consensus.cc:1685] finished
0709 13:16:52.907654 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.907862 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7161,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":28516,"spinlock_wait_cycles":29789440,"thread_start_us":365704,"threads_started":1,"wal-append.queue_time_us":517438}
W20260709 13:16:52.915575 14903 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.459s	user 0.000s	sys 0.006s
I20260709 13:16:52.917222 14376 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.919239 14872 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:52.922776 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2747) took 1081 ms. Trace:
I20260709 13:16:52.923321 10247 rpcz_store.cc:276] 0709 13:16:51.841275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.841423 (+   148us) service_pool.cc:224] Handling call
0709 13:16:51.841783 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.034592 (+192809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.034637 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.039845 (+  5208us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.295159 (+255314us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:52.295193 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.295261 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:52.914680 (+619419us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:52.922327 (+  7647us) raft_consensus.cc:1685] finished
0709 13:16:52.922360 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.922680 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2567,"raft.queue_time_us":40632,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":44001,"spinlock_wait_cycles":34932992,"thread_start_us":358547,"threads_started":2,"wal-append.queue_time_us":271238}
I20260709 13:16:52.929001 10398 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:52.930191 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.930606 10396 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:52.935194 14683 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:52.935463 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:52.936384 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.921059 11000 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:52.942274 10318 raft_consensus.cc:1240] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.942605 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:52.936291 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 934) took 1998 ms. Trace:
I20260709 13:16:52.948655 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.949239 14680 consensus_queue.cc:1059] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:52.950186 14680 raft_consensus.cc:3055] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.950629 14680 raft_consensus.cc:740] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.951591 14680 consensus_queue.cc:260] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.951918 14844 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:52.952806 14680 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.952128 10246 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.957008 10246 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:52.957557 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.945804 10999 rpcz_store.cc:276] 0709 13:16:50.942431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.147317 (+204886us) service_pool.cc:224] Handling call
0709 13:16:51.147615 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.780028 (+632413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.936094 (+1156066us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400660154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:52.936242 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418682240}
I20260709 13:16:52.960430 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:52.953728 10248 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:52.955796 10396 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:52.963887 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.968861 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.957935 10246 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:52.976052 10246 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.979640 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:52.980146 10394 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:52.865422 14471 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:52.897154 14874 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.983438 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:52.999866 10393 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:52.983960 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.986327 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:52.972096 14653 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.003566 14653 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.987382 10398 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:52.987911 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:53.006917 10394 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:53.007200 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:53.008074 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:53.009246 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:53.009676 10250 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:53.011158 10250 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:53.011503 10250 pending_rounds.cc:85] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:16:53.011737 10250 pending_rounds.cc:107] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:53.012001 10250 raft_consensus.cc:2889] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:52.988499 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:52.990406 14869 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.013264 14343 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:53.013151 14869 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:52.953329 14683 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:53.013774 14343 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.015116 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:53.016276 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.017225 10967 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:53.020948 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.022574 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:53.023561 10396 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:53.026414 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.027263 10248 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:53.031912 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:53.030494 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:53.032781 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.006068 14653 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:53.038123 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.539s (SENT) [suppressed 14 similar messages]
W20260709 13:16:53.068500 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.024467 14343 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.066202 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:53.069788 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.069854 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.070397 10396 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:16:53.068321 10245 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:16:53.074898 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.073908 10999 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:53.026060 14375 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:53.025436 14808 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:53.082731 10246 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:16:53.085789 10246 pending_rounds.cc:85] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:16:53.086189 10246 pending_rounds.cc:107] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:52.981722 14927 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.076663 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:53.086506 10246 raft_consensus.cc:2889] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.087563 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2751) took 1076 ms. Trace:
I20260709 13:16:53.087975 10246 rpcz_store.cc:276] 0709 13:16:52.011239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.011433 (+   194us) service_pool.cc:224] Handling call
0709 13:16:52.011844 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.952022 (+940178us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54004a1120. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5fdc0 00007f58c3aea1c0 00007f58c3aeb231 00007f58c3ae7d8f 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c
0709 13:16:53.087221 (+135199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.087478 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500026624}
I20260709 13:16:53.024447 14683 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.068148 14376 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:53.103996 10393 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:16:53.096334 14771 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:16:53.084897 14653 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.044497 14923 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:16:53.069334 14902 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:53.119877 14683 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.162487 14927 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.134686 14653 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.124266 14768 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.109221 14810 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:53.131278 14869 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.169983 14653 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:53.134068 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.095857 14375 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:53.112691 14376 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.110005 14885 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:53.157065 14889 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:53.157510 14923 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.157593 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.179136 10996 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:16:53.178774 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 140691us
I20260709 13:16:53.247545 10246 raft_consensus.cc:2410] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:16:53.248538 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.132725 14874 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:53.251343 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 155937us
I20260709 13:16:53.207985 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.253440 10999 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:16:53.219688 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.132035 14343 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.290045 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 915) took 1012 ms. Trace:
W20260709 13:16:53.250280 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.250162 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:53.270691 10322 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:53.341253 10324 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.184178 10392 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:53.342693 10397 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:53.178866 14313 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:16:53.239432 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:53.344496 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 269645us
I20260709 13:16:53.271684 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.185148 14810 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:53.202757 14728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.016s	sys 0.015s
W20260709 13:16:53.288949 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.247783 14923 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:53.343753 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.290547 14910 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.263193 14939 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:16:53.348954 14888 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:53.279506 14938 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:53.256628 14808 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:53.344390 10996 rpcz_store.cc:276] 0709 13:16:52.277655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.278997 (+  1342us) service_pool.cc:224] Handling call
0709 13:16:53.289748 (+1010751us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b54003cd054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:53.289954 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041685888}
W20260709 13:16:53.357481 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 85926us
I20260709 13:16:53.358522 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.371800 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.360948 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.345650 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.373176 10241 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:53.374382 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.339576 14792 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.271039 14914 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.264842 14814 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:53.376741 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.375866 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:53.359370 14921 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.750s	user 0.004s	sys 0.000s
W20260709 13:16:53.351159 14728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.016s	sys 0.015s
I20260709 13:16:53.247180 14885 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.286216 14831 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.253576 14889 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:53.384120 14946 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:53.386050 14956 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.386615 14792 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.386849 14762 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:53.283090 14375 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.455418 14810 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:53.392174 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.457661 14945 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:16:53.434366 14944 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:53.395313 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.459261 14471 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.459821 14471 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:53.460279 14471 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.396001 14888 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:53.463274 14888 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.402971 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:53.466432 10241 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:53.469508 14879 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.004s
W20260709 13:16:53.429211 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.470702 10247 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:16:53.472051 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 994) took 1104 ms. Trace:
I20260709 13:16:53.472445 10995 rpcz_store.cc:276] 0709 13:16:52.367323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.400843 (+ 33520us) service_pool.cc:224] Handling call
0709 13:16:52.428126 (+ 27283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.428676 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.428715 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.429343 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.549828 (+120485us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:52.549875 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.549946 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.292307 (+742361us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:53.471752 (+179445us) raft_consensus.cc:1685] finished
0709 13:16:53.471772 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.471992 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1827,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8766,"spinlock_wait_cycles":61316480,"thread_start_us":116528,"threads_started":1,"wal-append.queue_time_us":134855}
W20260709 13:16:53.474741 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.402642 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1852) took 1751 ms. Trace:
I20260709 13:16:53.476888 10318 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:53.478152 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.477131 10249 rpcz_store.cc:276] 0709 13:16:51.650954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.658502 (+  7548us) service_pool.cc:224] Handling call
0709 13:16:52.800565 (+1142063us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800002a98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:16:52.800795 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.807170 (+  6375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.807207 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.807719 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.025077 (+217358us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:53.025124 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.025188 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.388873 (+363685us) raft_consensus.cc:1685] finished
0709 13:16:53.388896 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.402559 (+ 13663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29131,"raft.queue_time_us":44197,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":9634,"spinlock_wait_cycles":3813632,"thread_start_us":216851,"threads_started":1,"wal-append.queue_time_us":289469}
I20260709 13:16:53.479199 10319 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:53.435724 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 59983.3us
I20260709 13:16:53.440096 14889 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:53.442847 14808 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.452188 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.453126 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:53.400118 14831 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:53.432343 14939 log.cc:927] Time spent T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:53.504115 14831 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.505534 14831 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:53.488054 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.507053 14376 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.490664 10241 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:53.498533 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.509076 10319 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.509933 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.499389 14879 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:53.510857 14879 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.510169 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:53.512780 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.513600 10316 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:53.513887 10321 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:53.512893 14879 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.487517 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:53.515362 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:53.515614 14885 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:53.516407 14810 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:53.436179 14923 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.516884 14810 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:53.517334 14810 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:53.369972 14910 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.518857 14859 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:53.519333 14859 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.519409 14910 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.521165 14792 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.522117 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.522781 10248 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:53.522876 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.523734 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.524152 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.524748 10245 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:16:53.525918 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.526328 14929 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:53.526252 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:53.526921 14929 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:53.527900 14929 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.528913 14929 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.529983 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:53.525930 10245 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:53.533310 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:53.537050 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.542546 10324 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:53.560395 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:53.561549 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.562849 10316 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:53.563112 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.542343 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:53.537710 10965 connection.cc:256] RPC call timeout handler was delayed by -1.416324904999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
I20260709 13:16:53.571827 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.573237 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:53.574851 10993 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:53.574863 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:53.575860 10994 raft_consensus.cc:2376] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17. Re-sending same reply.
I20260709 13:16:53.576363 10998 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:53.575274 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.573987 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.574736 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:53.580904 11001 raft_consensus.cc:2376] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11. Re-sending same reply.
I20260709 13:16:53.581831 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.583361 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:53.555536 14885 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:53.590179 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.568508 14504 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.575224 14728 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:53.532335 14953 consensus_queue.cc:1175] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:53.582969 14889 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.581389 14792 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:53.594218 14885 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:53.598759 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.599356 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.589514 14887 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:53.575595 14910 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:16:53.612882 10997 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:53.585800 14814 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:16:53.597195 14951 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:53.623534 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.612103 14750 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.613632 14885 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.627156 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.626312 10965 leader_election.cc:400] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
I20260709 13:16:53.635308 10965 leader_election.cc:403] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.614629 14512 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.638314 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.634568 14750 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.642915 14750 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.640316 14918 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:53.646361 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.640201 14874 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8.
I20260709 13:16:53.649658 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.610216 14792 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.622301 14951 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.688076 14951 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:53.688421 14792 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.656985 14859 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.692301 14810 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.652181 14585 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:53.696980 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47443.2us
I20260709 13:16:53.701287 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.707046 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.704430 14872 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.707401 14874 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.711287 14869 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:53.724136 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.704011 14792 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:16:53.730947 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 162993us
W20260709 13:16:53.732657 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 172343us
I20260709 13:16:53.733137 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:53.725729 14872 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:53.734432 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.756268 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 979) took 1662 ms. Trace:
I20260709 13:16:53.806919 14814 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.807245 10243 rpcz_store.cc:276] 0709 13:16:52.094385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.402384 (+307999us) service_pool.cc:224] Handling call
0709 13:16:52.426443 (+ 24059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.433948 (+  7505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.755924 (+1321976us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b54000baed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:53.756182 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15296384}
I20260709 13:16:53.807612 14814 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:53.809005 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 74665us
I20260709 13:16:53.814007 10290 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:53.824002 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.810065 14814 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:53.768838 10998 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:53.814196 14918 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:53.816285 14941 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.660s	user 0.000s	sys 0.003s
I20260709 13:16:53.751608 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:53.818893 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.767724 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:53.779153 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:16:53.831822 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 232519us
I20260709 13:16:53.851388 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.851866 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:53.853760 10997 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:53.705703 14375 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.752379 14504 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:53.863933 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.772056 14874 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.819224 14728 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:53.860296 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.854126 14734 raft_consensus.cc:2764] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:16:53.881110 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.820329 14792 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:53.733942 14869 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:53.852813 14918 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.779134 14810 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:53.883728 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.860034 14805 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.895085 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.857781 14964 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.896297 14734 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.913130 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:53.903719 14951 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.899158 14504 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.900065 14894 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:53.922310 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:53.920400 14805 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:53.879616 14375 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.897344 14969 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.903256 14953 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:53.924654 14808 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:16:53.924139 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 110219us
W20260709 13:16:53.925735 14959 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:16:53.905957 14925 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:16:53.914323 14376 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:53.898854 14792 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.929332 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:53.882606 14874 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:53.959668 14874 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.955778 14375 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.924180 14955 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:53.961436 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:53.937701 14961 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:16:53.962935 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 211452us
I20260709 13:16:53.927685 14805 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.981390 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:53.930009 14902 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.987403 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:53.961295 14963 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:16:53.959668 14792 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:53.962136 14955 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:53.930248 14313 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:16:53.973290 14969 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:53.985180 14504 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:54.004281 14969 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.004370 14504 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.005125 14504 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.008769 14750 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:53.917698 14872 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.005007 14969 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:54.010099 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.991326 14805 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.926183 14894 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:54.017637 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 90886.7us
I20260709 13:16:54.019469 10241 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:54.021762 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:53.929157 14728 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.027835 14894 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:54.033967 14471 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.006s
I20260709 13:16:54.031030 14918 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.034488 14471 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.002090 14955 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.037217 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:54.039177 10243 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:16:54.039740 10243 pending_rounds.cc:85] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:16:54.040036 10243 pending_rounds.cc:107] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:16:54.040374 10243 raft_consensus.cc:2889] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.962296 14869 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.056170 14831 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 13:16:54.017217 14977 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:54.057056 14977 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.050096 10243 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:16:54.058568 10243 pending_rounds.cc:85] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 10
I20260709 13:16:54.058830 10243 pending_rounds.cc:107] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:16:54.059065 10243 raft_consensus.cc:2889] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:54.059285 14977 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.015056 14976 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:16:54.060303 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.025930 14964 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.061260 14964 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:54.062247 14964 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.063510 14750 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.065018 14980 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:54.051133 14918 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:54.051811 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2450) took 1110 ms. Trace:
I20260709 13:16:54.077041 10320 rpcz_store.cc:276] 0709 13:16:52.941401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.941548 (+   147us) service_pool.cc:224] Handling call
0709 13:16:52.942001 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:52.953612 (+ 11611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.953642 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:52.954069 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.692063 (+737994us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18004442e0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:53.911508 (+219445us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:53.911549 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.911616 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.051519 (+139903us) raft_consensus.cc:1685] finished
0709 13:16:54.051538 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.051749 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11078,"raft.queue_time_us":11301,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9034,"spinlock_wait_cycles":5458176,"thread_start_us":219264,"threads_started":1,"wal-append.queue_time_us":1057840}
I20260709 13:16:54.065418 14970 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.079654 14970 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.081905 14970 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:54.053036 14971 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:16:54.053646 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:54.054026 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.054512 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.083036 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:54.086620 14792 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:54.090441 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:54.090488 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:54.098819 14313 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:54.109117 14885 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.135571 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52613.5us
W20260709 13:16:54.110651 14973 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:54.111398 14471 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:54.155942 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 168618us
I20260709 13:16:54.114960 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:54.156981 10243 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:54.157182 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:54.119437 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2768) took 1115 ms. Trace:
I20260709 13:16:54.157943 10247 rpcz_store.cc:276] 0709 13:16:53.004033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.020639 (+ 16606us) service_pool.cc:224] Handling call
0709 13:16:54.119228 (+1098589us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540043e4d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:54.119370 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031371648}
I20260709 13:16:54.052755 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:54.135352 14313 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:54.141736 14805 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.167093 14313 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.168044 14888 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:54.168558 14313 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.168892 10396 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:54.168744 14888 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.169373 14888 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.134759 14792 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.171440 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.172474 14792 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.144464 14925 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:54.152365 14808 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:54.113391 14859 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.168179 14805 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:54.142829 14885 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.178825 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:54.203790 10999 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:54.190420 14835 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:54.189836 14537 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:16:54.185997 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:54.207042 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:54.209396 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:54.227731 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:54.229236 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:54.229918 10320 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:54.213231 10998 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.210306 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:54.231410 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:54.232067 10316 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:54.122387 14504 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.237452 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:54.240779 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:54.238257 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:54.242870 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:54.243510 14792 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:54.243541 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:54.243988 14792 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.244139 14983 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.244453 14792 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:54.244729 14375 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:54.244696 14983 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.245349 14375 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.245765 14375 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.247210 14983 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.247781 14983 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.248286 14983 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.250455 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.250607 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:54.176826 14831 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.251343 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:54.211982 14750 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.139816 14970 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:16:54.254280 10324 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:54.241753 10316 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:54.205965 14340 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.214075 10999 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:54.266505 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.266522 10316 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:54.256523 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:54.260805 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.241714 10246 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:54.276275 10998 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:54.235526 14918 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:54.227272 14859 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.227386 14471 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.226311 14814 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.238981 14952 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.265117 14750 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.283818 14808 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:54.280809 14340 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.290211 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:54.290819 10322 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:54.298069 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:54.290601 14859 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.285943 10999 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:16:54.291736 10317 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:54.239488 14955 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.304297 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:54.283499 14918 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.298398 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:54.319383 10322 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:54.305469 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:54.308755 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:54.263126 14831 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.291299 14471 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:54.322541 10247 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:54.309326 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:54.293406 14983 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.295162 14808 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:54.376693 10398 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:54.314702 14934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.154s	user 0.013s	sys 0.007s
I20260709 13:16:54.299558 14953 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:54.323474 14918 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.294047 14814 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.399444 14934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.013s	sys 0.008s
I20260709 13:16:54.383119 14683 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.398525 14964 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:54.457486 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.470464 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.476945 10390 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:54.452673 14771 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.431994 14809 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.482841 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.414068 14953 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.453848 14964 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:54.510671 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 219742us
I20260709 13:16:54.485694 14771 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:54.455180 14683 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:54.677135 14313 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.005s
I20260709 13:16:54.480397 14808 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:54.680130 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:54.685544 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.687422 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:54.686498 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:54.676218 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 371844us
I20260709 13:16:54.695631 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.008596 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.009330 10394 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:54.697691 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.700199 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.017356 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.018438 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.019413 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.020387 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.021049 10391 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:55.021739 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:54.707151 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.025012 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.001966 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:54.718246 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.026912 14976 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:55.027071 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.027352 14976 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:55.027801 14976 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.719414 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:54.695851 14990 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.272s	user 0.006s	sys 0.003s
I20260709 13:16:54.749239 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.030642 10393 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:55.030560 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:55.031466 10250 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:55.033713 10393 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:55.034343 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.030435 14983 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:54.752105 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:54.715080 14991 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.240s	user 0.009s	sys 0.001s
W20260709 13:16:54.717000 14987 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.415s	user 0.005s	sys 0.002s
I20260709 13:16:55.047667 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.047931 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2355) took 2061 ms. Trace:
I20260709 13:16:55.048058 10319 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:55.048316 10245 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:54.689181 14964 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:54.708755 14969 consensus_meta.cc:287] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.008s
W20260709 13:16:54.757134 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 70788.3us
I20260709 13:16:55.055898 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:54.730911 14504 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:54.759456 14986 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.339s	user 0.010s	sys 0.000s
I20260709 13:16:54.810137 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:54.758188 14808 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.820943 14918 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.792243 14888 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.622s	user 0.001s	sys 0.019s
I20260709 13:16:54.782732 14885 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:54.824148 14343 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.760258 14955 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:54.828852 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:54.830026 14762 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.830401 14750 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.841166 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:54.843575 14683 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.844918 14771 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:54.835742 14959 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:16:54.855625 14792 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.011s
I20260709 13:16:54.817466 14340 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.824570 14914 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.821609 15014 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.849509 14953 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.852166 14471 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:54.862797 14859 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:54.869002 14814 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:54.885205 14375 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.014s
W20260709 13:16:54.890312 14952 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.010s
W20260709 13:16:54.897033 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.942759 15017 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.933220 15016 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.943753 15018 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.950101 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.145648 14984 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:54.945600 15015 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.180014 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:54.957324 15019 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.961789 14874 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:54.961939 14872 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.972679 14923 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.103143 14762 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.238750 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.240263 14762 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:54.974391 15020 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.241120 15020 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.181890 14952 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.243613 15020 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:54.975172 14994 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:16:55.244310 14872 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:54.952468 15008 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:54.988232 14376 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:55.245920 14376 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.998653 14734 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:55.000399 14996 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.002496 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.254062 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:55.255951 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 188658us
I20260709 13:16:55.013454 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:55.257786 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 244408us
I20260709 13:16:55.013861 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:55.043586 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:55.044821 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.046087 10391 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:55.048336 10397 rpcz_store.cc:276] 0709 13:16:52.986527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.046896 (+ 60369us) service_pool.cc:224] Handling call
0709 13:16:53.342468 (+295572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.343180 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.047735 (+1704555us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54003b92d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:55.047864 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580548992}
I20260709 13:16:55.049903 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.010062 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:55.260591 10394 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:55.063834 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.068760 10998 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:55.069604 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.070024 10997 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:55.073120 10995 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:55.078925 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:55.080209 10247 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:55.081485 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.086234 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.089473 10399 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:55.091536 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.096133 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 928) took 1327 ms. Trace:
I20260709 13:16:55.078465 14653 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:55.097672 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.106367 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2358) took 1053 ms. Trace:
I20260709 13:16:55.095361 14885 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:55.073918 14969 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.182230 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.295581 10248 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:55.089306 14888 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.232268 14918 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.233958 15025 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:16:55.041224 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.314965 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.267493 10321 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:16:55.270896 10995 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 942) took 1698 ms (client timeout 1692 ms). Trace:
W20260709 13:16:55.316203 10995 rpcz_store.cc:269] 0709 13:16:53.572150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.574370 (+  2220us) service_pool.cc:224] Handling call
0709 13:16:54.809961 (+1235591us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:16:55.270817 (+460856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3776384}
I20260709 13:16:55.267423 10994 rpcz_store.cc:276] 0709 13:16:53.768397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.768582 (+   185us) service_pool.cc:224] Handling call
0709 13:16:53.768959 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.769236 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:53.885729 (+116493us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.965878 (+1080149us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800306280. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c368823a
0709 13:16:55.095459 (+129581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.095615 (+   156us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:55.095685 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.095775 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.096044 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":618,"prepare.queue_time_us":154296,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5428,"raft.queue_time_us":267686,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":3258112,"thread_start_us":322070,"threads_started":3,"wal-append.queue_time_us":119802,"wal-append.run_cpu_time_us":1027,"wal-append.run_wall_time_us":1004652}
I20260709 13:16:55.275560 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.279222 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:55.319891 10250 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.163007 15014 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.270635 14952 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.280313 10393 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:55.272361 10398 rpcz_store.cc:276] 0709 13:16:54.052644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.053389 (+   745us) service_pool.cc:224] Handling call
0709 13:16:55.106124 (+1052735us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400301954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:55.106307 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564881280}
I20260709 13:16:55.283125 14844 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:55.283898 14313 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:55.285194 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.324955 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:55.246776 14872 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.285991 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.287830 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:55.272691 14989 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:16:55.231108 15019 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.289681 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2617) took 1031 ms. Trace:
I20260709 13:16:55.196550 15016 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.196812 15017 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.271584 14734 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.160560 14792 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.259763 15001 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.178005 14375 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.275513 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.296754 10317 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:55.297710 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.364858 10248 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:55.181830 15018 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.326081 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:16:55.370204 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44187.1us
I20260709 13:16:55.371228 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.372728 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.270823 14996 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.374725 14859 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.375484 14734 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:55.375818 14771 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.376106 14808 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.376302 14771 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.376734 14771 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.376674 14808 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.378825 10391 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:55.342123 14872 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.342325 15022 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:55.335409 10322 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:55.340281 10245 pending_rounds.cc:85] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:16:55.385573 10245 pending_rounds.cc:107] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:16:55.329013 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.342643 10318 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:55.342931 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.385960 10245 raft_consensus.cc:2889] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.386480 10398 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:16:55.386689 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 545602us
I20260709 13:16:55.161831 14914 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.324013 15020 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.247524 14874 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.323520 14653 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:55.356298 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.398663 14653 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.399652 14929 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:55.402491 15020 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.404891 15020 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.380429 14313 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.360456 10250 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:55.335541 15023 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.334411 14814 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:55.367708 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 92316.2us
I20260709 13:16:55.368927 10242 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:55.341862 15026 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.230830 15015 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.382469 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.434629 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.435714 15015 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.435981 10241 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:55.436358 14874 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.436627 14844 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:55.437067 14844 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:55.437392 15023 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.384063 14872 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.438261 14844 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.439389 14844 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.357482 14976 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.334465 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.459290 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:55.459546 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.441511 14814 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.460608 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:55.322548 10394 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:55.429615 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.383844 14859 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.333906 15025 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.476547 14976 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.477404 15025 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.477344 14969 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.440791 14872 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.440905 14996 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.342553 10325 rpcz_store.cc:276] 0709 13:16:54.258125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.258558 (+   433us) service_pool.cc:224] Handling call
0709 13:16:54.262951 (+  4393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:54.286554 (+ 23603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.286588 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:54.287157 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:16:54.399791 (+112634us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:54.642585 (+242794us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.690399 (+ 47814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.690480 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.002567 (+312087us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4800270cd8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f 00007f58c8afff37 00007f58c8b1455c 00007f58c8b14508 00007f58c8b14488 00007f58c8b14443 00007f58c8b136ec 00007f58c7a3da96
0709 13:16:55.289341 (+286774us) raft_consensus.cc:1685] finished
0709 13:16:55.289452 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.289615 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49530,"prepare.queue_time_us":295918,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":55679,"raft.run_cpu_time_us":2126,"raft.run_wall_time_us":294146,"spinlock_wait_cycles":28721536,"thread_start_us":342768,"threads_started":2,"wal-append.queue_time_us":593556}
I20260709 13:16:55.436950 14874 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.479676 14375 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.479825 14874 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.481283 15019 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.467154 14952 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.473984 14313 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.482190 14874 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.482944 14952 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.484781 15014 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.368296 15001 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:55.446913 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 117954us
I20260709 13:16:55.333329 10323 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:55.457846 10250 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:55.454567 10248 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:55.378063 14964 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.468817 10397 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:55.470705 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.471529 10398 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:55.380158 14885 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.478394 15017 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.486749 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:55.491982 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 45822.3us
I20260709 13:16:55.456197 14471 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.490823 10290 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:55.508481 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:55.452701 14808 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:55.515311 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.516417 10247 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:55.520207 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:55.509584 14925 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:16:55.523010 15018 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.523053 15023 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:55.526417 14965 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:55.522536 14340 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:55.483273 15016 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.493403 14874 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.578722 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:55.579675 10250 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:55.583331 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 63206.5us
I20260709 13:16:55.584214 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.581965 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.586971 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:55.451617 14970 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:16:55.598935 10995 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:55.588812 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 202865us
I20260709 13:16:55.527720 14814 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.523919 14504 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.527084 14956 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:55.604518 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.608726 10392 raft_consensus.cc:2410] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:55.574972 14340 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.583679 15023 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.617244 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:55.622723 14734 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:55.623172 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 112481us
I20260709 13:16:55.587137 15029 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.624255 10316 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:55.623251 14734 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:55.624815 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.619077 14340 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.628139 14734 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.629791 14734 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.631901 14376 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.633204 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:55.633975 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.634656 10993 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:55.566987 14683 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:16:55.637086 10997 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:16:55.637485 10997 pending_rounds.cc:85] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 8
I20260709 13:16:55.637702 10997 pending_rounds.cc:107] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:16:55.637923 10997 raft_consensus.cc:2889] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.638644 14964 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.638907 10998 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:55.639608 14952 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:55.641068 15001 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.641149 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.586421 14375 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:55.642593 14375 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.642794 14872 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:55.643733 11001 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.644976 14375 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.645634 14792 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.614135 14874 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.646680 10995 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:55.624154 15029 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.653788 10247 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:55.602550 14997 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.608731 14996 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.608438 14888 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.660823 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:55.662248 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 45092.8us
I20260709 13:16:55.618399 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:55.664152 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45898.6us
I20260709 13:16:55.665627 11001 raft_consensus.cc:2410] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:16:55.661685 10250 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:55.662600 10247 raft_consensus.cc:2410] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:16:55.614809 14956 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:55.619217 14814 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.588434 14771 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.647259 15016 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.681550 10390 raft_consensus.cc:2410] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:16:55.672318 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:55.673740 15029 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:55.683285 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.663180 15022 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:55.684476 15020 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:55.685405 15022 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.668416 14375 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:55.619303 14750 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:16:55.650378 14376 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.676354 14831 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.685823 15016 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.678714 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:55.694826 15031 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:16:55.695151 14340 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.696072 14313 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:55.696732 14313 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:55.696817 14956 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.697522 14340 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.697971 14956 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.697746 14313 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.691171 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:55.646817 15023 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:55.710381 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 86508.5us
W20260709 13:16:55.710799 10213 leader_election.cc:336] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.539s (SENT)
I20260709 13:16:55.711339 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:55.713946 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.714218 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.714823 10394 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
W20260709 13:16:55.715622 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.721561 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.758600 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.720422 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.717489 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.760212 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.728627 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.702260 14792 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:55.737859 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.761905 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.765552 11000 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:55.761502 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.760332 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:55.735719 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.763725 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.779896 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.780864 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.767812 10397 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:55.781728 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.716359 14750 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.789695 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.804124 10394 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:55.790839 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:55.805088 10397 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:55.765192 14792 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.791612 14771 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.792125 14376 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.798573 15016 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.832826 15016 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.834978 15016 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.828928 14750 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.764703 14340 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.758518 15027 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:55.825145 14888 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:55.840378 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 129599us
I20260709 13:16:55.840945 14888 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.841851 15016 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:55.843060 14888 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.825742 15042 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.843339 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:55.829020 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.844107 15016 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:55.830888 14992 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:55.844596 15016 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:55.845472 15016 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.847048 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.847718 10995 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:55.848968 10999 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:16:55.831895 15023 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.899981 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:55.902047 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:55.903121 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:55.828999 14792 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:55.824254 15001 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.915892 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:55.922559 15021 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:55.922830 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 870) took 1222 ms. Trace:
I20260709 13:16:55.923065 15021 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.923478 15021 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:55.897487 14771 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.897187 14992 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:55.908671 14814 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.840322 15027 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:55.908893 15018 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:55.923280 10399 rpcz_store.cc:276] 0709 13:16:54.700156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.719078 (+ 18922us) service_pool.cc:224] Handling call
0709 13:16:55.922593 (+1203515us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b540021be54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:55.922763 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135838592}
I20260709 13:16:55.942813 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:55.932929 14814 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:55.943702 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 116113us
I20260709 13:16:55.945101 10288 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:55.943879 14814 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.951402 14888 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.951690 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.951948 15043 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.952163 14888 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.952428 14997 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:55.952687 14888 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.953199 14997 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.954586 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:55.955209 10249 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.957556 14997 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:55.958930 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:55.960130 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:55.908286 14831 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:16:55.961325 10241 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:55.962801 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.964144 10999 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:55.964540 10323 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:55.964337 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.965579 10995 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:55.966300 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.966892 10317 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:55.967890 10241 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:55.969045 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:55.968531 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.969689 11000 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.969952 10317 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:55.971117 10241 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.972102 10241 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:55.974174 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.974563 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:55.974936 10323 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:55.975221 11002 raft_consensus.cc:2368] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14.
I20260709 13:16:55.976168 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:55.976823 10323 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:55.976780 10997 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:55.965688 10322 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:55.963551 10248 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:55.952538 15043 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.981091 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:55.981427 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:55.981685 10995 raft_consensus.cc:3060] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.982307 10325 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:55.934813 15027 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.985553 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:55.935458 15018 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.961155 14750 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.002897 15043 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:55.926460 15001 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:55.933472 14992 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:55.932379 15034 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.008519 11000 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:56.008791 10241 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:56.009240 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.011824 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.012665 15042 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.012517 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.030882 15018 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.015581 10321 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:56.016644 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.017143 14340 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.019469 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.047528 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.017882 14814 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.045105 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:56.027796 15020 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:56.029589 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 86867.5us
I20260709 13:16:56.032291 10249 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:56.003952 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.054742 10316 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:56.035295 10995 raft_consensus.cc:2468] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:56.055341 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:16:56.030887 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 157255us
I20260709 13:16:56.043426 10997 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:56.014058 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.059962 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.048388 10290 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.061769 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.025048 15021 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.049330 14750 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:16:56.063161 15020 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.064810 15021 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.065398 14888 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.065680 14771 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:56.066175 14771 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.066633 14771 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:56.068037 14885 raft_consensus.cc:2804] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:56.068711 14885 raft_consensus.cc:697] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:56.049698 14981 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:16:56.071375 15001 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.072746 15017 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:56.073359 14814 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.051630 14997 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:56.054522 14976 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:56.075269 14976 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:56.027840 14792 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.076258 14976 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.078766 14792 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.079107 14750 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:56.079631 14750 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:56.080637 14750 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.046598 15042 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.083614 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2613) took 1872 ms. Trace:
I20260709 13:16:56.083971 10318 rpcz_store.cc:276] 0709 13:16:54.210734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.210867 (+   133us) service_pool.cc:224] Handling call
0709 13:16:54.211111 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.388485 (+1177374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.083364 (+694879us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400115154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:56.083558 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601798400}
I20260709 13:16:56.084568 15027 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.051486 14340 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.085278 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.085557 10319 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:56.085814 14992 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.086709 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.073966 14997 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.087070 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.087512 14997 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:56.087685 10319 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.087867 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.084583 15042 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.089028 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.081936 15022 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:56.090500 15022 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:56.090852 15050 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:16:56.091355 15038 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:56.091758 10290 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.093111 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.094154 14992 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.094583 14992 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.094424 15043 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:56.094956 14992 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.095997 15043 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:56.096511 15043 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:56.097352 15043 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.098660 10396 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:16:56.099092 10396 pending_rounds.cc:85] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 7
I20260709 13:16:56.040452 15034 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:56.099339 10396 pending_rounds.cc:107] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:16:56.099514 10319 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:16:56.099627 15034 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.100418 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.101197 10323 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:56.087108 14340 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.098549 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.103896 14914 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:56.104768 10325 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:56.069696 14885 consensus_queue.cc:237] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.101085 14768 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:56.103152 15027 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.090166 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.109274 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.030411 14680 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.115697 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.099653 10396 raft_consensus.cc:2889] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:56.113147 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.141896 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.142120 10248 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:56.144023 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.117658 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.116895 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.120110 10325 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:16:56.140101 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 95070.8us
W20260709 13:16:56.096021 10392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 861) took 1626 ms (client timeout 1822 ms). Trace:
I20260709 13:16:56.144368 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.152398 10399 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:56.147248 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:56.153266 10392 rpcz_store.cc:269] 0709 13:16:54.469632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.470072 (+   440us) service_pool.cc:224] Handling call
0709 13:16:56.095789 (+1625717us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000bc7d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:56.095961 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614735744}
I20260709 13:16:56.085191 14750 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.154393 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.156951 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.119457 10316 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:56.140311 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:56.161059 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.161203 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.162014 10321 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:56.162488 10364 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:56.165100 10318 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:56.166308 15016 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:56.118757 14792 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.091810 15038 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:56.145511 14983 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:56.170642 10288 leader_election.cc:400] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14.
I20260709 13:16:56.167814 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.139418 14680 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.168916 10397 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:56.151736 14814 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:56.185889 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.179775 10288 leader_election.cc:403] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:16:56.146656 15017 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:56.151261 15035 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:56.101476 15018 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.196040 10321 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:56.198387 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:56.209350 10318 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:16:56.144985 14768 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.194970 14680 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.215087 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:56.251443 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:56.253788 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 91377.4us
I20260709 13:16:56.211346 14653 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14.
I20260709 13:16:56.176190 14376 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:16:56.276134 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 424539us
I20260709 13:16:56.277498 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:56.215709 15020 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:56.251349 15033 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:16:56.178877 14792 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.178597 14504 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:16:56.268023 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.290768 10995 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:56.254293 14340 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:56.091396 15022 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:56.269631 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 129383us
I20260709 13:16:56.296811 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:56.297772 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.299536 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.200555 14814 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:56.273130 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 58159.2us
I20260709 13:16:56.252411 14969 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.212448 15035 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.283547 10316 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:56.258852 15004 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:56.210970 15017 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.284250 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.284194 14914 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:56.309267 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:16:56.319088 15057 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:56.319545 15017 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.320191 10248 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:16:56.321028 15061 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:56.275460 10997 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:56.321992 14375 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:56.322755 14375 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:56.311087 10994 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:16:56.315995 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.332154 10390 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
W20260709 13:16:56.334995 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 686190us
I20260709 13:16:56.303231 14340 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:56.310488 15020 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.346580 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.405174 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.305217 15000 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:56.397416 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 871) took 1689 ms. Trace:
I20260709 13:16:56.314384 15022 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:56.406675 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 122503us
I20260709 13:16:56.381220 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.422672 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2366) took 1160 ms. Trace:
I20260709 13:16:56.310360 15021 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.426499 10318 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 10: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:56.270884 15038 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.444888 11000 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:56.444985 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.445669 11001 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:56.424932 10396 rpcz_store.cc:276] 0709 13:16:54.708175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.025928 (+317753us) service_pool.cc:224] Handling call
0709 13:16:56.098319 (+1072391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.141363 (+ 43044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.397118 (+255755us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000bc7d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:56.397331 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465536256}
I20260709 13:16:56.436033 15061 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:56.436151 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.438769 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.452068 10316 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.436462 15021 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:56.437407 14340 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.438935 10997 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:56.440027 15052 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:16:56.441109 15056 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:16:56.441867 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 132674us
I20260709 13:16:56.404013 15020 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.442584 14918 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:56.451370 10318 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:56.485515 14956 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:16:56.492735 14956 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:56.493204 14956 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:56.494982 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2798) took 1466 ms. Trace:
I20260709 13:16:56.494179 14956 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.495445 10244 rpcz_store.cc:276] 0709 13:16:55.028049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.028170 (+   121us) service_pool.cc:224] Handling call
0709 13:16:55.028471 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.365946 (+337475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.365975 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.366017 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:55.366052 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.494742 (+1128690us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000a8a54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:56.494791 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.494916 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775632768}
I20260709 13:16:56.496487 14956 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.498602 10290 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.499581 14653 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.499996 14653 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.500345 14653 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:56.501420 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.502696 14835 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.503211 14835 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.507368 10396 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:56.433336 10391 rpcz_store.cc:276] 0709 13:16:55.262556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.271517 (+  8961us) service_pool.cc:224] Handling call
0709 13:16:56.403200 (+1131683us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54002de454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:56.422583 (+ 19383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100749184}
I20260709 13:16:56.455626 10323 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:56.462399 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.407198 14869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.018s	sys 0.041s
I20260709 13:16:56.470101 14768 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.399113 14831 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.476884 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:56.439419 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 54309.6us
I20260709 13:16:56.523262 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.477751 15038 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.515288 10316 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:56.460731 15061 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:56.461289 15021 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:56.520757 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.432386 15000 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.446502 15034 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.486989 15020 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.546267 10244 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:56.526691 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49926.9us
I20260709 13:16:56.525780 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.547690 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:56.532028 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:56.521746 14869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.019s	sys 0.041s
I20260709 13:16:56.518836 14980 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.557088 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.558197 10393 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:56.398753 14375 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.560360 10243 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:56.563831 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 289688us
I20260709 13:16:56.525243 15018 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:56.585669 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52657.2us
I20260709 13:16:56.587491 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.590082 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.582325 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.581451 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.590987 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:56.591008 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 70955.3us
W20260709 13:16:56.592077 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 256048us
I20260709 13:16:56.594012 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:56.594211 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.509177 15069 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:16:56.546936 15061 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.550134 15017 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:56.546708 15000 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:56.618116 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:56.594000 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:56.623571 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:56.637028 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.630162 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.642345 10393 raft_consensus.cc:2376] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14. Re-sending same reply.
I20260709 13:16:56.639823 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.643685 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.637028 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.640208 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:56.645460 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.646910 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.647814 10397 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:56.629417 10323 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:56.660089 10395 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:56.662580 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.585036 14771 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.630730 14869 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:16:56.681959 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.582713 14980 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.720925 10323 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:16:56.733239 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 143208us
I20260709 13:16:56.723177 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:56.715000 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 162848us
W20260709 13:16:56.776929 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.662360 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.723573 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:56.779065 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.779628 10399 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:56.617874 14683 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:56.630321 14512 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:56.618623 15016 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:16:56.721323 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 86645.7us
I20260709 13:16:56.763373 14814 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.776110 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 996) took 1730 ms. Trace:
I20260709 13:16:56.721439 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.788609 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:56.792203 10395 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:56.743425 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.629688 15001 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:56.802968 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.783048 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.783747 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.638450 15017 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:56.724078 14965 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:56.743324 14808 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.639506 14504 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.759032 14768 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:56.642002 14981 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:56.758795 15071 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.791921 10242 rpcz_store.cc:276] 0709 13:16:55.045316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.045451 (+   135us) service_pool.cc:224] Handling call
0709 13:16:55.077300 (+ 31849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.428973 (+351673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.775849 (+1346876us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400101dd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:56.776045 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669543680}
I20260709 13:16:56.800616 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.766839 15035 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.804203 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.774902 15073 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:56.829869 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.780064 15004 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:56.812906 10393 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:56.811702 10247 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:56.804484 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.723125 14792 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:56.834358 14792 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:56.835047 14792 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:56.804512 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:56.837663 10399 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 10: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:56.817904 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:56.803898 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.823815 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.839053 10395 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:16:56.824079 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.825528 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:56.840525 10316 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:56.836246 14792 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.848026 10316 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:56.788522 15086 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:16:56.886102 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.811409 15017 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:56.819748 14808 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.895644 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:56.803134 15085 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.803608 15018 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:56.830183 15071 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:56.790292 14512 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.805114 15069 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:16:56.905051 10324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2628) took 1864 ms. Trace:
I20260709 13:16:56.852706 10318 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:56.916008 10324 rpcz_store.cc:276] 0709 13:16:55.040496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.040624 (+   128us) service_pool.cc:224] Handling call
0709 13:16:56.904308 (+1863684us) spinlock_profiling.cc:243] Waited 941 us on lock 0x7b58001c4198. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:16:56.904531 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.904717 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.904743 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.904784 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.904812 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.904866 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.904988 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163584}
I20260709 13:16:56.872380 15016 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:16:56.915624 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 97857us
I20260709 13:16:56.925699 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:56.903046 14808 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.935662 10390 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:16:56.937114 14869 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.937551 15070 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:16:56.853631 14504 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.919535 14653 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:56.942060 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:56.942943 10324 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:56.943673 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.050073 10399 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
W20260709 13:16:56.944273 15064 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:16:56.945140 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.051968 10393 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:56.945338 15065 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:16:56.904801 15085 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:56.917603 15060 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 13:16:56.904618 15018 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:56.912921 15083 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:56.902968 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 100924us
I20260709 13:16:56.914373 15071 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.965329 15080 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:56.966684 15081 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:56.968407 14969 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:56.971298 10323 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:56.972895 15021 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.933691 15034 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:56.872501 15073 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:56.961653 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.024892 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:57.025467 10997 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:57.025722 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:57.064428 15085 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.089736 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.040777 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:57.043640 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:57.045401 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:56.934705 15016 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.067430 15069 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:56.968394 15061 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.069541 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:57.045585 15035 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.077961 14969 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.078450 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2632) took 1102 ms. Trace:
I20260709 13:16:57.080374 15021 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:56.897142 15086 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:57.101918 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 140354us
I20260709 13:16:57.115453 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.115995 11001 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:16:56.949985 15004 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.124641 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.093947 10967 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.066717 15083 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.109869 10317 rpcz_store.cc:276] 0709 13:16:55.976297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.978251 (+  1954us) service_pool.cc:224] Handling call
0709 13:16:55.978552 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.982395 (+  3843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.982425 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.982463 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:55.982498 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.078147 (+1095649us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b5400114c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:57.078209 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.078391 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8338304}
I20260709 13:16:57.087028 14771 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.057147 14869 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.134017 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.095851 14980 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.130342 10393 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:16:57.149021 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.129586 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.096539 15094 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.075300 14814 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:16:57.155246 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:57.155791 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2640) took 1138 ms. Trace:
I20260709 13:16:57.110982 15034 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:57.126091 14992 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.031s	user 0.013s	sys 0.000s
I20260709 13:16:57.083913 15081 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.127496 14872 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.136108 15083 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.153752 15069 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.131168 15021 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:57.128770 15095 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:57.113299 15068 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.109787 15080 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:57.113832 15035 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.162209 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:57.254731 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.254694 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:57.248834 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 85632.8us
I20260709 13:16:57.377710 10317 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:57.377827 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.159403 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:57.310843 15097 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:16:57.311539 15021 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.251991 15061 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:57.252059 15072 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.668s	user 0.003s	sys 0.000s
I20260709 13:16:57.168630 15094 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.171336 15034 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:57.248309 14653 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.242609 14992 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.336913 15080 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.271780 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.337863 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.396062 10395 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:16:57.337843 15068 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.395323 15098 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.404953 14504 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.406282 15073 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.406657 10999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1036) took 1146 ms. Trace:
I20260709 13:16:57.407030 10999 rpcz_store.cc:276] 0709 13:16:56.259935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.265761 (+  5826us) service_pool.cc:224] Handling call
0709 13:16:56.266073 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.266477 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.266504 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.266945 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.427356 (+160411us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:56.427419 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.427518 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.251471 (+823953us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:57.406316 (+154845us) raft_consensus.cc:1685] finished
0709 13:16:57.406340 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.406596 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10510,"spinlock_wait_cycles":16620288,"thread_start_us":102001,"threads_started":1,"wal-append.queue_time_us":257502}
I20260709 13:16:57.338498 15095 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.409077 15095 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:57.409576 15095 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.411862 15080 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:57.412889 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 141222us
W20260709 13:16:57.413609 15022 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.962s	user 0.012s	sys 0.001s
I20260709 13:16:57.413676 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.340682 14996 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:57.414453 10245 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:16:57.151278 15000 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.414860 14869 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.415405 14996 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:57.415894 10396 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:57.405992 15068 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:57.285552 14872 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.157861 14805 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.177s
W20260709 13:16:57.158560 14885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.015s	sys 0.025s
W20260709 13:16:57.416872 14885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.015s	sys 0.025s
I20260709 13:16:57.416430 15103 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:57.360556 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 769) took 3130 ms. Trace:
I20260709 13:16:57.417299 15103 consensus_queue.cc:1243] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:57.417974 14872 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.357738 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2816) took 1679 ms. Trace:
I20260709 13:16:57.418675 15016 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.418571 10250 rpcz_store.cc:276] 0709 13:16:55.678649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.679183 (+   534us) service_pool.cc:224] Handling call
0709 13:16:55.946356 (+267173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.946620 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.946660 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.946720 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:55.946776 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.946853 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.316439 (+1369586us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000b9ad0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:57.357674 (+ 41235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613688576}
I20260709 13:16:57.420184 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:57.420760 10250 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.383882 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.415119 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:57.423971 15021 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.395449 15088 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:57.424853 14976 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.426967 14734 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:57.417584 10320 rpcz_store.cc:276] 0709 13:16:54.230761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.231681 (+   920us) service_pool.cc:224] Handling call
0709 13:16:54.231992 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.376652 (+144660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.376684 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.377174 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.037303 (+1660129us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b1800376120. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:16:56.218925 (+181622us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:56.218973 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.360081 (+1141108us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b5400114754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:57.360151 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.360215 (+    64us) raft_consensus.cc:1685] finished
0709 13:16:57.360235 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.360448 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49217,"raft.queue_time_us":82869,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14995,"spinlock_wait_cycles":256105216,"thread_start_us":181428,"threads_started":1,"wal-append.queue_time_us":1879137}
I20260709 13:16:57.427716 15094 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.352164 15018 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.431128 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.435271 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:57.437764 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:16:57.390540 14680 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.110s	user 0.013s	sys 0.000s
I20260709 13:16:57.396133 15034 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:57.390831 14537 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:16:57.403914 15092 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 13:16:57.415532 14653 raft_consensus.cc:2764] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 13:16:57.416210 14997 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.328s	user 0.008s	sys 0.008s
I20260709 13:16:57.381172 10399 raft_consensus.cc:2376] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14. Re-sending same reply.
I20260709 13:16:57.463635 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.416510 15000 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:57.470211 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 965) took 1030 ms. Trace:
I20260709 13:16:57.471261 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.471949 10399 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:16:57.472918 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.397079 10249 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:57.409703 15085 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.473524 10399 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.444555 10250 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:16:57.129894 10968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.002s	sys 0.017s
W20260709 13:16:57.129962 10394 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.011s
I20260709 13:16:57.453540 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:57.404851 15086 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:57.449348 14983 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.459892 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:57.161319 10319 rpcz_store.cc:276] 0709 13:16:56.017403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.100282 (+ 82879us) service_pool.cc:224] Handling call
0709 13:16:56.100593 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.107136 (+  6543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.107163 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.145378 (+ 38215us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.563520 (+418142us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.563560 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.563624 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.155476 (+591852us) raft_consensus.cc:1685] finished
0709 13:16:57.155508 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.155709 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5861,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":384642,"threads_started":1,"wal-append.queue_time_us":595369}
I20260709 13:16:57.466928 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:16:57.450528 14792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.112s	sys 0.164s
W20260709 13:16:57.484562 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.484987 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.485092 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.469584 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.445940 14504 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:57.458397 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:57.486420 10393 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 8.
I20260709 13:16:57.487377 10290 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:57.491241 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:57.478307 10322 raft_consensus.cc:2410] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:57.477916 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:57.477236 10317 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
W20260709 13:16:57.488200 14792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.113s	sys 0.164s
I20260709 13:16:57.468636 15103 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.497011 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:57.477625 10968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.002s	sys 0.017s
I20260709 13:16:57.476377 15018 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:57.478542 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 329619us
I20260709 13:16:57.499984 10994 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:57.480548 15023 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.422331 15095 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.470587 14997 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.470744 10995 rpcz_store.cc:276] 0709 13:16:56.441070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.441495 (+   425us) service_pool.cc:224] Handling call
0709 13:16:56.441880 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.442164 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:56.714455 (+272291us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.147223 (+432768us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.147599 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.328775 (+181176us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b18003ac420. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:57.359483 (+ 30708us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b18003ac420. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:16:57.456672 (+ 97189us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.467769 (+ 11097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.467846 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:57.467919 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.470039 (+  2120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.470154 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11776,"prepare.queue_time_us":616831,"prepare.run_cpu_time_us":230,"prepare.run_wall_time_us":8012,"raft.queue_time_us":230397,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":102745,"spinlock_wait_cycles":193814272,"thread_start_us":986874,"threads_started":3,"wal-append.queue_time_us":613387}
W20260709 13:16:57.503453 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 409560us
I20260709 13:16:57.504360 10997 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:16:57.477774 10394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.009s	sys 0.011s
I20260709 13:16:57.449493 14680 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.519385 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.510423 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.502007 14653 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:57.494798 14888 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.458427 14512 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.529194 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.794768 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:57.795655 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 266343us
I20260709 13:16:57.797859 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:57.799834 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.801641 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.803246 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.804109 10393 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:57.804517 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:57.805107 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1965) took 1215 ms. Trace:
I20260709 13:16:57.805665 10244 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:16:57.808624 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:57.809104 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:57.809572 10244 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:57.810891 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:57.812623 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1919) took 1704 ms. Trace:
I20260709 13:16:57.812711 10244 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:57.813138 10243 rpcz_store.cc:276] 0709 13:16:56.107997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.113607 (+  5610us) service_pool.cc:224] Handling call
0709 13:16:56.113885 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.560804 (+446919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.812012 (+1251208us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54003b42d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:57.812356 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026320256}
I20260709 13:16:57.511291 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.808760 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1949) took 1222 ms. Trace:
I20260709 13:16:57.810106 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54378 (request call id 999) took 1009 ms. Trace:
W20260709 13:16:57.815136 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 303816us
I20260709 13:16:57.814842 10390 rpcz_store.cc:276] 0709 13:16:56.585788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.590673 (+  4885us) service_pool.cc:224] Handling call
0709 13:16:57.808260 (+1217587us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54001aa754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:57.808557 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790001408}
I20260709 13:16:57.819015 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:57.815881 10245 rpcz_store.cc:276] 0709 13:16:56.801005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.801153 (+   148us) service_pool.cc:224] Handling call
0709 13:16:57.809688 (+1008535us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000a8f54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:57.809922 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342428032}
I20260709 13:16:57.820292 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1946) took 1295 ms. Trace:
I20260709 13:16:57.820792 10396 rpcz_store.cc:276] 0709 13:16:56.525120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.525454 (+   334us) service_pool.cc:224] Handling call
0709 13:16:57.819802 (+1294348us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003b97d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:57.820091 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996590976}
I20260709 13:16:57.821174 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:57.823894 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:57.824851 10395 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:57.824996 10317 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:16:57.827487 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:57.828593 10320 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.831844 10245 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:57.833192 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:56.724226  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:57.775331 10325 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:57.805680 10393 rpcz_store.cc:276] 0709 13:16:56.589839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.802810 (+1212971us) service_pool.cc:224] Handling call
0709 13:16:57.803620 (+   810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.804731 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.804985 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.841768 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:57.834081 10245 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:57.614085 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 103736us
I20260709 13:16:57.861617 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:57.814116 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:57.621038 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:57.657371 14808 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.004s
I20260709 13:16:57.622742 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:57.879463 14808 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.622308 10998 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
W20260709 13:16:57.679167 14969 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.002s
I20260709 13:16:57.529465 15022 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:57.883424 14969 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.883637 15022 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.474604 15102 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:57.697908 15023 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:57.887065 15102 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:16:57.887207 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:57.620872 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:57.546602 15016 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:57.878602 15110 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.662295 15081 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:57.890019 10396 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:57.668941 15083 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.897686 10999 raft_consensus.cc:2410] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:57.905247 10244 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:57.905659 10397 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:57.529636 14792 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:57.907476 14792 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.669781 15085 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.910534 15021 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.500825 14956 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.414s
I20260709 13:16:57.911414 15021 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:16:57.641610 15071 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.004s
I20260709 13:16:57.915138 15071 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:57.887810 15102 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:57.916111 14869 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.915879 15016 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.571116 15035 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.658543 14976 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:57.920487 14929 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:57.530462 14983 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:57.660684 14680 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.923739 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:57.653707 15105 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:16:57.927310 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 61029.6us
W20260709 13:16:57.501048 15020 consensus_meta.cc:287] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.943s	user 0.013s	sys 0.000s
I20260709 13:16:57.919854 14771 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.919075 14683 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.624367 15094 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.293s
I20260709 13:16:57.974460 14683 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.977691 14683 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.979199 14964 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:57.979915 14835 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.921890 15029 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:57.646193 15038 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 1.114s	user 0.013s	sys 0.001s
I20260709 13:16:57.493566 15001 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:57.965462 14792 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:58.000748 14951 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:58.001368 14951 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:57.650604 15108 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:58.003548 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1957) took 1415 ms. Trace:
I20260709 13:16:58.004076 10391 rpcz_store.cc:276] 0709 13:16:56.588038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.358607 (+770569us) service_pool.cc:224] Handling call
0709 13:16:57.359029 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.001397 (+642368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.001447 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.001487 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:58.001529 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.003018 (+  1489us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54002de454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:58.003083 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.003305 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476206848}
I20260709 13:16:57.986553 14929 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.007850 15016 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.008919 15021 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:57.917583 14814 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:57.623652 15086 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:57.617656 14750 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.456s	user 0.014s	sys 0.002s
W20260709 13:16:57.630390 15017 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.726s	user 0.004s	sys 0.008s
I20260709 13:16:57.973696 14983 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.020588 15061 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.020891 14983 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:58.021368 15061 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.972508 14771 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:57.974335 10242 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:57.956035 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82833.1us
I20260709 13:16:57.499289 14992 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:57.910077 15000 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.020654 15017 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.624325 14653 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:58.034789 15000 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.036197 14653 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.037015 10241 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:58.037196 15000 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:57.510758 15103 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:57.992615 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 167843us
I20260709 13:16:57.993736 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1967) took 1403 ms. Trace:
I20260709 13:16:58.038971 10396 rpcz_store.cc:276] 0709 13:16:56.594925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.919628 (+1324703us) service_pool.cc:224] Handling call
0709 13:16:57.992712 (+ 73084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.993147 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.993194 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.993292 (+    98us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:57.993375 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.993477 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.993636 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.005765 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.011785 15109 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.013031 14808 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:58.012588 14869 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.014008 15020 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:57.663045 14997 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.027904 14771 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.030082 15075 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.030969 14750 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:58.033100 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 1962) took 1443 ms. Trace:
I20260709 13:16:57.639907 15095 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:58.051335 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.018101 15055 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.720s	user 0.002s	sys 0.001s
I20260709 13:16:58.049871 10397 rpcz_store.cc:276] 0709 13:16:56.589182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.648801 (+ 59619us) service_pool.cc:224] Handling call
0709 13:16:58.032812 (+1384011us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540040f954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:58.033017 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516263168}
I20260709 13:16:58.058605 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.060045 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.061272 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:58.062512 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.064059 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.065025 15035 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:58.065085 15016 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:58.065671 15035 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:58.066665 14680 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:58.067845 10390 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:16:58.068246 10390 pending_rounds.cc:85] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 8
I20260709 13:16:58.068645 10390 pending_rounds.cc:107] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:58.068980 10390 raft_consensus.cc:2889] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.069116 15103 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.050311 15022 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.070127 14951 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:58.071089 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.071509 14914 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.068183 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 874) took 1449 ms. Trace:
I20260709 13:16:58.073145 10391 rpcz_store.cc:276] 0709 13:16:56.618581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.067066 (+1448485us) service_pool.cc:224] Handling call
0709 13:16:58.067502 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.067853 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.067877 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.067916 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:58.067943 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.067995 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.068092 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.042627 14969 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.062090 10396 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:16:58.085268 15086 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.085427 14981 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.078859 15075 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.086499 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.087109 15018 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:58.088390 14869 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.088168 15109 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.088814 10248 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:16:58.048383 14814 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:57.661602 15034 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.092897 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.096365 10245 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:58.098063 10320 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:58.052376 15029 consensus_queue.cc:1243] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:58.103210 10397 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:58.103003 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:58.112294 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 122966us
I20260709 13:16:58.113881 15109 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.115433 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 884) took 1341 ms. Trace:
I20260709 13:16:58.115423 14808 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:58.116593 14808 consensus_queue.cc:1243] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:58.116137 10391 rpcz_store.cc:276] 0709 13:16:56.774130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.090111 (+1315981us) service_pool.cc:224] Handling call
0709 13:16:58.109568 (+ 19457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.114895 (+  5327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.114945 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.115046 (+   101us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:58.115086 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.115152 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.115346 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:58.119500 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 132150us
W20260709 13:16:58.122762 15106 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 13:16:58.126780 15038 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:58.127715 14981 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.130064 15120 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.130947 15120 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.133940 15120 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:58.106647 15086 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.135363 14981 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.137017 15086 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:16:58.141083 10399 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.664s	user 0.016s	sys 0.001s
I20260709 13:16:58.141409 15102 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.141762 10399 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:58.105345 14929 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.146159 10317 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:58.155761 10999 raft_consensus.cc:3060] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.145531 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.147324 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1953) took 1531 ms. Trace:
I20260709 13:16:58.147580 11001 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:58.125447 15018 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.145824 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1951) took 1467 ms. Trace:
I20260709 13:16:58.209380 10395 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:16:58.212473 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.148842 15112 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.231959 10396 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:58.233444 10396 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:58.233704 15018 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:58.234817 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 63391.9us
I20260709 13:16:58.235756 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.237162 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.238032 14929 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:58.238394 10249 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:58.238574 10290 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.238718 14929 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:58.239602 15086 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.240021 14929 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.240259 15086 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.242591 15124 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:58.242960 15127 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.243264 15124 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:58.243456 15127 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.243614 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:58.243980 15127 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.111524 14680 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:58.230729 15035 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.231385 10243 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:58.233897 10396 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:58.177345 10394 rpcz_store.cc:276] 0709 13:16:56.586932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.588218 (+  1286us) service_pool.cc:224] Handling call
0709 13:16:56.588558 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:57.588808 (+1000250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.588856 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:57.823051 (+234195us) log.cc:844] Serialized 52 byte log entry
0709 13:16:57.981725 (+158674us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:58.040854 (+ 59129us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.097607 (+ 56753us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.106526 (+  8919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.109084 (+  2558us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.109124 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:58.109134 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.118675 (+  9541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66211,"prepare.queue_time_us":61208,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":21619,"raft.queue_time_us":348732,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":20890,"spinlock_wait_cycles":14704256,"thread_start_us":1131785,"threads_started":2,"wal-append.queue_time_us":175260}
I20260709 13:16:58.253701 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.254634 10322 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:58.259235 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2824) took 1403 ms. Trace:
I20260709 13:16:58.259410 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:58.259754 10241 rpcz_store.cc:276] 0709 13:16:56.855981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.106467 (+250486us) service_pool.cc:224] Handling call
0709 13:16:57.106912 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.037550 (+930638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.258963 (+221413us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540009f454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:58.259171 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138228992}
I20260709 13:16:58.261027 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:58.261853 15004 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:58.262521 14768 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.272924 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.146657 15017 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.233603 15034 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.277062 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.281068 15094 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:58.281562 15094 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:58.282708 15094 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.284153 15094 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:58.285382 10397 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:58.244565 15124 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.286661 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.287812 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.288916 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:58.291004 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:58.290122 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.300238 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:16:58.300822 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 155453us
I20260709 13:16:58.302340 10391 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:58.304216 10241 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:58.305775 15020 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.206709 10392 rpcz_store.cc:276] 0709 13:16:56.586423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.586532 (+   109us) service_pool.cc:224] Handling call
0709 13:16:56.586818 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.587023 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:56.636564 (+ 49541us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.841881 (+1205317us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800444880. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c0975c0a 00007f58ca0b5219 00007f58c09fda40 00007f58c09f84e4 00007f58c09f8455 00007f58c74e03c7 00007f58c3af29a7 00007f58c3b020bf 00007f58c3b02038
0709 13:16:57.896129 (+ 54248us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.973305 (+ 77176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.984387 (+ 11082us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:57.989407 (+  5020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.028440 (+ 39033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.053475 (+ 25035us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34269,"prepare.queue_time_us":865242,"prepare.run_cpu_time_us":273,"prepare.run_wall_time_us":273,"raft.queue_time_us":38448,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":43628,"spinlock_wait_cycles":8595328,"thread_start_us":464589,"threads_started":2,"wal-append.queue_time_us":438336}
I20260709 13:16:58.302244 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:58.273770 14869 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.278726 15038 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.274183 15075 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:16:58.314392 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50716.2us
I20260709 13:16:58.315456 10395 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:58.319706 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:58.272329 15112 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.263768 14983 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.322451 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:16:58.323418 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 78081.8us
W20260709 13:16:58.330956 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71680.1us
I20260709 13:16:58.331945 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:58.147675 14814 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.332736 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.333429 10243 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:16:58.337518 10243 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:58.338297 15112 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:58.325888 10396 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.350472 15025 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:58.350733 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.325414 15018 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:58.339151 14680 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.351643 15018 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:58.400897 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.414971 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:58.329749 15038 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.342222 15109 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:58.427832 15079 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:16:58.429100 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 97292.4us
I20260709 13:16:58.429518 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.427889 15128 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:58.431617 15128 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:16:58.425381 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71861.4us
I20260709 13:16:58.352861 15129 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:16:58.435703 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:58.436362 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2795) took 3409 ms. Trace:
I20260709 13:16:58.444630 10243 raft_consensus.cc:1240] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:58.413324 15025 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:58.443432 15086 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.447564 15025 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.452519 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.454638 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:58.455197 10318 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:16:58.455760 10324 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:58.456578 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:58.456959 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.457837 10324 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:58.458392 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.471088 10999 raft_consensus.cc:2468] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:16:58.479791 10396 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:58.482172 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 180080us
I20260709 13:16:58.478202 15018 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.432924 15128 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.524092 14504 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:58.526327 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:58.445575 10246 rpcz_store.cc:276] 0709 13:16:55.027195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.053785 (+ 26590us) service_pool.cc:224] Handling call
0709 13:16:55.058719 (+  4934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.059097 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:55.094025 (+ 34928us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.960450 (+866425us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18002cdd60. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c368823a 00007f58c3af2a2a
0709 13:16:56.158008 (+197558us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.159793 (+  1785us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.159923 (+   130us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.159953 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.160021 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.016945 (+1856924us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:16:58.435959 (+419014us) raft_consensus.cc:1685] finished
0709 13:16:58.435984 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.436160 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14696,"prepare.queue_time_us":33483,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":2634,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":22429,"spinlock_wait_cycles":12057600,"thread_start_us":197330,"threads_started":1,"wal-append.queue_time_us":1164812}
W20260709 13:16:58.513827 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.195:40329 timed out after 1.589s (SENT) [suppressed 7 similar messages]
W20260709 13:16:58.532729 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.551258 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.553951 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.554612 10998 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:58.555241 14869 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:58.556294 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:58.557066 11000 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:16:58.541050 15018 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.560130 15018 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.513451 15109 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.557117 14983 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.564860 15109 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.520088 15102 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.556226 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.586684 11001 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.594693 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.603803 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:58.605316 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.605702 15083 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.515487 14771 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.596025 15018 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.617964 15129 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.566615 15127 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.632396 10396 raft_consensus.cc:1275] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:16:58.630654 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:58.635780 15113 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.024s	user 0.016s	sys 0.016s
I20260709 13:16:58.636590 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:58.638407 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 295656us
I20260709 13:16:58.638942 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.640532 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.641189 10241 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:16:58.641546 10288 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:58.642544 15098 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.643492 14683 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:58.643249 15098 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.643970 14683 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:58.642028 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.632949 10396 pending_rounds.cc:85] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 6
I20260709 13:16:58.648427 10396 pending_rounds.cc:107] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:16:58.648706 10396 raft_consensus.cc:2889] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.651376 10246 raft_consensus.cc:2393] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:58.624362 15038 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.661087 15004 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.664657 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.665686 10245 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:58.667104 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.666723 14762 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:58.672278 14762 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:58.672673 14762 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:58.674651 10995 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:16:58.674674 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:58.681398 11001 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:58.669910 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:58.667963 14981 raft_consensus.cc:2804] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:58.695622 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 262297us
I20260709 13:16:58.696336 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:58.692772 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:16:58.645205 14683 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.700928 10246 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:58.674799 15102 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.702461 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 188664us
I20260709 13:16:58.673698 14762 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.676808 15129 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.720217 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.720892 10999 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.723135 14762 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.717553 15102 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.724493 10247 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:58.725662 15102 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.726907 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:58.727617 10247 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:58.728165 15130 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.496s	user 0.004s	sys 0.000s
I20260709 13:16:58.723062 15068 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:58.706491 14981 raft_consensus.cc:697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:58.736886 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.739578 15127 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.757937 14981 consensus_queue.cc:237] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:58.750392 14683 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.752413 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:16:58.755162 15142 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:58.755681 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.745369 14976 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.764269 10247 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:16:58.719406 15098 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.730139 15061 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:58.783766 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:58.789180 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:58.793015 11001 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:58.778638 15068 consensus_queue.cc:1243] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:58.793965 10245 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:16:58.790148 15127 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:58.799983 14809 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:16:58.800561 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 1009) took 1732 ms. Trace:
I20260709 13:16:58.767927 15020 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.808576 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:58.812997 11001 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:16:58.797062 10248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54378 (request call id 1001) took 1995 ms (client timeout 1788 ms). Trace:
I20260709 13:16:58.814083 14771 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:16:58.814319 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 145220us
I20260709 13:16:58.814592 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.815795 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:58.811601 10250 rpcz_store.cc:276] 0709 13:16:57.066421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.510936 (+444515us) service_pool.cc:224] Handling call
0709 13:16:57.530600 (+ 19664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.906556 (+375956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.906614 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.906695 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:57.906742 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.792132 (+885390us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540009db54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:58.792169 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.798597 (+  6428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822391680}
W20260709 13:16:58.813572 10248 rpcz_store.cc:269] 0709 13:16:56.801751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.803980 (+  2229us) service_pool.cc:224] Handling call
0709 13:16:58.791778 (+1987798us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540009d654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:58.796917 (+  5139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2886640896}
I20260709 13:16:58.819692 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:58.836618 10243 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:58.810007 15129 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.809998 15127 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:58.835641 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.852202 10250 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:58.850559 10246 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.861486 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:16:58.868948 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.871829 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:58.872795 10395 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:16:58.854080 15127 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:58.881049 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:16:58.880904 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:58.887477 10394 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:58.870405 14771 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.870627 15094 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.848569 15020 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.884543 15083 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:58.895998 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.896697 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.897145 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.900754 10967 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:58.893326 14771 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:16:58.902649 14771 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.898326 15083 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.909801 15083 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.896052 15089 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:58.913383 15126 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.681s	user 0.001s	sys 0.009s
W20260709 13:16:58.915932 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 103872us
I20260709 13:16:58.894464 15094 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:58.920130 14512 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:58.921041 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 66984.9us
W20260709 13:16:58.931109 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50191.8us
I20260709 13:16:58.933384 10999 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:58.937306 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:16:58.939206 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.913763 15035 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.935019 15094 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:58.943488 10325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2649) took 2794 ms (client timeout 1865 ms). Trace:
W20260709 13:16:58.944802 10325 rpcz_store.cc:269] 0709 13:16:56.147635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.156638 (+  9003us) service_pool.cc:224] Handling call
0709 13:16:58.934690 (+2778052us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540022c9d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:58.941505 (+  6815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3717283712}
I20260709 13:16:58.946978 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1943) took 1463 ms. Trace:
I20260709 13:16:58.947060 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1933) took 1653 ms. Trace:
I20260709 13:16:58.945004 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 1966) took 2354 ms. Trace:
I20260709 13:16:58.949182 10390 rpcz_store.cc:276] 0709 13:16:56.590074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.818100 (+1228026us) service_pool.cc:224] Handling call
0709 13:16:57.818697 (+   597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.069599 (+250902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.943754 (+874155us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540018fe54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:58.944941 (+  1187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505927424}
I20260709 13:16:58.948491 10244 rpcz_store.cc:276] 0709 13:16:57.292346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.967300 (+674954us) service_pool.cc:224] Handling call
0709 13:16:57.967783 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.972208 (+  4425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.972240 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.983183 (+ 10943us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:57.983231 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.943953 (+960722us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b54001dbad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:58.943996 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.945288 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9687936}
I20260709 13:16:58.946326 14869 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.951722 14869 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:58.952201 14869 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.953224 15071 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.955031 15129 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.954042 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.947499 10249 rpcz_store.cc:276] 0709 13:16:57.484030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.496719 (+ 12689us) service_pool.cc:224] Handling call
0709 13:16:58.943828 (+1447109us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54002eca54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:16:58.946891 (+  3063us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340098432}
I20260709 13:16:58.946959 15061 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.959060 14888 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:58.959438 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:58.959961 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:58.959820 14888 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.960363 14512 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.960915 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.961740 14512 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.961524 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.962525 15102 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:58.963948 14537 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:58.964112 15102 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:58.964701 15102 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.965029 15035 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:58.966647 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:16:58.966967 15001 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:58.967461 15001 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:58.967674 15035 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.968451 15001 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.969429 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:58.970782 10967 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:58.965102 15102 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:58.971247 10364 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:16:58.955617 15129 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:58.947256 15089 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:58.969841 15001 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.964411 14537 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:58.954035 15071 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:16:58.970736 15027 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.959843 15061 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:58.971836 14888 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:58.977972 14512 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:58.991920 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 108785us
I20260709 13:16:58.978682 15089 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:16:58.997236 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.003417 10967 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:58.970710 15035 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:16:58.999779 14512 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.013249 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:59.004724 15089 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:59.021063 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.022913 11001 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:59.022362 15023 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:59.024118 14771 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.024719 14888 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.024425 14537 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.025379 14888 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.025693 14537 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.026486 14771 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:59.027580 14888 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.028493 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2823) took 2173 ms. Trace:
I20260709 13:16:59.028867 10242 rpcz_store.cc:276] 0709 13:16:56.855640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.925025 (+ 69385us) service_pool.cc:224] Handling call
0709 13:16:56.939766 (+ 14741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.029632 (+1089866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.018916 (+989284us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540043dad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:59.028434 (+  9518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2372948224}
I20260709 13:16:59.022902 14809 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:59.011667 15086 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:59.016638 14512 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.039594 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:59.016546 14762 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.045400 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.018496 15027 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:59.048799 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.049372 10999 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:59.052754 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:16:59.054136 15083 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.015179 15025 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:59.063802 14983 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.064131 15083 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.064546 14983 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.064915 11000 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.070677 15025 consensus_queue.cc:1243] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:59.071816 15025 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:59.072327 15025 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:59.070709 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.073181 10320 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:59.073537 15025 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.075502 15025 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.071218 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.081144 10250 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:16:59.084590 10999 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:59.091274 14983 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.092814 10319 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:59.093647 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.095331 14683 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:59.098793 10321 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:59.096873 15075 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:59.104327 10994 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:59.107041 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.108035 10997 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:16:59.108605 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.108948 10994 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:59.109257 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:59.111564 11002 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:59.054872 15086 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.111748 10993 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.113958 15086 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.121032 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:59.069331 15004 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.060958 15027 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:59.057390 14762 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.140156 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.140360 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.141070 10997 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:16:59.127238 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44279.5us
I20260709 13:16:59.129604 15129 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.132830 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.133706 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.121307 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:59.138676 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.157313 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:16:59.158463 15035 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:59.159245 15035 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:16:59.160331 15035 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.161140 15127 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.162838 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.163533 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.164216 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.167246 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.147014 15023 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:59.170583 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.171365 15127 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:59.147367 15027 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.147845 15018 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.172744 15018 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:59.173229 15018 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.149513 15086 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:59.150547 14951 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.153012 14762 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:59.164991 10394 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:16:59.180991 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.181839 10395 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.143762 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:16:59.169353 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:16:59.189836 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:59.190447 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.190886 10390 raft_consensus.cc:2410] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:16:59.193553 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.194325 10396 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:16:59.200898 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.201560 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:16:59.208379 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.214359 14683 consensus_queue.cc:1048] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:59.216391 14888 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.217170 14888 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.219717 14888 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:59.228806 14901 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:59.229288 14901 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:59.230237 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.239887 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.204698 14771 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.244041 14771 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.193682 15075 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:59.246613 15075 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.247046 15075 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.207953 15086 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.252641 15086 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.252480 14901 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.255831 15018 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.259349 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.260099 15094 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.261256 10997 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.246649 14869 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.262521 10995 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.263278 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.264215 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.267058 14809 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:59.268285 14809 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:59.268702 14809 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:16:59.271556 10395 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:16:59.200407 14762 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.282676 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:16:59.178184 15068 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:16:59.282362 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.182833 15129 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:16:59.120028 15089 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.254117 14901 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.190184 15004 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:16:59.290926 15018 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:59.292200 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:16:59.305028 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 95580.4us
I20260709 13:16:59.296284 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.297063 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.269681 14809 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.282940 14762 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.308974 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.315662 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.317678 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.283787 14771 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.322016 10392 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:59.297834 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 189920us
I20260709 13:16:59.237370 15121 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:16:59.327297 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.336843 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.332314 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.301699 15000 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.340677 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.302672 15094 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:16:59.337857 10997 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:16:59.336905 10390 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:16:59.339785 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:59.344048 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.344952 10396 raft_consensus.cc:2368] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13.
I20260709 13:16:59.335390 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:16:59.348956 14376 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.349579 14376 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:16:59.350996 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.351959 14376 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:59.352818 10146 catalog_manager.cc:5697] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 9, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.354868 10146 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.356762 10146 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:59.358027 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.352829 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:59.362593 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.364081 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.366392 15089 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:16:59.366842 15098 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:59.367261 15098 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:16:59.367992 10144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 284) took 27446 ms (client timeout 15000 ms). Trace:
I20260709 13:16:59.368263 15098 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.369697 15098 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.328066 14762 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.376529 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.381139 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.383358 14809 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.332785 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:16:59.390326 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 57715.8us
I20260709 13:16:59.393224 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.340833 15000 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.340327 14869 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.327554 14683 consensus_queue.cc:1059] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:16:59.400410 14683 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:59.400792 14683 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:16:59.401737 14683 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.403018 14683 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.405190 10323 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:59.405474 10319 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:59.396550 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:59.406322 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.406667 11000 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:16:59.407233 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.408792 10325 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.413307 15020 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:16:59.414208 15000 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.417815 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.387936 10146 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 13, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.398005 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:59.423307 14869 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:59.424490 14869 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:59.425022 14869 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:16:59.425310 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.425911 10392 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.426162 14869 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.424404 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.398934 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:16:59.428207 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 87182.7us
I20260709 13:16:59.441965 10146 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:16:59.395804 15089 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:59.446295 10396 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:16:59.448892 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:16:59.449832 10323 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:59.427902 14869 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:59.451998 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:59.469640 10146 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.472903 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.478343 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:59.480841 10397 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:59.482928 10250 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:59.482982 10146 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.572820 10998 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:59.574613 10248 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.581094 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.488822 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:16:59.588476 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59894.5us
W20260709 13:16:59.593220 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 114983us
I20260709 13:16:59.455283 15089 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.597131 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:16:59.610714 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.621651 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.610999 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.618074 10146 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 8, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 8 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.623801 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.611167 10323 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:59.618587 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.612032 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:59.626780 10249 raft_consensus.cc:2393] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:59.627681 10250 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:16:59.466367 15020 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:59.630419 10320 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:59.625182 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:59.631392 10317 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:59.632282 10324 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:16:59.656769 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:16:59.629678 10146 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.657537 10395 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:16:59.658567 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.643139 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.643882 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.652244 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.485399 15061 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.633191 15161 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:59.662600 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.663559 10318 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:59.671653 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:16:59.740782 10396 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:59.741438 10397 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:59.672297 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:59.576778 14512 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.466301 15127 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
W20260709 13:16:59.649458 15102 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
I20260709 13:16:59.664757 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.620728 15089 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.487654 14888 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
W20260709 13:16:59.662647 15025 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.587s	user 0.003s	sys 0.008s
I20260709 13:16:59.687412 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:59.486405 15079 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.184s
I20260709 13:16:59.688272 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:16:59.695892 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 98912.3us
I20260709 13:16:59.588266 15004 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:16:59.658378 10146 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 2 to 9, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 9 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:16:59.743018 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.745450 10322 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:16:59.745936 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:16:59.656311 15071 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:16:59.747689 14771 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.853107 10390 raft_consensus.cc:2368] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:16:59.858848 10997 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:16:59.920496 10997 pending_rounds.cc:85] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 8
I20260709 13:16:59.748196 15018 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:59.899564 14762 consensus_meta.cc:287] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
W20260709 13:16:59.761808 14951 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
W20260709 13:16:59.861788 15160 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:16:59.862437 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.951241 10318 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:16:59.670105 15020 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:16:59.854625 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:16:59.368451 10144 rpcz_store.cc:269] 0709 13:16:31.921707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.941945 (+ 20238us) service_pool.cc:224] Handling call
0709 13:16:32.237434 (+295489us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a52090 00007f58c3af0f3a 00007f58c98a71cc 00007f58c99a537e 00007f58c7e662a4 00007f58c7e66232 00007f58c7e66161 00007f58c7e660dc 00007f58c7e65392 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:32.334823 (+ 97389us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b5400260110. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c4640 00007f58c989bb76 00007f58c99a5c3e 00007f58c7e662a4 00007f58c7e66232 00007f58c7e66161 00007f58c7e660dc 00007f58c7e65392 00007f58c1e2348c 00007f58c1e228c6
0709 13:16:59.367730 (+27032907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:50.798872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:50.926580 (+127708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:50.926641 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:16:50.926660 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:51.045657 (+118997us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:51.081126 (+ 35469us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:51.085423 (+  4297us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:51.150159 (+ 64736us) tablet.cc:701] Row locks acquired
0709 13:16:51.150207 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:16:51.150417 (+   210us) write_op.cc:270] Start()
0709 13:16:51.150576 (+   159us) write_op.cc:276] Timestamp: P: 1783603011150350 usec, L: 0
0709 13:16:51.150614 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:16:51.151322 (+   708us) log.cc:844] Serialized 4518 byte log entry
0709 13:16:51.846619 (+695297us) op_driver.cc:464] REPLICATION: finished
0709 13:16:52.731434 (+884815us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c09de0ac 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c751eef0
0709 13:16:52.867795 (+136361us) write_op.cc:301] APPLY: starting
0709 13:16:52.867900 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:52.990889 (+122989us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:52.990934 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:53.159085 (+168151us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:53.159439 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:16:53.159509 (+    70us) write_op.cc:312] APPLY: finished
0709 13:16:53.159961 (+   452us) log.cc:844] Serialized 105 byte log entry
0709 13:16:54.010833 (+850872us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae532a 00007f58c3a6af14 00007f58c3a6aec3 00007f58c3a6ae38 00007f58c3a6adf3 00007f58c3a6a0dc 00007f58c3a93e16 00007f58c3a7bcbb 00007f58c3a6639d 00007f58c3a69d75
0709 13:16:54.189394 (+178561us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c09de0ac 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b
0709 13:16:54.474618 (+285224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.485955 (+ 11337us) write_op.cc:454] Released schema lock
0709 13:16:54.706979 (+221024us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:54.804745 (+ 97766us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:54.812222 (+  7477us) write_op.cc:454] Released schema lock
0709 13:16:55.141848 (+329626us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18000e1100. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
Metrics: {"mutex_wait_us":1364801,"reported_tablets":46,"spinlock_wait_cycles":185367168,"child_traces":[["op",{"apply.queue_time_us":994564,"apply.run_cpu_time_us":53533,"apply.run_wall_time_us":1898776,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":380984,"prepare.run_cpu_time_us":30654,"prepare.run_wall_time_us":702762,"raft.queue_time_us":161909,"raft.run_cpu_time_us":16419,"raft.run_wall_time_us":2232058,"replication_time_us":660299,"spinlock_wait_cycles":141473024,"thread_start_us":3004238,"threads_started":5,"wal-append.queue_time_us":1654378,"wal-append.run_cpu_time_us":30818,"wal-append.run_wall_time_us":2438532}]]}
I20260709 13:16:59.860553 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:16:59.848340 15124 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:16:59.961793 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:16:59.962450 10248 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.890313 10242 raft_consensus.cc:2393] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:16:59.910442 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:16:59.966775 10394 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.000s
W20260709 13:16:59.856165 15159 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:16:59.917495 10146 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 11, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.921128 10997 pending_rounds.cc:107] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:59.973728 10997 raft_consensus.cc:2889] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:59.855167 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.914795 14683 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.006s
I20260709 13:16:59.967974 10394 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
W20260709 13:16:59.970312 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 60002.8us
I20260709 13:16:59.982738 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:16:59.904130 15121 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.934281 15075 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.004s
I20260709 13:16:59.764226 15102 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:16:59.988955 10391 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:16:59.923825 15018 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:00.001106 15035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.015s	sys 0.023s
I20260709 13:17:00.004498 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:00.006901 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:16:59.949388 14981 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.962834 15001 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:00.022743 11000 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:59.924099 15000 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.016701 10146 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 13 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:00.025206 10250 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:17:00.006440 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 342337us
I20260709 13:17:00.012749 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:00.032776 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 352112us
I20260709 13:16:59.949102 14762 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.005296 14808 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.010704 15018 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.983670 14771 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:00.035307 14901 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:17:00.059816 10244 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:59.961731 15124 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.032478 15083 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.994357 15071 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.064280 10395 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:00.070091 10146 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.074270 10245 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:00.038162 15161 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:00.004345 15075 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.066256 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.083071 10250 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:17:00.085507 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.086592 14983 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:00.086961 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.088112 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.088335 14376 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.089043 14376 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.089269 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:00.088114 14983 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:00.090425 14683 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:00.090883 14683 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.091230 14683 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.095911 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.096544 14537 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:00.096953 14537 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:00.097646 15083 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.098748 15075 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.099509 14512 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.100210 15020 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:00.100822 15165 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.101064 14512 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.101675 15165 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.028051 14981 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.104117 15165 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.104413 14981 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:00.105490 15163 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:17:00.110118 15102 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.048260 14808 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:00.111196 15166 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:17:00.115756 15000 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.116227 15176 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.116837 15176 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.119158 14771 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:00.118012 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.014533 15004 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:17:00.100210 15083 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:00.063161 10967 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:00.122917 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59870.5us
I20260709 13:17:00.090169 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.033317 15001 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.130146 10316 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:00.084941 10146 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.035025 15121 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.071437 15035 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.143872 10396 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:17:00.136838 10392 consensus_meta.cc:287] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.002s
I20260709 13:17:00.226517 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:00.097822 14537 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.207392 15020 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.101778 14512 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.242815 14512 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:00.131611 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 136479us
I20260709 13:17:00.243783 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:00.244424 10249 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.245296 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.135886 10288 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.215725 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1056) took 1059 ms. Trace:
I20260709 13:17:00.219141 10245 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:00.217219 10146 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 13 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:00.222960 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:00.223330 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:00.143784 15102 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:00.230047 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:00.236094 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:00.257411 10392 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:17:00.240315 15098 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.000s
I20260709 13:17:00.240163 15020 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:00.257923 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 122267us
I20260709 13:17:00.247720 10994 rpcz_store.cc:276] 0709 13:16:59.150938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.151272 (+   334us) service_pool.cc:224] Handling call
0709 13:16:59.151602 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.151818 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.151843 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.152389 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.283565 (+131176us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:59.283652 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.283793 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.210322 (+926529us) raft_consensus.cc:1685] finished
0709 13:17:00.210349 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.210522 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":130656,"threads_started":1,"wal-append.queue_time_us":278532}
I20260709 13:17:00.260862 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.263769 15121 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.311029 14976 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:00.209949 15083 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:17:00.222114 15071 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.267674 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:00.267320 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 171501us
I20260709 13:17:00.280167 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:00.272518 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 255940us
I20260709 13:17:00.273737 15023 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:00.272131 10146 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 13 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:00.261153 14888 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:00.259550 15102 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:00.354650 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.351317 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 901) took 1520 ms. Trace:
I20260709 13:17:00.362707 10391 rpcz_store.cc:276] 0709 13:16:58.830862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.830998 (+   136us) service_pool.cc:224] Handling call
0709 13:16:58.844130 (+ 13132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.996302 (+1152172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.351074 (+354772us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002fe754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:00.351255 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584820608}
I20260709 13:17:00.353896 10146 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:00.302498 15167 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
I20260709 13:17:00.273398 15178 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:00.366407 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 98850.1us
W20260709 13:17:00.366537 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 120829us
I20260709 13:17:00.386976 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:00.388166 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:00.364054 10393 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.355253 15023 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.394848 10146 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:00.368697 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.371367 10241 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:00.380522 15027 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.301294 15075 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:00.404654 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:00.403321 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:00.406364 15023 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.301694 15035 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:17:00.407820 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.357966 14504 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.302050 15161 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:17:00.411154 10243 raft_consensus.cc:1275] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:00.361812 15098 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.365226 15102 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:00.411144 10146 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.435918 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:00.437759 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 192511us
I20260709 13:17:00.439831 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:00.424996 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.382244 14976 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:00.370999 14951 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.367974 15071 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:00.411403 15129 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:00.413972 15075 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.450209 10241 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:00.426403 14376 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:00.453832 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:00.489899 10243 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.451712 10146 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:00.457412 15127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.034s
I20260709 13:17:00.439074 14762 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:00.510558 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 102829us
I20260709 13:17:00.439656 14888 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.417385 14983 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:17:00.508807 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.438921 15176 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.417330 14981 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:00.532508 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.419144 15083 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:17:00.529595 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.530406 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:00.508354 15127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.034s
I20260709 13:17:00.468400 15075 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:00.426797 14504 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.535511 10241 raft_consensus.cc:2410] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:17:00.535543 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 95786.5us
I20260709 13:17:00.537998 15186 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.539911 15182 raft_consensus.cc:2764] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:00.535864 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:00.547722 15169 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.464s	user 0.000s	sys 0.001s
I20260709 13:17:00.532100 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:00.549520 15198 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.467295 14976 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:00.489354 14376 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.440994 15098 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.529877 10146 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 12, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.532100 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:00.466467 14951 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.512161 14683 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:00.565670 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 177430us
I20260709 13:17:00.528357 14901 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:00.667075 10322 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.668031 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.616099 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:00.629041 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2406) took 1309 ms. Trace:
I20260709 13:17:00.616397 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:00.669003 10390 rpcz_store.cc:276] 0709 13:16:59.319230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.357645 (+ 38415us) service_pool.cc:224] Handling call
0709 13:17:00.628773 (+1271128us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54000109d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:00.628972 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128627968}
I20260709 13:17:00.669759 10998 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:17:00.572443 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 219194us
I20260709 13:17:00.616919 10995 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.612924 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.675330 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:00.570616 14869 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.094s	user 0.008s	sys 0.004s
W20260709 13:17:00.678470 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 43706us
I20260709 13:17:00.680691 10999 raft_consensus.cc:2410] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:00.682824 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.607139 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:00.551152 15001 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:00.618585 15184 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
W20260709 13:17:00.621280 15183 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:17:00.647799 15089 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.005s
I20260709 13:17:00.690076 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.696997 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1967) took 1118 ms. Trace:
W20260709 13:17:00.676728 14809 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.290s	user 0.005s	sys 0.008s
W20260709 13:17:00.620710 15181 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:00.672019 14376 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:00.723519 11001 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:00.600622 15168 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.629273 15124 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.618788 15177 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:00.551678 15129 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:17:00.621609 15023 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.704682 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.698872 15200 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:00.677486 15182 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.716735 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.686965 10146 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:00.730125 10248 consensus_meta.cc:287] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.000s
I20260709 13:17:00.747635 10248 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:00.748313 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54378 (request call id 1028) took 1072 ms. Trace:
I20260709 13:17:00.716109 15020 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.710963 14981 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:00.619766 15185 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 13:17:00.700793 15071 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:00.699556 14983 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:00.590165 15186 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.686444 15112 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:17:00.710127 15001 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:00.744349 15121 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:17:00.751160 15018 consensus_meta.cc:287] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.001s
I20260709 13:17:00.722571 15089 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.769137 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2851) took 1295 ms. Trace:
I20260709 13:17:00.758842 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:00.774266 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.784051 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1969) took 1164 ms. Trace:
I20260709 13:17:00.674803 14901 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.749421 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1050) took 1641 ms. Trace:
I20260709 13:17:00.715698 15035 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:00.755332 15182 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.796514 10996 rpcz_store.cc:276] 0709 13:16:59.107951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.109649 (+  1698us) service_pool.cc:224] Handling call
0709 13:16:59.110001 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:59.110564 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:59.208965 (+ 98401us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.127727 (+918762us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:00.226569 (+ 98842us) log.cc:844] Serialized 52 byte log entry
0709 13:17:00.226777 (+   208us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:00.227094 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.236300 (+  9206us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.377015 (+140715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.377104 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.628061 (+250957us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b18002e3ea0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:17:00.749185 (+121124us) raft_consensus.cc:1685] finished
0709 13:17:00.749208 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.749350 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51689,"prepare.queue_time_us":174807,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":150,"raft.queue_time_us":488180,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":32628,"spinlock_wait_cycles":53536896,"thread_start_us":1011809,"threads_started":4,"wal-append.queue_time_us":485921}
I20260709 13:17:00.741437 15197 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.606995 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75f247057a16492c8757cbf337e8b240"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:00.751727 10242 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.751813 10146 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:00.803939 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45195.4us
W20260709 13:17:00.802150 10249 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.001s
W20260709 13:17:00.736133 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 253303us
I20260709 13:17:00.699420 15025 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:00.795797 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:00.764096 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1966) took 1185 ms. Trace:
I20260709 13:17:00.752619 15177 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.808696 10146 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.780761 14888 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.810135 14888 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:00.811024 15177 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.810822 10146 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 9, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 9 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.811870 15200 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:00.812847 15213 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:00.813314 15213 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:00.813094 10146 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.748714 10248 rpcz_store.cc:276] 0709 13:16:59.676181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.923731 (+247550us) service_pool.cc:224] Handling call
0709 13:17:00.748251 (+824520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.813934 15124 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.814401 15124 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:00.814875 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.815340 15124 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.816118 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.761536 15023 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.796357 10245 rpcz_store.cc:276] 0709 13:16:59.619939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.302037 (+682098us) service_pool.cc:224] Handling call
0709 13:17:00.355947 (+ 53910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.375694 (+ 19747us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:00.375728 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.397005 (+ 21277us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.653131 (+256126us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:00.653192 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.653292 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.783799 (+130507us) raft_consensus.cc:1685] finished
0709 13:17:00.783819 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.783987 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115185,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":38825,"thread_start_us":201739,"threads_started":1,"wal-append.queue_time_us":319677}
I20260709 13:17:00.790117 15020 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.759114 15027 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:00.802320 14901 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.819180 15086 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:00.819494 10245 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:00.803761 15018 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.820266 15175 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:00.820708 15175 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:00.821880 15018 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:00.754249 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49604.8us
I20260709 13:17:00.836005 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.745595 15168 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.843274 10322 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:00.805835 10249 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:00.813784 15089 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.791760 10247 rpcz_store.cc:276] 0709 13:16:59.473672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.473874 (+   202us) service_pool.cc:224] Handling call
0709 13:16:59.573032 (+ 99158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.627337 (+ 54305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.627380 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.686866 (+ 59486us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.157768 (+470902us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:00.157826 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.157924 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.768909 (+610985us) raft_consensus.cc:1685] finished
0709 13:17:00.768930 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.769076 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17356,"raft.queue_time_us":38688,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":305018,"threads_started":1,"wal-append.queue_time_us":674177}
I20260709 13:17:00.811071 14888 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.845999 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.846436 14888 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.846843 10247 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:00.847836 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.848407 10247 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:00.848526 14869 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.849088 14869 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.768661 15186 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.818830 15061 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:00.787022 14809 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.822453 10246 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.756326 14762 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:00.803925 10393 raft_consensus.cc:606] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:00.858825 10393 raft_consensus.cc:614] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.823175 15068 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.824258 14951 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.823662 10146 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 10, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.819675 15127 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:00.861018 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:00.861707 11002 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.825361 14504 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:00.825979 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.825398 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1053) took 1707 ms. Trace:
I20260709 13:17:00.864671 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:00.826292 15025 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.827193 15188 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:00.830475 14683 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.856989 15086 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.778409 14981 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.777558 14808 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.856005 15061 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:00.814186 15213 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.902925 15061 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.903789 14981 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:00.904228 15061 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.864712 15127 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:00.907222 15127 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.908934 15127 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:00.821558 15175 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.805666 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.838028 10399 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:00.808521 10250 rpcz_store.cc:276] 0709 13:16:59.578388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.131023 (+552635us) service_pool.cc:224] Handling call
0709 13:17:00.208268 (+ 77245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.208655 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.208680 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.209149 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.372450 (+163301us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.372502 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.372590 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.763861 (+391271us) raft_consensus.cc:1685] finished
0709 13:17:00.763884 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.764032 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3999,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7766,"thread_start_us":162915,"threads_started":1,"wal-append.queue_time_us":437973}
W20260709 13:17:00.911514 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 105914us
I20260709 13:17:00.912164 10250 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:00.849632 11001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37924 (request call id 968) took 1401 ms (client timeout 1596 ms). Trace:
I20260709 13:17:00.852248 10247 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.862411 10213 leader_election.cc:400] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13.
I20260709 13:17:00.913908 10213 leader_election.cc:403] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:00.810758 15182 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:00.916035 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:00.916356 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 367591us
I20260709 13:17:00.860960 15068 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:00.874577 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:00.865507 10995 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:00.921305 10317 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.922284 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:00.876856 15025 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:00.885429 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:00.856182 15191 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:17:00.885653 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 988) took 1498 ms. Trace:
I20260709 13:17:00.926362 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:00.857475 15020 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:00.896327 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:00.932770 10324 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
W20260709 13:17:00.933341 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 89294us
I20260709 13:17:00.897164 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:00.934198 10325 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:00.898408 10316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 798) took 1481 ms (client timeout 1734 ms). Trace:
I20260709 13:17:00.859841 15083 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.934886 10316 rpcz_store.cc:269] 0709 13:16:59.405119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.406056 (+   937us) service_pool.cc:224] Handling call
0709 13:17:00.886387 (+1480331us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54000cc454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:00.886526 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640889728}
I20260709 13:17:00.802773 14976 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.939674 15083 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.856645 15197 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.942013 15083 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:00.942528 15197 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.861842 10146 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 6 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:00.913302 11001 rpcz_store.cc:269] 0709 13:16:59.448100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.448606 (+   506us) service_pool.cc:224] Handling call
0709 13:17:00.849454 (+1400848us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400469454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:00.849554 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842313088}
I20260709 13:17:00.876187 14762 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.876503 15089 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.831516 15075 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.881821 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1968) took 1301 ms. Trace:
I20260709 13:17:00.959412 10242 rpcz_store.cc:276] 0709 13:16:59.580148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.112622 (+532474us) service_pool.cc:224] Handling call
0709 13:17:00.748252 (+635630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.804246 (+ 55994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.881341 (+ 77095us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54001dbfd0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:00.881529 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460915584}
I20260709 13:17:00.926326 10322 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.930068 15079 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:00.896865 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:00.934540 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.935833 15020 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.942056 10250 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:00.864719 10993 rpcz_store.cc:276] 0709 13:16:59.118103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.118215 (+   112us) service_pool.cc:224] Handling call
0709 13:16:59.134615 (+ 16400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.135066 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.135111 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.139009 (+  3898us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.271735 (+132726us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:59.271772 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.271837 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.824550 (+1552713us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b24000d4fa8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c08819c4 00007f58c087facb 00007f58c0a3adc9 00007f58c0a3aa55 00007f58c0a39fb0 00007f58c36b0488 00007f58c36b0be8 00007f58c3688398 00007f58c368376a 00007f58c3682bb6
0709 13:17:00.825109 (+   559us) raft_consensus.cc:1685] finished
0709 13:17:00.825134 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.825338 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":877,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":26319,"spinlock_wait_cycles":64739712,"thread_start_us":124896,"threads_started":1,"wal-append.queue_time_us":428777}
I20260709 13:17:00.919704 10243 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:00.889298 14809 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.919258 15023 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:00.922447 14981 consensus_queue.cc:1048] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:17:00.953830 15083 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:17:00.958350 15089 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.944612 10146 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.926896 10997 rpcz_store.cc:276] 0709 13:16:59.387648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.387821 (+   173us) service_pool.cc:224] Handling call
0709 13:16:59.402555 (+ 14734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.987488 (+584933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.885314 (+897826us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540028f0d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:00.885571 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023749376}
I20260709 13:17:00.960779 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:00.901010 14376 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:00.924127 15086 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.942176 15204 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:00.966838 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.897598 15188 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:00.925660 15094 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:00.953441 15200 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:01.028746 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 61982.2us
I20260709 13:17:01.042798 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:00.958093 14762 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.035519 10246 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
W20260709 13:17:00.965348 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 46525.1us
I20260709 13:17:00.968921 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.005357 10322 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:01.037355 10146 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:01.031445 15102 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 13:17:00.965548 15018 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.078204 10213 leader_election.cc:400] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:01.082191 10213 leader_election.cc:403] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:00.950151 14901 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.087512 10323 raft_consensus.cc:2368] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15.
I20260709 13:17:00.988816 15020 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:01.089461 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 120654us
I20260709 13:17:01.008436 15179 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13.
I20260709 13:17:01.016309 15197 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.041227 15035 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:01.042774 14869 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.098133 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.102196 10316 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:01.094427 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.096072 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.098891 10319 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:00.991954 15176 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:17:01.107586 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:01.108268 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.977546 15211 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:17:01.076779 15079 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:01.087132 15192 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:01.076547 15200 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:01.110759 11001 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:01.101526 10322 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:01.014526 15209 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:17:01.079663 15185 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:01.091004 15161 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:01.153965 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:01.052841 15023 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.006856 15221 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:17:01.120676 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:01.160667 10993 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:01.122445 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:01.007313 15025 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.155495 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:01.156424 10399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2408) took 1836 ms (client timeout 2005 ms). Trace:
I20260709 13:17:01.157161 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.087855 15102 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.086725 15071 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:01.113744 14976 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.161561 10998 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:01.098513 15035 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:01.154098 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:01.173089 11000 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
W20260709 13:17:01.163795 10399 rpcz_store.cc:269] 0709 13:16:59.320377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.343657 (+ 23280us) service_pool.cc:224] Handling call
0709 13:17:01.151761 (+1808104us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002dda54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:01.156326 (+  4565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118984576}
W20260709 13:17:01.179378 15217 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:17:01.163836 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.181826 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 1973) took 1064 ms. Trace:
I20260709 13:17:01.154927 15192 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:01.187096 10241 rpcz_store.cc:276] 0709 13:17:00.117200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.688544 (+571344us) service_pool.cc:224] Handling call
0709 13:17:00.689196 (+   652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.722955 (+ 33759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.722993 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.744334 (+ 21341us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.952434 (+208100us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.952490 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.952616 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.181530 (+228914us) raft_consensus.cc:1685] finished
0709 13:17:01.181559 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.181748 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13312,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":25250,"thread_start_us":173556,"threads_started":1,"wal-append.queue_time_us":247996}
I20260709 13:17:01.164891 15205 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:01.183374 15035 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.172863 15168 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.180660 15171 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:01.200438 15198 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.207755 15025 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.209362 15221 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.211539 15222 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.242379 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:01.244149 15218 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:17:00.714643 10244 rpcz_store.cc:276] 0709 13:16:59.578622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.112604 (+533982us) service_pool.cc:224] Handling call
0709 13:17:00.113006 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.113205 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:00.353986 (+240781us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.696477 (+342491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.696692 (+   215us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:00.696743 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.696808 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.696938 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98690,"prepare.queue_time_us":94525,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":105192,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6915,"spinlock_wait_cycles":35456,"thread_start_us":464356,"threads_started":2}
I20260709 13:17:01.246076 15102 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.245873 15221 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.247298 15192 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.248605 15221 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.253053 15168 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:01.253705 15168 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.254271 15178 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:01.254688 15178 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:01.255649 15178 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.257424 15230 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.199270 14976 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:01.286825 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 184085us
I20260709 13:17:01.280454 10316 raft_consensus.cc:2368] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
W20260709 13:17:01.303741 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.299340 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.223001 15171 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.315997 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:01.327447 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.327481 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.315706 15124 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.329854 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.330513 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.340612 10395 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:01.341217 10993 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:01.342970 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.334280 10317 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:01.336369 11002 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
W20260709 13:17:01.328781 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 175394us
I20260709 13:17:01.236694 15165 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:01.344889 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:01.347870 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.348138 10317 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:01.259883 15089 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.351851 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:01.326994 15171 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:01.353893 10316 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:01.318851 15102 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.326447 15190 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.351989 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.361969 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.221319 15205 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.368840 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:01.372156 10393 raft_consensus.cc:606] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.372195 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:01.259109 15200 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.350332 14808 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.355216 15061 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:01.375439 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:01.355070 14809 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.354741 15000 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.355332 15177 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:01.380241 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.380501 15188 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.383255 15098 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.359215 15127 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:01.349828 10317 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:01.356189 15239 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:01.428210 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52892.7us
I20260709 13:17:01.367287 15089 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:01.258179 15230 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.435421 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:01.295763 15222 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.239468 15079 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.376901 15198 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:01.355436 15165 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.371491 14683 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.388547 15226 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:01.445643 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 83771.1us
I20260709 13:17:01.427506 15177 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:01.441673 15086 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.391058 15061 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.370606 15102 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.434700 15185 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.436314 15168 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.459447 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:01.448439 15023 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.470911 15061 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.475651 15230 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.479089 15020 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.495352 15020 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.445029 15127 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.484385 15222 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.486033 15205 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.487321 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.447278 14771 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.491484 15102 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:01.462322 15235 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:01.505301 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:01.459635 15177 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.509055 10317 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:01.459870 15216 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.448988 15209 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:17:01.449127 15018 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:17:01.516381 15165 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.516920 15215 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:01.508082 15168 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.511324 14771 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.510376 15226 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.523586 10395 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:01.531903 10399 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:01.459820 15231 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.524216 15000 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.530354 15215 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.535560 15226 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.537889 15215 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.545687 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.548234 10395 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:01.538210 15226 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.487219 14683 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.541203 15000 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.557178 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:01.562923 15061 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.531921 15216 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.542753 15231 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.572530 15178 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.577342 15035 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.580897 14771 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.582695 15216 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.584282 15000 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.590339 15226 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.592792 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:01.603081 10397 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:01.602977 15226 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.603752 15035 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:01.604337 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.605129 15226 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.605996 10247 raft_consensus.cc:1240] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:01.604337 15035 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.592871 15215 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.607753 15215 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.595117 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.611320 10390 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:01.612190 15061 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.598588 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.599294 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.601658 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:01.614049 10246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 1974) took 1496 ms (client timeout 1515 ms). Trace:
I20260709 13:17:01.614468 10392 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:01.614943 10324 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:17:01.614594 10246 rpcz_store.cc:269] 0709 13:17:00.117524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.214269 (+ 96745us) service_pool.cc:224] Handling call
0709 13:17:01.613866 (+1399597us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54002eb654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:01.613981 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300209920}
I20260709 13:17:01.616041 14683 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.616640 10397 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:01.614969 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.617725 10395 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:01.602029 10393 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:01.602342 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.602434 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.622869 10394 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:01.622936 10392 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:01.628580 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.618943 10391 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:01.637750 10213 leader_election.cc:400] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:01.638182 10213 leader_election.cc:403] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:01.638497 10399 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:01.629328 10241 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:17:01.643410 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.647383 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.648048 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.648922 10317 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:01.650069 10290 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.654948 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:01.655582 10247 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:01.651196 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.661808 10399 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:01.663547 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:01.655187 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.664966 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:01.667034 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.653482 15061 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:17:01.669111 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:01.670497 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.671398 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.668709 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.673355 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.675158 10391 raft_consensus.cc:2410] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:01.676900 10392 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:01.678964 15089 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:01.679935 15075 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.654655 15000 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:01.682677 15000 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:01.683265 15215 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.654341 15018 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:01.683629 15000 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.619452 15035 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:01.668315 15225 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.490s	user 0.000s	sys 0.006s
I20260709 13:17:01.674069 10316 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:01.695837 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.697151 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:01.696077 10244 raft_consensus.cc:1240] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:01.701468 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.701814 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:01.686093 15035 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:01.702860 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51736.4us
I20260709 13:17:01.653646 15216 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.704049 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:01.659672 15222 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:01.704807 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:01.704860 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.750203 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.753618 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.754940 10248 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:01.755091 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.757113 10247 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:01.749792 15216 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.666636 15209 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:17:01.669418 15129 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:17:01.764706 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.669309 15185 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:17:01.750048 15089 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:01.766772 15089 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.767820 15213 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.769816 14376 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.770982 14376 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.771453 14376 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:01.771783 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:01.772877 15177 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.768971 15089 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.773419 14376 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.773736 15222 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:01.764755 15209 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:01.766151 15185 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:01.772876 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.776659 15239 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.797254 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.755160 15018 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.794479 10320 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:17:01.658886 15233 consensus_queue.cc:1059] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:01.766081 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:01.779182 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.784821 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.784727 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:01.708935 14683 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:01.747208 15230 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:01.792460 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.784132 15171 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.790007 15209 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:01.810127 10393 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:01.796097 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.793092 15185 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:01.799893 10244 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:01.682695 15231 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:01.762121 15216 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.819229 10321 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:01.821048 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:01.829994 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.704996 14504 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.830888 10242 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:01.832764 10399 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:17:01.833804 10316 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:01.703877 15075 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:01.704885 15127 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.806857 14683 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.805794 15018 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:01.861032 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:01.959959 10247 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:01.869338 14901 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:01.882264 15174 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:01.908468 15200 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.834712 14504 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:01.910971 10323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2689) took 1429 ms (client timeout 1630 ms). Trace:
W20260709 13:17:01.911751 15240 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.587s	user 0.000s	sys 0.003s
I20260709 13:17:01.912328 15161 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:01.913167 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.913625 15237 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.596s	user 0.000s	sys 0.003s
I20260709 13:17:01.862627 15231 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:01.913938 14537 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.916325 15068 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:01.930382 14951 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:01.819938 15221 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:01.796128 15222 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:01.947106 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 100061us
I20260709 13:17:02.023313 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:01.947592 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 95568us
W20260709 13:17:01.964448 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 215764us
I20260709 13:17:01.910315 15129 raft_consensus.cc:3055] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:02.028630 15129 raft_consensus.cc:740] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:02.029546 15129 consensus_queue.cc:260] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.030614 15129 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:02.031561 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.032317 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:02.032658 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.032850 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.033425 15233 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.033871 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:01.834074 15239 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.034605 11002 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:02.034940 15233 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:02.035002 15239 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.035548 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.035719 15233 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.036167 15233 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:02.036538 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:01.989555 15161 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:02.037444 15239 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:01.965649 15018 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.038136 15161 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.039207 15161 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.042542 15206 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:02.043495 15253 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 13:17:01.820273 15226 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:17:02.045104 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:02.047564 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:02.051318 15035 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.990382 14504 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.036183 10998 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:17:01.996757 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:01.966305 14683 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.019460 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.020660 11000 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.027690 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:01.984258 10323 rpcz_store.cc:269] 0709 13:17:00.481522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.509589 (+ 28067us) service_pool.cc:224] Handling call
0709 13:17:01.910741 (+1401152us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002c7ed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:01.910906 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955648768}
I20260709 13:17:02.062618 10995 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:02.072294 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.072840 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.994009 15178 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:02.075790 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.077196 10396 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:02.080864 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:02.081235 10392 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:02.081420 10390 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:02.083328 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:01.961339 15127 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:02.080156 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.025672 15231 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:02.085345 10399 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:02.085906 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.086722 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:02.087029 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:02.095448 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.095909 10393 raft_consensus.cc:606] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:02.087317 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:02.096484 10393 raft_consensus.cc:614] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:02.096654 10394 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.090559 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.081526 10999 raft_consensus.cc:2376] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14. Re-sending same reply.
I20260709 13:17:02.097436 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:02.096120 10322 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:02.106245 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:01.983558 15174 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.113687 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.052093 15035 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:01.990206 15200 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.130532 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.131127 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:02.118670 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:02.120304 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.071149 14771 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:02.075811 15229 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.134938 10392 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:02.134073 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.107720 15127 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.140471 10321 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:02.129937 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.169924 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.140868 10999 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:02.138612 15001 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:02.122738 15240 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:02.057749 14951 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.106417 15068 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.155442 10394 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:01.982975 15209 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.077508 15239 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:17:02.076153 15102 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:17:02.188839 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.174934 10997 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
W20260709 13:17:02.191510 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 61062.4us
I20260709 13:17:02.193320 10392 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:02.193678 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.211696 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:01.995083 15185 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.141242 14976 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.103621 15178 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.203673 10994 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:02.229446 10319 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:02.199960 15252 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:17:02.233367 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.186939 15075 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:02.235544 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.237000 10392 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:02.233680 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:02.253336 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.170866 15229 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.260118 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.268611 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:02.255977 15190 consensus_meta.cc:287] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.887s	user 0.002s	sys 0.010s
I20260709 13:17:02.264418 10319 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:02.285674 14951 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:02.285804 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:02.290542 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:02.294137 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.260066 15261 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.305617 10997 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:02.295640 15174 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:02.313138 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.198920 15189 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.008s	sys 0.007s
I20260709 13:17:02.279279 15190 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.266968 14976 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:17:02.260070 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:02.328642 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 68661.1us
I20260709 13:17:02.329592 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:02.321796 15189 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.008s	sys 0.007s
I20260709 13:17:02.316915 14376 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.337117 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:02.261842 15231 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:02.326613 15192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.023s	sys 0.058s
I20260709 13:17:02.319469 15177 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:02.351922 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.352375 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:02.353724 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.330569 15243 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:02.360918 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:02.348943 15192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.023s	sys 0.059s
W20260709 13:17:02.347915 15254 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:17:02.358704 15230 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:17:02.347519 15124 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:02.344815 15102 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:02.312999 15261 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.350802 14376 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.375394 15200 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:02.375936 15243 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:02.394953 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 341232us
I20260709 13:17:02.389078 15124 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:02.395967 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:02.403306 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:02.404345 15161 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:02.404837 15198 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.405393 15198 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.405848 15198 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:02.390157 15257 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:17:02.377842 15216 consensus_queue.cc:1059] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:02.397060 15124 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.412248 15124 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:02.229949 15061 consensus_queue.cc:1175] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73825599c2644b898cebaafbccd86e99" responder_term: 15 status { last_received { term: 13 index: 9 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:02.424787 15229 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.426398 15192 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:02.416622 14976 raft_consensus.cc:3055] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:02.417071 15178 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:02.437252 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 405207us
I20260709 13:17:02.444316 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.447422 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.431507 14771 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.449646 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.434862 15161 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.452293 10965 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.021s	sys 0.008s
I20260709 13:17:02.454845 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:02.455267 10965 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.021s	sys 0.008s
W20260709 13:17:02.455830 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 678171us
I20260709 13:17:02.456023 10247 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:02.459461 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 295441us
I20260709 13:17:02.435926 15171 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.436455 14976 raft_consensus.cc:740] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:02.447454 15260 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
W20260709 13:17:02.447187 15258 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:17:02.479313 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.480846 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:17:02.535651 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 54878.9us
I20260709 13:17:02.536902 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:02.488085 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.489444 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.490698 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.494161 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.495788 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.538911 10243 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 8.
I20260709 13:17:02.539089 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.496529 10245 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:02.497679 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.540959 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.541898 10250 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:02.543118 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.543620 10244 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:02.504951 15272 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:02.520838 14976 consensus_queue.cc:260] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.514532 15261 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.544018 10241 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:02.471578 15175 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.552918 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:02.435055 15192 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.544059 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:02.442797 15127 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.559350 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:02.573164 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:02.552822 15233 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:17:02.546064 15004 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:02.546414 15250 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.545831 15215 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:02.473098 14771 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.615623 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:02.623039 10394 raft_consensus.cc:2376] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12. Re-sending same reply.
I20260709 13:17:02.474617 15161 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.626286 15161 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.627063 15161 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:02.627683 15161 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.633014 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:02.637284 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.457305 15243 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.575493 15165 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:02.581636 15171 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:02.617720 15258 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:02.581627 15000 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:02.602591 15004 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:02.655128 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.643747 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.619673 15215 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.654765 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.656116 10393 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:02.576673 14901 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:02.558393 15272 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:02.686890 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 326070us
I20260709 13:17:02.689334 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:02.690867 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:02.700184 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.644390 15171 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:02.722872 10249 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:02.669332 15004 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.654618 14376 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.600883 15233 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.672513 15161 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:02.644351 15165 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:02.687177 15215 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:02.702003 15179 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.008s
I20260709 13:17:02.698444 15230 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:02.621743 15250 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:02.729557 15229 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:02.746587 10396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.007s
W20260709 13:17:02.762005 10396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.007s
I20260709 13:17:02.768182 10325 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:02.750029 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 59260.6us
I20260709 13:17:02.741040 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:02.727914 15171 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:02.775913 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:17:02.710047 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 354478us
W20260709 13:17:02.758503 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 289895us
W20260709 13:17:02.760147 15129 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.000s
I20260709 13:17:02.779037 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2423) took 1256 ms. Trace:
W20260709 13:17:02.787420 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.788383 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.795138 10993 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:17:02.755784 15179 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.001s	sys 0.008s
I20260709 13:17:02.790702 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.797497 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.742444 15165 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.823283 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:02.760645 15230 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:02.792891 10398 rpcz_store.cc:276] 0709 13:17:01.523057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.523197 (+   140us) service_pool.cc:224] Handling call
0709 13:17:01.523538 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.523958 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:01.645308 (+121350us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.859891 (+214583us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.976351 (+116460us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.976801 (+   450us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:01.976879 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.977005 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.778724 (+801719us) raft_consensus.cc:1685] finished
0709 13:17:02.778762 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.778954 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3466,"prepare.queue_time_us":152762,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":4935,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":102922,"thread_start_us":268736,"threads_started":2,"wal-append.queue_time_us":541207}
I20260709 13:17:02.835975 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:02.868844 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:02.784337 14376 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.907084 10997 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:17:02.872054 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 74943.5us
I20260709 13:17:02.876845 15297 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:02.878762 15288 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:02.879298 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 56140.2us
I20260709 13:17:02.876745 14771 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:02.883435 15282 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:17:02.883311 15127 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:02.884157 15272 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:02.891069 15280 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:02.892275 15233 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:02.790448 15161 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.797490 15268 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.899392 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.899266 15250 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:02.900305 15179 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.023602 15179 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:02.902197 15275 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.026712 15275 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.029699 15275 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:02.902856 15213 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.135s	user 0.011s	sys 0.003s
W20260709 13:17:02.903337 15018 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.865s	user 0.009s	sys 0.004s
I20260709 13:17:03.030867 10324 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:17:03.031522 15001 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.031064 15018 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.031991 15001 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.032109 15161 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:02.903961 15283 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:17:02.904592 15269 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:17:02.904838 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 813) took 1255 ms. Trace:
W20260709 13:17:02.905602 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.930646 15288 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.870502 10393 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:02.912083 14901 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.914577 15209 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:02.832880 15230 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.928282 10290 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:02.935140 15020 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:02.936092 14888 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:02.975790 15278 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:17:02.977676 15292 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:17:02.979583 15301 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:17:02.983968 15289 log.cc:927] Time spent T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:17:02.985459 15198 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
W20260709 13:17:02.990428 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.001639 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 236513us
W20260709 13:17:03.008178 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.020445 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.014928 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:03.000254 14683 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.911s	user 0.014s	sys 0.000s
I20260709 13:17:02.836740 10394 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:17:03.058736 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.038555 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.279405 10997 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:03.040546 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.108994 10317 rpcz_store.cc:276] 0709 13:17:01.648990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.704568 (+ 55578us) service_pool.cc:224] Handling call
0709 13:17:02.904615 (+1200047us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54000cc454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:02.904782 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289351552}
W20260709 13:17:03.115973 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 187772us
I20260709 13:17:03.281309 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:03.202064 15000 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:03.283131 15000 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:03.284550 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.292685 10997 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:17:03.012730 15124 consensus_meta.cc:287] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.002s
I20260709 13:17:03.202318 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:03.034134 15018 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.160903 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2019) took 1034 ms. Trace:
I20260709 13:17:03.035317 15161 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.039072 15192 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.104848 15213 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.274173 10396 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:03.111851 15222 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:03.121138 14504 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.003s	user 0.015s	sys 0.000s
I20260709 13:17:03.158684 15250 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:03.306082 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 291246us
I20260709 13:17:03.298213 15261 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.298468 14771 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.321162 15304 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.298611 15274 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:03.322711 15171 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:17:03.323801 15303 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.324153 14376 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:03.324143 15068 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.122s	user 0.005s	sys 0.007s
I20260709 13:17:03.328922 10290 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:03.155541 14888 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:03.292740 15035 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.331527 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 476707us
I20260709 13:17:03.383311 10997 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:03.278059 15221 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 1.171s	user 0.015s	sys 0.000s
I20260709 13:17:03.107925 15288 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.117846 15020 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:03.095932 14537 consensus_meta.cc:287] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 1.084s	user 0.015s	sys 0.000s
I20260709 13:17:03.159113 15302 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.300101 10399 rpcz_store.cc:276] 0709 13:17:02.126757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.130953 (+  4196us) service_pool.cc:224] Handling call
0709 13:17:02.170107 (+ 39154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.189146 (+ 19039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.189177 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:02.203122 (+ 13945us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.601295 (+398173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:02.651314 (+ 50019us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.837164 (+185850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.837249 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.160657 (+323408us) raft_consensus.cc:1685] finished
0709 13:17:03.160680 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.160840 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1102,"prepare.queue_time_us":50659,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":9682,"raft.queue_time_us":72061,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":28541,"thread_start_us":515885,"threads_started":2,"wal-append.queue_time_us":501036}
I20260709 13:17:03.357023 10993 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:03.294253 15275 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.117316 14901 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.309285 15297 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.378700 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49898.9us
W20260709 13:17:03.354363 15102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.045s	sys 0.129s
I20260709 13:17:03.117159 15165 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.500566 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1070) took 1436 ms. Trace:
I20260709 13:17:03.356806 14504 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.350642 15161 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.091681 15268 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.336601 15192 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.356020 15018 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:03.495153 15294 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
W20260709 13:17:03.465247 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75091.7us
I20260709 13:17:03.376775 15171 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.308527 15124 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.358511 15179 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.388316 14981 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.389142 15177 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.346922 15213 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:03.425279 15004 consensus_meta.cc:287] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.001s
I20260709 13:17:03.333235 15231 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:03.397967 15221 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:03.501004 11001 rpcz_store.cc:276] 0709 13:17:02.063758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.067298 (+  3540us) service_pool.cc:224] Handling call
0709 13:17:02.067838 (+   540us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:02.321952 (+254114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.321999 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:02.327272 (+  5273us) log.cc:844] Serialized 52 byte log entry
0709 13:17:02.701674 (+374402us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:02.701718 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.701787 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.983091 (+281304us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:03.497372 (+514281us) raft_consensus.cc:1685] finished
0709 13:17:03.497396 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.500489 (+  3093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30306,"raft.queue_time_us":376250,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9196,"spinlock_wait_cycles":72033152,"thread_start_us":578233,"threads_started":2,"wal-append.queue_time_us":527895}
I20260709 13:17:03.307149 15198 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.367013 14771 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.505023 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:03.366691 15261 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.300076 14683 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.360674 15222 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.472400 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 921) took 1691 ms. Trace:
I20260709 13:17:03.491648 14512 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.498404 15102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.046s	sys 0.129s
W20260709 13:17:03.511619 10248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.048s	sys 0.096s
W20260709 13:17:03.502211 15296 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.618s	user 0.001s	sys 0.004s
I20260709 13:17:03.513109 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:03.394284 15308 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:17:03.520557 10316 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:17:03.394008 15035 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.377959 15304 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.560632 15304 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.525354 10392 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:17:03.562894 14771 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.563336 15261 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.565095 15035 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.526455 15177 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.508368 15161 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.377321 15274 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.502755 15275 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:03.545186 10248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.048s	sys 0.097s
I20260709 13:17:03.388837 15303 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.544539 10391 rpcz_store.cc:276] 0709 13:17:01.781113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.781249 (+   136us) service_pool.cc:224] Handling call
0709 13:17:01.793276 (+ 12027us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:01.793661 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.793690 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:01.808819 (+ 15129us) log.cc:844] Serialized 52 byte log entry
0709 13:17:02.319131 (+510312us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:02.644701 (+325570us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.650998 (+  6297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.651086 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.472049 (+820963us) raft_consensus.cc:1685] finished
0709 13:17:03.472080 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.472311 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5986,"prepare.queue_time_us":26945,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":7800,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":17440,"spinlock_wait_cycles":70901632,"thread_start_us":663250,"threads_started":2,"wal-append.queue_time_us":606730}
I20260709 13:17:03.551424 15171 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.537801 15317 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.501276 15297 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.515661 14888 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.511627 15020 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:03.549649 15215 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:17:03.525247 15231 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.543076 15314 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:17:03.550453 14512 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:03.551268 15175 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.993s	user 0.008s	sys 0.004s
W20260709 13:17:03.551355 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.496001 15302 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.552199 14901 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:03.557034 15165 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.570513 10321 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:03.576512 14376 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:03.610666 14504 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.611130 14376 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.613209 14376 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.535038 15179 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.613847 15179 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.615975 15179 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.527963 15268 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.510510 15018 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.586946 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2001) took 1798 ms. Trace:
I20260709 13:17:03.541702 15233 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:03.552659 15102 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:03.618906 10248 rpcz_store.cc:276] 0709 13:17:01.789033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.789175 (+   142us) service_pool.cc:224] Handling call
0709 13:17:01.789475 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.789688 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:02.268073 (+478385us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.976985 (+708912us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:03.586422 (+609437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.586517 (+    95us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:03.586583 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.586677 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.586862 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42912,"prepare.queue_time_us":541981,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2743,"raft.queue_time_us":198394,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"spinlock_wait_cycles":74057472,"thread_start_us":1616308,"threads_started":3,"wal-append.queue_time_us":607108}
W20260709 13:17:03.620828 15310 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:17:03.620644 15102 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.621165 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.621980 10248 raft_consensus.cc:2393] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:03.623133 15297 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.623420 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.531481 15004 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.624265 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2877) took 1126 ms. Trace:
I20260709 13:17:03.624619 10241 rpcz_store.cc:276] 0709 13:17:02.498324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.623153 (+1124829us) service_pool.cc:224] Handling call
0709 13:17:03.624209 (+  1056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.625524 15004 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.625650 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.516000 15192 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.626678 15303 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:03.594256 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.975s (SENT) [suppressed 17 similar messages]
I20260709 13:17:03.627820 15192 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.629881 15302 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:03.630626 15314 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:03.631167 15314 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:03.631415 15308 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:03.631791 15308 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:03.632148 14683 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.632606 15308 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.591336 15309 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:03.607728 10395 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:17:03.630745 15161 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.634665 15179 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.618182 15018 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.610047 15198 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.635367 15179 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.638926 15275 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.639559 14683 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.640062 15312 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:17:03.641459 15275 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.642005 15275 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.642403 15302 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.642701 15124 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.642931 15302 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.644254 15275 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.601212 15215 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.645856 15302 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:03.646704 10393 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:03.640122 14683 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.647281 15215 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.595299 15317 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:03.640887 15209 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.000s
I20260709 13:17:03.665724 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:03.668797 15179 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.652086 10397 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:17:03.660190 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.632054 15314 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.649271 10241 raft_consensus.cc:2410] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:03.674319 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:03.674612 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2879) took 1175 ms. Trace:
I20260709 13:17:03.675004 10241 rpcz_store.cc:276] 0709 13:17:02.498864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.625381 (+1126517us) service_pool.cc:224] Handling call
0709 13:17:03.674552 (+ 49171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.675429 10391 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:03.675942 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.676412 15190 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.676892 15190 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.677193 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.677915 15175 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.673475 10246 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:03.679143 10398 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:03.648422 14683 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.679735 10393 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:03.680122 15239 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.680814 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:03.680581 15239 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.655213 14976 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:03.681625 10967 connection.cc:256] RPC call timeout handler was delayed by -1.0341810830000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:17:03.656786 15290 log.cc:927] Time spent T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.820s	user 0.000s	sys 0.006s
I20260709 13:17:03.683131 15309 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.658350 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.660544 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2871) took 1163 ms. Trace:
I20260709 13:17:03.683753 10250 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:03.683669 15309 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.683955 10244 rpcz_store.cc:276] 0709 13:17:02.496747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.659597 (+1162850us) service_pool.cc:224] Handling call
0709 13:17:03.659927 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.660144 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.660181 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.660234 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:03.660277 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.660333 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.660469 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.684942 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:03.685180 14512 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:03.661494 15206 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:03.683374 15239 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.685977 15206 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:03.686656 14512 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.686008 15309 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.687295 15272 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.687044 15206 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.687783 15272 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.688385 15206 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.653440 15189 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:03.685552 10397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2017) took 1566 ms (client timeout 1959 ms). Trace:
I20260709 13:17:03.689388 15189 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:17:03.689491 10397 rpcz_store.cc:269] 0709 13:17:02.119711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.119985 (+   274us) service_pool.cc:224] Handling call
0709 13:17:03.685383 (+1565398us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54003b9cd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:03.685484 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3487437184}
I20260709 13:17:03.692116 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:03.692866 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:03.693454 10399 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.694600 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.695211 10394 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:03.695979 10998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1071) took 1631 ms. Trace:
I20260709 13:17:03.696172 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.696425 10998 rpcz_store.cc:276] 0709 13:17:02.064276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.065553 (+  1277us) service_pool.cc:224] Handling call
0709 13:17:02.088013 (+ 22460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.088232 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:02.392761 (+304529us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.656063 (+1263302us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:03.695276 (+ 39213us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18002e3e40. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c368823a
0709 13:17:03.695585 (+   309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.695638 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:03.695690 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.695763 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.695918 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":527174,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":97,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"spinlock_wait_cycles":88765568,"thread_start_us":527521,"threads_started":2,"wal-append.queue_time_us":376832}
I20260709 13:17:03.693362 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.682965 15192 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.698731 10393 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:03.699062 15192 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.700228 15239 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.665343 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2433) took 1090 ms. Trace:
I20260709 13:17:03.664577 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 812) took 2015 ms. Trace:
I20260709 13:17:03.701545 15286 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.645139 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2876) took 1147 ms. Trace:
I20260709 13:17:03.702329 15286 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.703150 10248 rpcz_store.cc:276] 0709 13:17:02.498055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.620912 (+1122857us) service_pool.cc:224] Handling call
0709 13:17:03.645053 (+ 24141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.702096 10320 rpcz_store.cc:276] 0709 13:17:01.648765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.809549 (+160784us) service_pool.cc:224] Handling call
0709 13:17:01.809859 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.843704 (+ 33845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.843733 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.964355 (+120622us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.346629 (+382274us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:02.346676 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.664174 (+1317498us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54002bcd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:03.664222 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.664269 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:03.664280 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.664489 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12002,"raft.queue_time_us":12561,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":124214,"spinlock_wait_cycles":49243904,"thread_start_us":330697,"threads_started":1,"wal-append.queue_time_us":494475,"wal-append.run_cpu_time_us":1804,"wal-append.run_wall_time_us":1004373}
I20260709 13:17:03.704097 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.704391 10399 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:03.704921 10248 raft_consensus.cc:2410] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:03.683300 15268 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.701406 15239 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.705668 15268 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.671730 15205 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:03.706717 15205 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.707309 15239 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.707715 15268 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.708807 15205 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.634006 15308 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:03.709862 10241 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:03.651496 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.713125 10247 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:03.713581 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.714291 10243 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:03.670130 15185 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:03.715262 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:03.716310 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.716851 10243 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:03.717710 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.657858 15213 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:03.656674 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.701305 10392 rpcz_store.cc:276] 0709 13:17:02.575173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.585669 (+ 10496us) service_pool.cc:224] Handling call
0709 13:17:02.586135 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.561356 (+975221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.665105 (+103749us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54002ddf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:03.665280 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159388928}
I20260709 13:17:03.720817 15001 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:03.721318 10395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2430) took 1933 ms (client timeout 2347 ms). Trace:
I20260709 13:17:03.710976 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52922 (request call id 816) took 2061 ms. Trace:
W20260709 13:17:03.721784 10395 rpcz_store.cc:269] 0709 13:17:01.787764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.788009 (+   245us) service_pool.cc:224] Handling call
0709 13:17:03.721167 (+1933158us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54001a9854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:03.721266 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4162234624}
I20260709 13:17:03.722004 10316 rpcz_store.cc:276] 0709 13:17:01.649737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.857796 (+208059us) service_pool.cc:224] Handling call
0709 13:17:01.974950 (+117154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.552636 (+1577686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.710705 (+158069us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002bdc54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:03.710914 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3550154112}
I20260709 13:17:03.718885 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2869) took 1222 ms. Trace:
I20260709 13:17:03.723364 10246 rpcz_store.cc:276] 0709 13:17:02.496225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.639872 (+143647us) service_pool.cc:224] Handling call
0709 13:17:03.718703 (+1078831us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540043e4d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:03.718829 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339346304}
I20260709 13:17:03.705892 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:03.724288 10248 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.724385 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.725066 10246 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:03.725939 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.726534 10246 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:03.676414 15233 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:03.730888 10364 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:03.731060 15233 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:03.731732 14809 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:03.732314 15233 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.734820 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.654522 15222 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:03.735471 10324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 806) took 2088 ms (client timeout 1514 ms). Trace:
I20260709 13:17:03.736284 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.737344 10398 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:03.645020 15198 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.717715 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:03.738705 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 1040) took 1262 ms. Trace:
I20260709 13:17:03.739249 15238 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:03.739754 15238 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.740105 15238 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:03.606508 15020 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.683156 10967 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:03.743260 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 60184.7us
I20260709 13:17:03.747051 10241 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.747725 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2883) took 1247 ms. Trace:
I20260709 13:17:03.748065 10241 rpcz_store.cc:276] 0709 13:17:02.499947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.746541 (+1246594us) service_pool.cc:224] Handling call
0709 13:17:03.746857 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.747486 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.747671 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.749402 10241 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:03.749915 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2887) took 1248 ms. Trace:
W20260709 13:17:03.750706 10321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2714) took 1557 ms (client timeout 1793 ms). Trace:
I20260709 13:17:03.600260 15231 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.750883 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:03.751168 10321 rpcz_store.cc:269] 0709 13:17:02.193168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.193367 (+   199us) service_pool.cc:224] Handling call
0709 13:17:03.750550 (+1557183us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003ebcd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:03.750650 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3127751936}
I20260709 13:17:03.744150 15297 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.738631 15198 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.744678 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:03.754334 10247 raft_consensus.cc:2393] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 9: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:03.754540 10250 raft_consensus.cc:2410] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:03.754725 15314 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:03.756206 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2888) took 1218 ms. Trace:
I20260709 13:17:03.756714 10247 rpcz_store.cc:276] 0709 13:17:02.537434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.755177 (+1217743us) service_pool.cc:224] Handling call
0709 13:17:03.755555 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.755774 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.755812 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.755868 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:03.755912 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.755983 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.756140 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.603122 14888 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.710516 15317 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.677969 15177 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.704591 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2018) took 1578 ms. Trace:
W20260709 13:17:03.595268 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82216.1us
I20260709 13:17:03.750385 15001 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:03.760783 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:03.761629 15297 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:03.762966 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:03.760237 10390 rpcz_store.cc:276] 0709 13:17:02.126002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.126266 (+   264us) service_pool.cc:224] Handling call
0709 13:17:02.132025 (+  5759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.234440 (+102415us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:02.235459 (+  1019us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.651286 (+415827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:02.651333 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:02.651372 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.704363 (+1052991us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400301954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:03.704411 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.704534 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15192,"prepare.queue_time_us":108228,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":6415,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":32153,"spinlock_wait_cycles":234894592,"thread_start_us":409240,"threads_started":1,"wal-append.queue_time_us":548424}
I20260709 13:17:03.756845 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2889) took 1014 ms. Trace:
I20260709 13:17:03.763942 10250 rpcz_store.cc:276] 0709 13:17:02.742396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.756079 (+1013683us) service_pool.cc:224] Handling call
0709 13:17:03.756355 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.756539 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.756565 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.756605 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:03.756637 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.756691 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.756791 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.764496 11002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1073) took 1699 ms. Trace:
I20260709 13:17:03.764880 15250 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.765291 15297 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:03.766166 14981 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.766741 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:03.764496 15230 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:17:03.767453 15230 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.764878 11002 rpcz_store.cc:276] 0709 13:17:02.064857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.065701 (+   844us) service_pool.cc:224] Handling call
0709 13:17:02.089168 (+ 23467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:02.258980 (+169812us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:02.571630 (+312650us) log.cc:844] Serialized 14 byte log entry
0709 13:17:03.345986 (+774356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.346060 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:03.346138 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.764255 (+418117us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54005a8054. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:03.764318 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.764441 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9600,"prepare.queue_time_us":376001,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":50,"raft.queue_time_us":363710,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":48775,"spinlock_wait_cycles":389977984,"thread_start_us":1072330,"threads_started":3,"wal-append.queue_time_us":458691}
I20260709 13:17:03.769672 15230 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.768509 15190 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:03.745052 10245 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.774539 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2874) took 1277 ms. Trace:
I20260709 13:17:03.774865 10245 rpcz_store.cc:276] 0709 13:17:02.497496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.744539 (+1247043us) service_pool.cc:224] Handling call
0709 13:17:03.744863 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.774298 (+ 29435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.774484 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:03.735957 10324 rpcz_store.cc:269] 0709 13:17:01.647002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.647140 (+   138us) service_pool.cc:224] Handling call
0709 13:17:03.735289 (+2088149us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540022ddd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:03.735399 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3179953024}
W20260709 13:17:03.773388 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.776216 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.776947 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.777490 15274 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.784161 15198 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.785140 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.702354 15189 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.786501 15243 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.799975 15243 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.800441 15243 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.810583 15189 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.787860 15192 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.750217 10241 rpcz_store.cc:276] 0709 13:17:02.501021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.748782 (+1247761us) service_pool.cc:224] Handling call
0709 13:17:03.749110 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.749688 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.749866 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:03.739276 10242 rpcz_store.cc:276] 0709 13:17:02.476350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.476519 (+   169us) service_pool.cc:224] Handling call
0709 13:17:02.502723 (+ 26204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.630878 (+128155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.630933 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:02.631565 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.761796 (+130231us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:02.761845 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.978797 (+216952us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:03.738376 (+759579us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000b9ad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:03.738433 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.738475 (+    42us) raft_consensus.cc:1685] finished
0709 13:17:03.738489 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.738648 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":206637,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":30194,"spinlock_wait_cycles":371849984,"thread_start_us":129814,"threads_started":1,"wal-append.queue_time_us":241806}
I20260709 13:17:03.790589 14809 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.815732 14809 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.816164 14809 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.790747 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:03.791035 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 56286.8us
I20260709 13:17:03.791882 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.818652 10998 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:03.792201 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:03.819952 10997 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:03.793538 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:03.821448 11001 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:03.793747 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:03.822113 10993 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:17:03.817770 10996 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:03.826722 14981 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:03.829241 15317 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.704640 15286 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.794469 15297 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.794910 10243 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:03.795405 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:03.832620 15297 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:03.833022 15297 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.833359 15297 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.833865 14809 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.840399 14809 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:03.842710 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47392.2us
I20260709 13:17:03.843684 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:03.844570 15308 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:03.846845 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:03.690129 15272 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:03.797928 10248 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:17:03.814916 15313 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:03.848567 15308 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.829879 15317 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.851681 15317 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:03.852326 10998 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:03.854097 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:03.854974 15317 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.856179 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:03.856369 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.857113 15317 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:03.857838 15317 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:03.685180 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.860299 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:03.858697 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:03.860791 10244 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:17:03.863862 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.865563 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:03.866880 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.867707 10967 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:03.868806 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 109113us
I20260709 13:17:03.870148 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.871446 10247 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:03.872121 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.789846 15288 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.858326 15317 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:03.879861 10250 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:17:03.880375 10250 pending_rounds.cc:85] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:17:03.880607 10250 pending_rounds.cc:107] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:17:03.880844 10250 raft_consensus.cc:2889] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.881166 10250 pending_rounds.cc:107] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:17:03.881400 10250 raft_consensus.cc:2889] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.884290 10248 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:03.879846 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.887092 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2873) took 1389 ms. Trace:
I20260709 13:17:03.888164 10246 rpcz_store.cc:276] 0709 13:17:02.497228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.727123 (+1229895us) service_pool.cc:224] Handling call
0709 13:17:03.886014 (+158891us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b5800002a98. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8ac1fc0 00007f58c8aac929 00007f58c8aac3d2 00007f58c2023bd4
0709 13:17:03.886222 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.886728 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.886757 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.886804 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:03.886845 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.886906 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.887031 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192707968}
I20260709 13:17:03.890254 10245 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:03.910976 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.912928 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.913875 10999 raft_consensus.cc:2410] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:17:03.914816 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.915369 10999 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:03.915618 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.916422 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.916977 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.917829 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.918540 10248 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:17:03.917918 10998 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.922076 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:03.917083 10250 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
W20260709 13:17:03.930405 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71778.8us
W20260709 13:17:03.932140 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.935053 10391 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:03.936304 10244 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:03.891258 15238 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:03.916910 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.945951 10247 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:17:03.928217 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.945878 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:03.948297 10246 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.957226 10994 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:03.958480 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.961040 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:03.962028 10242 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:03.931948 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:03.972318 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.973219 11002 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.973884 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:03.951462 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.970459 14951 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:03.978199 10364 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.944761 15272 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:03.968152 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:03.989221 14951 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:03.989480 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.990262 15175 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:03.991159 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:03.991967 11000 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:03.919529 14809 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:03.930003 15190 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:03.999827 10390 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:03.994900 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:03.885713 15317 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:04.004271 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.005676 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.006281 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.004884 10994 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:04.007969 10390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:03.983068 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:04.002979 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.979243 14976 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:04.024739 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:03.985293 15286 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:04.031927 10997 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:17:03.986903 15274 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.993752 15272 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.993096 14512 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.002867 15190 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:04.027786 10998 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:04.062839 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:03.982112 15198 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:04.027149 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:03.990720 15175 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:04.035614 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 184838us
I20260709 13:17:04.077564 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.077757 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:04.038709 11002 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:04.078148 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.078480 10317 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.000129 14809 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.962841 15177 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:17:04.003542 15222 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:04.030479 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:03.919317 15297 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:03.999065 14951 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.085690 10325 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:04.059892 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.060665 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.065479 10246 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:04.028067 15061 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:04.073650 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:04.028187 15250 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.079689 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.029500 14976 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:04.036214 15286 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.085817 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.102108 10993 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:04.086469 10316 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:04.034614 15309 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:04.107865 10319 raft_consensus.cc:2368] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:04.041509 15274 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.105397 10318 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:04.053802 15272 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:04.131201 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.132055 10318 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:04.101447 15314 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.084774 15175 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.085321 14809 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.063433 15229 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:04.107496 15061 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:04.116722 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.068979 15295 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:04.147550 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.128006 15309 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.029549 15243 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.068183 15304 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.052150 15307 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:17:04.090443 15287 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.128326 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.086676 15004 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:04.040187 10288 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:04.179098 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 139021us
I20260709 13:17:04.135229 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:04.039551 15322 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:17:04.187557 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.107237 15192 raft_consensus.cc:2764] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:17:04.140173 10249 raft_consensus.cc:2410] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:04.068177 15190 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:04.149307 15298 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.145399 10317 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:04.203186 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.122180 14976 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:04.068553 15213 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:04.125468 10995 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:04.125012 15286 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.122253 15222 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:04.126157 15165 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:04.155813 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.068264 14512 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.081974 15198 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.136065 15274 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:04.090835 15311 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 13:17:04.181556 10319 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.180800 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:04.150656 15061 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:04.189687 10323 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:17:04.141791 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.155035 15309 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:04.125674 15250 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.177924 15230 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.256769 15230 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.205139 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.259932 15198 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.250839 15233 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:04.261135 15233 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:04.261224 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.210906 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.096764 15231 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.168329 15308 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:04.163938 15226 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.178256 14888 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:04.230803 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 75111.2us
I20260709 13:17:04.150058 15229 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.190048 15124 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:04.217351 15206 consensus_meta.cc:287] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.001s
I20260709 13:17:04.221438 15213 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:04.237572 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56855us
I20260709 13:17:04.285493 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.197751 15305 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.179728 15304 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.246832 15311 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:04.247196 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.236670 15215 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:04.157303 15295 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.240653 10318 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:17:04.251128 10319 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:04.255999 14512 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.187150 15287 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.262832 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.265388 10317 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:04.269451 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 191975us
I20260709 13:17:04.306845 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:04.271751 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.259596 15230 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:04.280390 15323 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:17:04.213100 15298 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.285320 10325 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:04.293340 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.263172 15319 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:04.297077 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:04.301815 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 213789us
I20260709 13:17:04.303506 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:04.308318 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.294744 15174 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:04.314697 10318 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:04.313431 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:04.315201 10317 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:04.285976 15124 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.316380 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.321485 10317 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:04.316937 10322 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:17:04.321883 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.323314 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.325991 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:04.326642 10398 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.327415 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:04.327963 10392 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:04.328632 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.326944 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:04.289776 15311 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:04.326627 10318 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:04.333357 10397 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:04.334470 15304 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.310595 15319 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.335212 15319 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.335309 10321 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:04.337138 15295 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.338593 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.339854 15243 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.341952 15061 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.343154 10243 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:04.345755 15061 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.346984 15317 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.347712 15287 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.348246 10392 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:17:04.349171 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.351555 15299 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:04.352138 15299 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:04.353132 15299 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.323849 15297 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.371086 15299 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:04.300693 15198 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.355047 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:04.295099 14888 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.356540 15213 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.357179 14512 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:04.357554 15311 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.324433 15124 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:04.298400 15305 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.367247 15215 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:04.311213 14683 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:17:04.368003 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54568.7us
I20260709 13:17:04.368206 15250 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.322556 15001 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:04.354445 15190 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.305254 15222 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:04.376710 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 70000.4us
I20260709 13:17:04.410552 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.359625 15229 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.262180 15233 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.381511 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:04.382510 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:04.383483 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 71194.6us
W20260709 13:17:04.416460 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.416920 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:04.381517 15243 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:04.394760 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.396754 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:04.420171 10247 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:04.426720 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 45296.1us
I20260709 13:17:04.431877 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.432765 10397 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:04.397357 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.434172 10250 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:04.397712 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.435285 10248 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:04.378162 15200 raft_consensus.cc:2764] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:04.402485 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:04.390192 15189 consensus_meta.cc:287] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 13:17:04.407096 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:04.450969 10245 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:04.445398 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.448228 10993 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:04.461130 10391 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:04.452996 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:04.381929 15198 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.467862 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:04.467933 10390 raft_consensus.cc:606] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:04.469717 10390 raft_consensus.cc:614] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:04.475476 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:04.476333 10396 raft_consensus.cc:2368] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:04.478087 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.409512 15231 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.408730 15215 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:04.484953 10288 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:04.454039 15226 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:04.489351 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.492396 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.493137 10393 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:04.513669 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.520422 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:04.521569 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.488965 10247 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:04.497447 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.524510 10392 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:04.491662 15001 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:17:04.460166 15274 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.492178 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.526979 10243 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:04.522964 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.492136 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.528616 10322 raft_consensus.cc:1240] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:04.453243 15229 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:04.513998 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:04.516734 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.528038 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.460806 15243 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:04.517599 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.513185 10242 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:04.532003 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:04.525202 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.533054 10247 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:17:04.526710 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.515333 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:04.450359 15308 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:04.536624 10247 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:04.537294 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.541015 10999 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:04.466274 15297 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:17:04.489509 15320 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.542940 15320 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.489209 15311 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.546799 10323 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:04.489843 15298 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.548776 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.566524 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.566587 10393 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:17:04.564234 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.567865 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.568818 10393 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:17:04.549088 10999 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:04.548779 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.554188 15286 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.555137 15320 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.581346 15313 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:04.558600 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.512614 15226 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:04.582552 15226 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:04.508932 15333 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.570353 10322 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:17:04.570618 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:04.577893 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.578732 15177 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:04.578938 15215 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.562422 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:04.578749 15229 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:04.515998 15206 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:04.585554 10316 raft_consensus.cc:2368] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:17:04.563325 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.585879 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:04.602192 10994 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:04.602558 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.597703 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.604312 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:04.597726 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 82520us
I20260709 13:17:04.598176 10242 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:04.606861 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:17:04.607617 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.596192 10999 raft_consensus.cc:2410] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:04.604312 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.592829 10245 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:04.613790 10319 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:04.615170 10324 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:04.615638 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.616552 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.616828 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.617200 10393 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:17:04.617741 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.618011 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.621088 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.621234 10994 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:04.622198 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.623035 10998 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.628746 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.565871 15287 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:17:04.595276 15302 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:04.638005 10243 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:17:04.633680 10999 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:04.642448 10243 pending_rounds.cc:85] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 9
I20260709 13:17:04.642772 10243 pending_rounds.cc:107] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:04.643019 10243 raft_consensus.cc:2889] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.608131 15075 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:04.638787 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 267176us
W20260709 13:17:04.637714 10249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 2880) took 2138 ms (client timeout 2148 ms). Trace:
I20260709 13:17:04.643033 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.644682 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:04.649016 10249 rpcz_store.cc:269] 0709 13:17:02.499133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.732456 (+233323us) service_pool.cc:224] Handling call
0709 13:17:04.637496 (+1905040us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540006ccd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:04.637656 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3137407744}
I20260709 13:17:04.649425 10392 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:04.649634 10245 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:04.648382 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.643394 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.628957 15230 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:04.656468 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:04.653846 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.657693 10393 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:04.657946 10246 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:04.654991 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:04.650259 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.659601 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.658643 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.661377 10999 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.634793 15298 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.659945 10213 leader_election.cc:400] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:04.668982 10213 leader_election.cc:403] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.619911 14512 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:17:04.648089 15189 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:04.651486 15075 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.670399 10398 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:04.842609 15075 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:04.671761 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:04.843184 14976 consensus_meta.cc:287] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:17:04.676710 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:04.843612 14976 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.676110 15192 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:04.722175 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:04.724685 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.647647 15206 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:04.722175 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.834874 10999 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:17:04.838490 15190 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:04.838894 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.868206 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:04.846954 15331 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
W20260709 13:17:04.873471 15338 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:17:04.874034 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.874420 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.874753 10245 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:04.867369 15206 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.875140 10999 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:17:04.876142 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.876231 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:04.876940 10241 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.877380 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:04.863072 15004 consensus_meta.cc:287] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:17:04.840090 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.878336 15004 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:04.860633 15272 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 13:17:04.879321 10399 raft_consensus.cc:2410] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:04.859922 15020 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:04.867717 10391 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 7.
W20260709 13:17:04.876051 15327 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.589s	user 0.003s	sys 0.000s
I20260709 13:17:04.890748 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.891969 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.871162 10998 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
W20260709 13:17:04.870396 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.661055 15286 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.880627 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:04.895502 10245 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:04.896531 10999 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:17:04.881402 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 295619us
I20260709 13:17:04.881556 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:04.859470 10322 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:04.899389 10247 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.860954 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:04.859942 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 183304us
I20260709 13:17:04.884246 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.851046 15198 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:04.887346 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.893253 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.893618 10242 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:04.904480 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:04.894537 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 285621us
I20260709 13:17:04.899498 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.900636 10391 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:04.900573 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:04.905901 10999 raft_consensus.cc:2376] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13. Re-sending same reply.
I20260709 13:17:04.907781 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:04.909983 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.879406 15272 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.846212 14976 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:04.655157 15243 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.913857 15198 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:04.917289 15198 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:04.917683 15198 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:04.925028 15175 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.773s	user 0.006s	sys 0.002s
I20260709 13:17:04.925549 15175 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.914124 14512 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:04.926788 14512 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:04.927860 14512 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.928061 15198 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.930328 15198 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:04.930719 15319 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.005s
I20260709 13:17:04.931191 15319 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.932305 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:04.932988 10394 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:04.933358 15319 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:04.933900 15299 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.002s
I20260709 13:17:04.883383 15020 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:04.934819 15020 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.936128 15178 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:04.936682 15178 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:04.938658 10997 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:04.939659 14809 consensus_meta.cc:287] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
I20260709 13:17:04.939849 15272 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.940136 14809 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:04.941582 10995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 1000) took 1028 ms. Trace:
I20260709 13:17:04.942077 10995 rpcz_store.cc:276] 0709 13:17:03.913420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.918954 (+  5534us) service_pool.cc:224] Handling call
0709 13:17:03.919217 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.226511 (+307294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.941270 (+714759us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54005a1c54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:04.941504 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473763584}
I20260709 13:17:04.943887 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.944793 10995 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:04.945734 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.914222 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.967201 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:04.972436 10322 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:04.966487 10994 raft_consensus.cc:2368] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:17:05.023196 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:04.951565 15124 consensus_meta.cc:287] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:17:05.044459 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.047768 10397 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:05.067589 10995 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:17:05.122049 10241 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:17:05.122512 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.123636 10322 raft_consensus.cc:2410] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:04.963567 14809 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:04.926914 15309 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
I20260709 13:17:04.680740 15298 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:04.947798 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.949802 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.152561 15298 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.153028 10398 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.153746 10246 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:17:04.951563 15335 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 13:17:04.951948 10391 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:05.155011 15305 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.912871 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.156140 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1098) took 1297 ms. Trace:
I20260709 13:17:05.156499 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.156872 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.157488 10393 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:05.158058 10395 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:04.956614 10396 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
W20260709 13:17:04.958062 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.913085 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:04.961184 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:04.934183 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.162345 10316 raft_consensus.cc:2376] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13. Re-sending same reply.
I20260709 13:17:05.163882 10316 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:05.165518 10316 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:05.124950 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.179303 10242 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.183799 10398 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:05.041977 15333 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.959625 10247 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:05.185837 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.186673 10247 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:05.187590 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 287077us
I20260709 13:17:05.188429 10213 leader_election.cc:400] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12.
I20260709 13:17:05.189680 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.166256 10393 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:05.167212 10394 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:17:05.156512 11001 rpcz_store.cc:276] 0709 13:17:03.858743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.858869 (+   126us) service_pool.cc:224] Handling call
0709 13:17:03.859262 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.914145 (+ 54883us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:04.150112 (+235967us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.489769 (+339657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.490299 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.508715 (+ 18416us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:04.508761 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.508845 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.951000 (+442155us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:05.155841 (+204841us) raft_consensus.cc:1685] finished
0709 13:17:05.155973 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.156085 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46517,"prepare.queue_time_us":396058,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":85880,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":50288,"spinlock_wait_cycles":301353856,"thread_start_us":487177,"threads_started":2,"wal-append.queue_time_us":441840}
I20260709 13:17:04.937781 15178 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.149427 15309 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.175210 15288 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.175875 15175 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:05.176823 15314 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:05.112640 15238 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:04.915351 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.200392 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.191257 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.202023 10247 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:05.203480 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.204457 10242 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:05.214284 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.215020 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.164062 15274 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.206548 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:05.046543 15075 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.215289 10247 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:17:05.216464 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 301162us
I20260709 13:17:05.083813 15124 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.225612 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.221948 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.229636 10244 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:17:05.232761 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.227851 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.234571 10996 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:05.205062 15305 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:05.222885 15298 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.239131 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:05.210114 15314 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:05.243312 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:05.224469 14809 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:05.239305 10242 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.245093 10321 raft_consensus.cc:2393] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:05.246513 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:05.247318 10318 raft_consensus.cc:2393] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:05.248258 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:05.248760 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:05.239883 15298 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:05.249459 10362 leader_election.cc:336] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.630s (SENT)
I20260709 13:17:05.249670 15274 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:05.237526 15198 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:05.240859 15175 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:05.222582 15192 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:05.284678 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.295430 10242 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:05.202890 15333 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.271766 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:05.262073 10213 leader_election.cc:336] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.512s (SENT)
I20260709 13:17:05.238658 15061 raft_consensus.cc:2764] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:05.227579 15299 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:17:05.267447 15226 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.002s
I20260709 13:17:05.270821 11002 raft_consensus.cc:2393] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:05.297015 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:05.304463 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 55036.5us
I20260709 13:17:05.302490 15333 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.276541 15298 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.276400 15198 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.290592 14809 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:05.285246 15124 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.273761 15274 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:05.283924 15309 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.338070 10242 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:05.318998 15198 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:05.326458 15274 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:05.383378 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 121351us
I20260709 13:17:05.310921 15226 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:05.394475 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 89186.3us
I20260709 13:17:05.317533 15314 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.389207 15350 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:05.382843 14951 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.395794 15305 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:05.403154 10395 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:05.403424 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.400815 15299 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:05.400007 15192 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:05.417914 15305 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.401561 15075 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.430871 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:05.433269 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.433173 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:05.435374 15192 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.442049 15359 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.442822 15359 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.443296 15359 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.445785 10246 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:05.434772 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.448546 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.448052 15356 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.456578 15298 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.463375 15298 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.465476 15359 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.397262 14809 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.466907 10318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2566) took 1075 ms. Trace:
W20260709 13:17:05.505872 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.515515 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.516510 10242 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:05.467885 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.430405 15360 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:05.466763 15356 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.447420 15020 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.447062 15358 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.523650 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.476989 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40532 (request call id 41) took 1473 ms. Trace:
I20260709 13:17:05.530503 10390 rpcz_store.cc:276] 0709 13:17:04.003073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.003283 (+   210us) service_pool.cc:224] Handling call
0709 13:17:05.476700 (+1473417us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540021be54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae2853 00007f58c8ab060a 00007f58c20367d4 00007f58c2036762 00007f58c2036691 00007f58c203660c 00007f58c20358c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:05.476878 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054118656}
I20260709 13:17:05.478642 14888 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.479851 15226 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.481323 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.484004 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2538) took 1424 ms. Trace:
I20260709 13:17:05.553246 10320 rpcz_store.cc:276] 0709 13:17:04.059219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.059602 (+   383us) service_pool.cc:224] Handling call
0709 13:17:05.483781 (+1424179us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002be154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:05.483936 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328007552}
I20260709 13:17:05.484328 15004 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:05.484874 15198 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.570269 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:05.570887 11002 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.488327 10248 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.491787 15230 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:05.498950 15061 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:05.499475 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:05.502206 10318 rpcz_store.cc:276] 0709 13:17:04.392064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.394368 (+  2304us) service_pool.cc:224] Handling call
0709 13:17:05.466720 (+1072352us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54001bbf54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:05.466848 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897556352}
I20260709 13:17:05.541061 10242 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:05.429700 15299 consensus_queue.cc:1243] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:17:05.543668 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 75895.9us
I20260709 13:17:05.544639 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:05.577276 10244 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:05.521677 15322 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:05.547539 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:05.551003 10325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34184 (request call id 2548) took 1486 ms (client timeout 1705 ms). Trace:
I20260709 13:17:05.561160 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.552564 15350 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.564154 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.582481 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:05.565388 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:05.566573 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.584221 10318 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.550122 15344 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:05.584641 10324 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:05.567359 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:05.568116 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.586089 10319 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:05.581933 10325 rpcz_store.cc:269] 0709 13:17:04.064598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.115797 (+ 51199us) service_pool.cc:224] Handling call
0709 13:17:05.550764 (+1434967us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003ec6d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:05.550920 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269099264}
I20260709 13:17:05.565958 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:05.548902 15189 consensus_queue.cc:1059] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:17:05.570425 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2024) took 1168 ms. Trace:
I20260709 13:17:05.485700 15274 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:05.493763 15268 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:05.573858 10241 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.577517 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.545696 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:05.575282 10994 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:05.521425 15313 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:05.549122 15231 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.561610 14981 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:05.589249 10243 rpcz_store.cc:276] 0709 13:17:04.402504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.586696 (+184192us) service_pool.cc:224] Handling call
0709 13:17:04.637637 (+ 50941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.643471 (+  5834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.570205 (+926734us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b540006ccd0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:05.570369 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116357888}
I20260709 13:17:05.595599 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:05.583375 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:05.598109 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50690.1us
I20260709 13:17:05.599422 10290 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.574862 15061 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:05.601795 11002 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:05.602003 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 1007) took 1558 ms. Trace:
I20260709 13:17:05.618484 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.617291 10997 rpcz_store.cc:276] 0709 13:17:04.043858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.067231 (+ 23373us) service_pool.cc:224] Handling call
0709 13:17:04.073679 (+  6448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.939092 (+865413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.601732 (+662640us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400469454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:05.601925 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988832640}
I20260709 13:17:05.622510 10213 leader_election.cc:400] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:17:05.623165 10213 leader_election.cc:403] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:05.591392 15322 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.624310 15061 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.625680 15061 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.617312 14981 consensus_queue.cc:1243] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:05.627449 10993 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:05.617584 15231 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.630306 15365 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:05.630894 15231 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.631362 10290 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.633123 15165 raft_consensus.cc:3055] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:05.632355 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 49087.9us
I20260709 13:17:05.633656 15165 raft_consensus.cc:740] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:05.632911 14981 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:05.634621 14981 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:05.635566 14981 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.636255 15359 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.604450 15222 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.638550 15222 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:05.638976 15222 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.639698 10290 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.643421 15274 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.644112 15274 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.644631 15274 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.645478 15314 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.602021 15192 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.575511 15004 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:05.649113 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.649569 10244 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:05.597579 15317 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:05.653051 10364 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:05.596695 15268 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:05.660984 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.658465 15198 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.664752 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.665372 10396 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:05.666433 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:05.667039 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.668020 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.651508 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.668608 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.659775 10290 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.617915 15363 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:05.578384 15230 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.653525 15350 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:05.669397 10397 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:05.670442 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.671579 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:05.671932 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.672112 15226 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:05.679281 15311 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:05.605863 15313 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:05.680907 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.644179 15215 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:05.681495 15215 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:05.682780 15313 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.684177 10390 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:05.656697 14683 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.672972 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.653007 15189 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.688949 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.697012 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.608907 10319 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:05.687213 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 999) took 1153 ms. Trace:
I20260709 13:17:05.685495 10290 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:05.698282 10996 rpcz_store.cc:276] 0709 13:17:04.533750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.534339 (+   589us) service_pool.cc:224] Handling call
0709 13:17:05.687001 (+1152662us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54004f06d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:05.687151 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477457664}
I20260709 13:17:05.664147 15192 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:17:05.662657 15068 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.701083 10395 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:05.703365 15309 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:05.704852 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.662338 14809 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:05.687223 15345 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.673072 15297 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.676822 15178 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:05.676463 15359 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.714851 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.725484 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.729668 10397 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:05.710659 15344 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:05.686364 15317 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:05.719553 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.695824 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.695508 15313 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.700028 15287 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.744174 15287 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:05.744606 15287 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.744728 15230 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.747062 10395 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:05.710884 15311 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:17:05.748555 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.713490 10290 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.749933 10290 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:05.716156 10396 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:05.707638 15286 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:05.701572 15350 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:05.711354 15299 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.738085 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.718714 15363 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:05.742426 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 46686.4us
I20260709 13:17:05.783515 15350 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.785632 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:05.721572 15198 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.786550 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.786978 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.787267 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:05.787496 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49535.4us
I20260709 13:17:05.743664 15313 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.788128 15313 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.788312 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:05.788638 10319 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:17:05.789646 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.707849 15102 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:05.789954 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.767661 15286 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.760391 10243 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:05.790834 15286 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.754192 14976 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:05.779791 15322 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.725912 14809 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.792111 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.793480 14809 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:05.794219 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica cb71def93f904f619a1527aa48a32294 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:05.790655 10323 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:05.795754 10997 pending_rounds.cc:85] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 7
I20260709 13:17:05.796063 10997 pending_rounds.cc:107] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:05.796293 10997 raft_consensus.cc:2889] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:05.718075 15215 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.780830 15206 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:05.781335 15274 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:05.786984 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.815764 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.782102 15004 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:05.742381 15192 raft_consensus.cc:2764] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:05.712293 15229 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:05.791069 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:05.780109 10249 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:05.800674 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.801158 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:05.801595 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 130097us
I20260709 13:17:05.801808 15231 consensus_queue.cc:1059] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:05.802279 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.803292 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.805557 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.805894 15320 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:05.768894 15365 raft_consensus.cc:2804] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:05.806761 15102 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:05.808104 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:05.808512 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.808714 14976 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:05.808954 15226 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:05.809719 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:05.810735 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:05.811156 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.859862 10398 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:05.812057 10394 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.769313 10393 raft_consensus.cc:3060] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:05.814147 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.816215 10324 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:05.688234 15165 consensus_queue.cc:260] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.735246 15359 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:05.819235 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:05.787740 10325 raft_consensus.cc:2393] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:05.820672 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 143278us
I20260709 13:17:05.741487 15020 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:05.718115 15068 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.821138 15001 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.823774 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:05.818468 15198 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.824275 15363 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:05.826156 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:05.827278 15368 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:05.834494 10994 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:05.836921 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:05.722302 15268 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.806591 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:05.931854 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 95046.4us
I20260709 13:17:05.932078 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.798054 15215 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.830837 14683 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:17:05.819619 15061 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:05.819378 15230 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:05.870805 14976 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.841164 10996 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:05.865604 15102 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.868650 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:05.870018 15376 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:05.872107 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 58055.6us
I20260709 13:17:05.873113 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.873208 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:05.873425 10318 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:05.838048 15274 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.874145 10394 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:05.872982 10243 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:05.876802 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.880942 11002 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 8.
I20260709 13:17:05.934810 10390 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
W20260709 13:17:05.895804 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.871054 15359 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.957767 10247 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:17:06.049007 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.052156 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:06.053768 10399 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
W20260709 13:17:06.062160 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.883188 10393 raft_consensus.cc:2468] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
W20260709 13:17:05.921267 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 102087us
I20260709 13:17:05.830441 15299 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.924732 10241 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:05.926388 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:05.736840 15297 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.876870 15231 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 13:17:05.932760 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:05.875411 15367 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:17:05.923493 15004 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:17:05.933688 15288 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:05.841224 15229 raft_consensus.cc:3055] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:05.881283 15309 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:06.031874 15374 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.094833 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 226281us
I20260709 13:17:05.944329 15192 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.923715 15345 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 13:17:05.863277 15365 raft_consensus.cc:697] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:05.950284 15268 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:06.111984 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 179293us
I20260709 13:17:06.149288 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:05.933395 15344 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.195s
I20260709 13:17:06.131786 10362 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:06.078424 15213 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:06.070981 15319 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.067327 15230 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:06.146920 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.110620 15189 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:06.122486 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 70412.7us
I20260709 13:17:06.130411 15192 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:06.122794 15061 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:06.120853 15229 raft_consensus.cc:740] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:06.168269 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:05.881016 15317 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:05.953486 15001 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.164930 15222 consensus_meta.cc:287] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 13:17:06.121371 15287 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.032881 15226 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.203271 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:06.174156 15274 raft_consensus.cc:2764] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:17:06.209100 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 136334us
I20260709 13:17:06.206919 15274 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:05.969900 15363 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.187602 15192 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.224983 14888 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:06.146656 15374 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.225977 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:06.244103 15374 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.243510 15365 consensus_queue.cc:237] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.247318 15322 raft_consensus.cc:2764] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:06.233388 15274 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:06.204456 15189 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:06.253100 10320 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:06.238778 15230 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.225508 15297 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:06.260017 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 84320.8us
I20260709 13:17:06.256389 14976 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:06.280468 14976 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.280920 14976 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:06.279503 15229 consensus_queue.cc:260] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.284122 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:06.211155 15360 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:06.167331 15286 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.175693 15319 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:06.297984 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 94769.1us
W20260709 13:17:06.323652 10213 connection.cc:256] RPC call timeout handler was delayed by -1.01351924100004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 13:17:06.314163 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 182482us
I20260709 13:17:06.285610 15309 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:06.205349 15222 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.209283 15001 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.379421 10316 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:06.369720 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 85666.4us
I20260709 13:17:06.381717 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:06.289575 15322 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:06.400274 15308 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:06.390113 15309 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.401432 15308 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.403738 15309 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:06.401026 15385 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:06.404862 15286 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.351387 15358 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.416411 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:06.423103 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:06.426934 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:17:06.428591 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.431188 10995 raft_consensus.cc:2393] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:06.431504 10998 pending_rounds.cc:85] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 9
I20260709 13:17:06.431910 10998 pending_rounds.cc:107] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:06.432204 10998 raft_consensus.cc:2889] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.435360 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:06.437847 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:06.438553 10995 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:06.421636 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:06.386408 15206 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:06.443605 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 112304us
I20260709 13:17:06.443276 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.445102 11000 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.445233 10213 leader_election.cc:400] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 9 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 9. Current term is 10.
I20260709 13:17:06.446247 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:06.447101 15394 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.448192 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:06.449214 15394 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:06.449667 15394 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.450071 15394 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.449980 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:06.451086 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 166428us
I20260709 13:17:06.451907 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:06.452852 15350 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:06.453504 15350 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:06.456103 10995 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:06.457329 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:06.413282 15198 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:06.462255 10995 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:06.464228 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:06.468174 10995 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:06.438483 15297 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:06.442803 15309 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:06.443382 15308 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:06.474543 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.477222 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:06.479678 15389 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:06.462460 15061 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:06.484813 15314 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.000s
W20260709 13:17:06.477448 15388 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:17:06.488794 15313 consensus_meta.cc:287] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.002s
I20260709 13:17:06.489331 15313 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.493185 11000 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:17:06.459518 15305 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.465974 15250 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:06.503986 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 68733us
W20260709 13:17:06.504315 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 44157.3us
I20260709 13:17:06.509018 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:06.454605 15350 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.475106 15309 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:06.438700 15358 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.493010 15308 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:06.514039 15061 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:06.521119 15309 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:06.505761 15305 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.526917 15319 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.440429 15274 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.545867 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:06.497011 15198 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:06.459072 15206 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.557013 15308 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.558750 15061 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.565874 15392 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:06.584336 10318 raft_consensus.cc:2410] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:17:06.561689 15359 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.580235 15061 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:06.634610 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.598886 15419 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:17:06.644948 15178 consensus_meta.cc:287] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.906s	user 0.006s	sys 0.003s
I20260709 13:17:06.651475 15206 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.653544 15305 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.645700 15412 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:06.657619 15412 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:06.658849 15412 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.662514 15222 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.665874 15192 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.666694 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:06.667450 10997 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 9.
I20260709 13:17:06.668890 15192 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.673321 15178 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.673990 15178 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.675855 15359 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.675937 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:06.676651 10248 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:06.677042 15411 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:06.677300 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:17:06.677948 15215 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.006s
I20260709 13:17:06.679126 15358 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.683316 15313 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.700376 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.680480 15250 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:06.696643 15192 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.707005 15305 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:06.719758 10999 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:06.712126 15400 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.744467 10397 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:17:06.716711 15358 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:06.727911 15305 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.710500 14976 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.718482 15192 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.718611 15308 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.763680 15305 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.745487 15400 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.781817 15400 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:06.782757 15192 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.784484 14976 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.787626 15061 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:06.789863 15061 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:06.790759 15394 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.792886 15394 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.764583 15358 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:06.789527 15309 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:06.819257 15369 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.888s	user 0.004s	sys 0.000s
I20260709 13:17:06.820583 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2042) took 1313 ms. Trace:
I20260709 13:17:06.820971 10245 rpcz_store.cc:276] 0709 13:17:05.507258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.507827 (+   569us) service_pool.cc:224] Handling call
0709 13:17:05.508281 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.576085 (+ 67804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.576122 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.582140 (+  6018us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.711806 (+129666us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:05.711846 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.775766 (+ 63920us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b54000a8f54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:05.775837 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.818602 (+1042765us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:06.820328 (+  1726us) raft_consensus.cc:1685] finished
0709 13:17:06.820363 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.820516 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1236,"raft.queue_time_us":1423,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":5536,"spinlock_wait_cycles":158717184,"thread_start_us":77299,"threads_started":1,"wal-append.queue_time_us":204805}
I20260709 13:17:06.827527 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:06.833845 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:06.835103 11001 raft_consensus.cc:2410] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:17:06.832216 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:06.927721 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.928550 11001 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.817991 15308 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:06.806761 15178 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:06.828784 15396 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.943015 10245 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:06.934432 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 137219us
I20260709 13:17:06.944756 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.945363 10997 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:06.956380 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:06.938071 15420 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:17:06.945168 15421 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.988335 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:06.989346 10995 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:06.990159 11002 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:17:06.995662 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:07.006783 10997 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:06.944876 15358 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:07.003415 15317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.042s	sys 0.076s
I20260709 13:17:07.015635 14683 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:07.016232 15422 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:17:07.012136 11001 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:07.005069 15102 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:07.007462 15238 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:17:06.949669 15396 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:07.018082 15317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.042s	sys 0.076s
W20260709 13:17:07.039382 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.008690 14976 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:17:07.018800 15102 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:07.044896 15102 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.985159 15421 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.051550 15020 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.055245 10995 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:07.055640 15020 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.058486 15020 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.065490 15020 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.066708 15428 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:17:07.067607 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.066201 15020 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.068774 15305 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.074112 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.075434 10321 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:07.076238 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:07.017369 15178 consensus_queue.cc:1059] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:07.081306 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:07.083667 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.084429 10325 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:07.081720 15020 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:07.087724 15319 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:07.081746 15286 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:07.099913 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.100656 10324 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:07.084836 15313 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:07.083966 15359 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.111589 15421 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:07.112175 15309 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:07.117009 15313 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:07.116926 15359 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.106036 15286 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.140641 14809 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:07.141109 14809 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:07.141906 14809 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.143205 14809 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.136142 15305 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:07.146983 10999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 1018) took 2289 ms (client timeout 2134 ms). Trace:
W20260709 13:17:07.147399 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.149549 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.149839 15189 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.150075 15287 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.150458 15189 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:07.150907 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 738243us
I20260709 13:17:07.151504 15175 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.151892 15175 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:07.152688 15189 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:07.156623 15189 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:07.156925 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.158447 15001 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.160300 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 936) took 1355 ms. Trace:
I20260709 13:17:07.159976 15313 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.160703 10397 rpcz_store.cc:276] 0709 13:17:05.805239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.805339 (+   100us) service_pool.cc:224] Handling call
0709 13:17:07.160143 (+1354804us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54002dc154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:07.160242 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015642368}
I20260709 13:17:07.161841 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:07.161980 10393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2062) took 1501 ms (client timeout 1944 ms). Trace:
I20260709 13:17:07.162637 10320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 825) took 1378 ms. Trace:
I20260709 13:17:07.154426 15363 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.163404 15363 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:07.167598 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.168529 15215 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.169117 15215 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.172396 15400 raft_consensus.cc:3055] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:07.172887 15400 raft_consensus.cc:740] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:07.173491 15419 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:07.173956 15419 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:07.174906 15419 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.175412 15068 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.176127 15419 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:07.178954 15375 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:07.179411 15375 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:07.180533 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 933) took 1378 ms. Trace:
I20260709 13:17:07.180313 15375 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.180920 10396 rpcz_store.cc:276] 0709 13:17:05.801911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.802032 (+   121us) service_pool.cc:224] Handling call
0709 13:17:07.180338 (+1378306us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54001dfe54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:07.180475 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371882240}
I20260709 13:17:07.181368 15375 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:07.182035 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.183203 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.183516 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.184181 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.184592 10249 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.185777 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.155031 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.186630 10399 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.186956 15396 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.155313 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.155709 15344 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.155552 10317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 829) took 1370 ms. Trace:
I20260709 13:17:07.188400 15344 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.183203 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:07.162405 10393 rpcz_store.cc:269] 0709 13:17:05.660341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.660740 (+   399us) service_pool.cc:224] Handling call
0709 13:17:07.161821 (+1501081us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001347d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:07.161928 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247341824}
I20260709 13:17:07.163184 10320 rpcz_store.cc:276] 0709 13:17:05.784425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.786328 (+  1903us) service_pool.cc:224] Handling call
0709 13:17:07.162458 (+1376130us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540021ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:07.162584 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070974336}
I20260709 13:17:07.187011 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.154771 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.192025 15311 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.192267 10392 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.192664 15226 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:07.192670 15311 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.193588 15226 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:07.194062 15226 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:07.194906 15226 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.196224 15226 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.186650 10250 raft_consensus.cc:2410] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:07.154691 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.188505 10317 rpcz_store.cc:276] 0709 13:17:05.785557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.791897 (+  6340us) service_pool.cc:224] Handling call
0709 13:17:07.155350 (+1363453us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003ec1d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:07.155495 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633094016}
I20260709 13:17:07.199240 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.197598 10993 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:07.200045 10398 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:07.178788 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.206776 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:07.152743 15175 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.209408 15175 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.215340 15319 consensus_queue.cc:1059] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:07.216655 15319 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.216951 15229 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:07.217190 15319 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.218487 15178 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.219043 15178 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:07.147452 10999 rpcz_store.cc:269] 0709 13:17:04.857037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.912773 (+ 55736us) service_pool.cc:224] Handling call
0709 13:17:07.146738 (+2233965us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400611554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:07.146877 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3426690432}
I20260709 13:17:07.220521 15178 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.223104 15344 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:07.224764 10993 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.228250 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.229307 10393 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:07.233856 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.235842 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.236529 10993 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:07.237618 11002 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:07.239683 10247 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:07.244958 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.245618 10393 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:07.246408 10999 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:07.249773 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:07.239135 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.253281 10243 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:07.255007 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.258855 10994 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:07.259548 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:07.260525 10246 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:07.261001 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.264595 10965 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:07.264997 10965 leader_election.cc:403] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:07.265690 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:07.267647 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.280226 10999 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:07.284312 10392 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:07.289939 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:07.290738 10996 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.290675 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.295639 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.296622 11001 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:07.304184 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.308982 10245 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.311148 10247 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:07.328020 10393 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:07.330122 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:07.329236 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.330957 10398 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:07.332227 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.332597 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:07.336838 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.256431 15165 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:07.330345 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.340966 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.254386 15178 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.347079 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.289687 15308 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:07.374094 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.374487 15308 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:07.374846 10397 raft_consensus.cc:3060] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.375029 15308 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.375519 15308 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:07.370815 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.353626 15068 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:07.354017 15213 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.332908 14951 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:07.378839 14951 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.378787 15213 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.381158 14951 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.173748 15400 consensus_queue.cc:260] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.415654 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.418200 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.423103 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.379141 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.373528 15231 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:07.382907 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 138680us
I20260709 13:17:07.372720 10393 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:07.384500 10999 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:07.386061 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.381527 15213 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.387719 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:07.295596 15320 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:07.453735 10392 raft_consensus.cc:2376] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12. Re-sending same reply.
I20260709 13:17:07.260344 15376 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:17:07.288143 15344 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:17:07.458856 10399 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:07.464426 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.494978 10317 raft_consensus.cc:2376] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13. Re-sending same reply.
I20260709 13:17:07.495045 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.495790 10399 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:07.495942 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.455369 10391 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:07.464465 10993 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:07.464772 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.497649 10318 raft_consensus.cc:2368] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13.
I20260709 13:17:07.463857 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.466585 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.498687 10393 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.499848 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:07.500834 10250 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:07.501271 10397 raft_consensus.cc:2468] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:07.501381 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.503013 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.503103 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.503909 10399 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:07.486647 11001 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:07.458444 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.506477 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.475344 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 84833.8us
I20260709 13:17:07.463258 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.463119 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:07.466223 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.466585 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.508488 10325 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:07.509075 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 46063.6us
I20260709 13:17:07.383755 15215 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:07.517825 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.519351 10318 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:07.519923 10391 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:07.485754 10398 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:07.521759 10398 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:07.523149 10398 raft_consensus.cc:1240] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:07.524322 10398 raft_consensus.cc:1240] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:17:07.493678 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 121015us
I20260709 13:17:07.509938 10393 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:17:07.516839 10319 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:07.526830 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.527622 10250 raft_consensus.cc:2393] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 8: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:07.528098 10398 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.385177 15359 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.509696 10392 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:07.535028 10399 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:07.537243 10319 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:17:07.540975 10397 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:07.541640 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.541990 10250 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:07.545292 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.542567 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:07.546010 10316 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
W20260709 13:17:07.546407 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 280776us
I20260709 13:17:07.547235 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:07.499715 15305 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.475284 14981 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.391533 15288 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:17:07.525141 10246 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:07.480816 15250 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:07.508181 15299 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.480194 15286 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.480736 15124 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.486805 15311 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.541872 15189 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.572041 10246 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:07.517915 15363 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.569996 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:07.574673 10324 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:07.540259 15360 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:07.578146 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:07.581633 10393 raft_consensus.cc:606] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:07.582062 10393 raft_consensus.cc:614] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:07.537132 15320 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:07.457108 15417 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.183s
I20260709 13:17:07.557535 15344 consensus_queue.cc:1243] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:07.583832 10321 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: [11.11-13.12]
W20260709 13:17:07.584600 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.558414 14683 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.583525 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.478780 15231 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.610671 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.589932 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:07.578871 15102 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.006s
I20260709 13:17:07.604035 10319 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:07.606334 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:07.623245 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:17:07.607926 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.541522 14951 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:07.581661 15250 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.627713 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.568568 15305 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.628767 10319 raft_consensus.cc:2410] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:17:07.612478 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 224839us
W20260709 13:17:07.614406 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.575320 15319 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:07.582329 15004 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.631050 14951 consensus_queue.cc:1243] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:07.631719 14951 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.632117 14951 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:07.633096 14951 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.616885 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.634552 15320 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.635250 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.636521 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.636588 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.579833 15189 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:07.638657 10967 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:07.618132 15439 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.640707 15439 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:07.641747 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.642993 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.644781 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.581753 15299 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.631379 15004 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:07.639565 15376 consensus_queue.cc:1175] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" responder_term: 10 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:07.648243 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:07.650169 10325 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:07.574000 14981 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.651113 10242 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:07.647394 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:07.657629 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.586365 15124 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.665447 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.666448 10317 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:07.669881 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.671794 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:07.672537 11001 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:07.643246 15439 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:07.626982 15344 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.676215 10325 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:07.650490 15374 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.703799 10320 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:07.666893 14951 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.720819 14809 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:17:07.627435 15102 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.744133 15102 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.746556 10316 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:07.747953 15004 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:07.750988 15435 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:07.664109 15363 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:17:07.677757 15068 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:17:07.752084 15363 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:07.752498 15363 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:17:07.754418 15434 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:17:07.754758 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.755548 15299 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.704269 15374 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:07.756407 15374 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.728120 10317 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
W20260709 13:17:07.722352 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.763501 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.631090 15319 consensus_queue.cc:1059] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:17:07.677974 15391 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:07.739602 15250 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:07.768203 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 198303us
I20260709 13:17:07.705190 15439 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:07.738034 15375 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.002s
I20260709 13:17:07.695441 15446 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:07.766819 10996 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:17:07.767776 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.770210 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:07.805510 10994 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.805763 10317 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:07.772917 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:07.769588 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 221400us
I20260709 13:17:07.778803 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.806427 10318 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:07.807332 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.753501 15363 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.749785 15308 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.809231 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:07.809978 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 220125us
I20260709 13:17:07.757650 15231 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:07.815855 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.767386 15391 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.675861 15189 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.819546 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.838013 10317 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:07.812878 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.821036 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:07.821488 15229 consensus_meta.cc:287] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.604s	user 0.018s	sys 0.000s
W20260709 13:17:07.824335 15437 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:07.840802 15124 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:07.826601 15431 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.262s	user 0.002s	sys 0.001s
W20260709 13:17:07.842800 15175 consensus_meta.cc:287] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.008s
W20260709 13:17:07.827353 15433 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:17:07.827976 15430 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:17:07.817198 15004 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.846714 15004 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.828173 15363 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.848965 15004 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.839932 15250 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:17:07.831266 14981 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.808025 15068 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.854805 15068 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:07.766247 15445 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.811878 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:07.856109 15445 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.856462 10319 raft_consensus.cc:2393] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:07.856678 15445 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.857262 15068 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:07.832923 15308 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:07.731669 15344 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:17:07.863217 15439 raft_consensus.cc:3055] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.863870 15439 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:07.864399 10288 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:07.865051 15439 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.866510 15396 raft_consensus.cc:2804] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:07.819972 15440 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:07.834969 15305 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:07.868947 10325 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:07.839102 10318 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:07.870380 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.876937 10393 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
W20260709 13:17:07.835210 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 52827.2us
I20260709 13:17:07.873620 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.877874 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.881108 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:07.883770 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.875036 10390 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:07.887131 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:07.888114 10397 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
W20260709 13:17:07.840077 15226 consensus_meta.cc:287] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.006s
I20260709 13:17:07.838161 15391 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:07.867125 15396 raft_consensus.cc:697] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:07.876506 15439 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.893896 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:07.866541 15001 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:07.894310 15189 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.877562 15124 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:17:07.899267 15419 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.011s
I20260709 13:17:07.903630 10249 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:07.915673 10248 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:07.915982 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:07.902778 15449 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:07.917680 15449 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:07.913928 10290 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:07.916945 10394 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
W20260709 13:17:07.930702 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 257361us
I20260709 13:17:07.937652 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:07.938695 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:07.943212 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:07.951612 10362 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:07.958696 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:07.964603 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:17:08.002315 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 63733.5us
I20260709 13:17:08.004899 15440 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:08.005573 15175 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.006450 15449 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:08.009855 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.028064 11000 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:17:08.033871 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 69362.3us
I20260709 13:17:08.035320 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.027981 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.041786 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.044546 11000 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:17:08.044806 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.046167 10997 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:08.048317 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.049207 10397 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
W20260709 13:17:08.054574 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:08.055721 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:08.056445 10317 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:08.056609 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.055819 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:08.063172 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58922.6us
I20260709 13:17:08.063431 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:08.064389 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:07.941936 15102 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.067988 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:08.068081 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:07.997676 15226 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.057402 10321 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:08.083578 10317 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:08.025702 15317 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:08.056674 15165 consensus_meta.cc:287] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.001s
I20260709 13:17:08.025787 15446 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:08.025979 15440 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:08.026031 14809 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.001113 14976 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:17:08.053712 15222 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.008957 15068 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:17:08.099859 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.069242 15250 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.053617 15004 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:08.102340 10395 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:08.103801 15407 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:08.086824 15213 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:08.086902 15286 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:08.089635 15360 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:08.093652 15230 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:17:08.151019 15451 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:17:08.111864 15004 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.111495 15395 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.151732 15004 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.151911 15395 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.075791 15396 consensus_queue.cc:237] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:08.160006 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.159811 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.159456 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.163408 11002 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:08.159550 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:08.110459 15222 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:08.156215 15313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.024s
I20260709 13:17:08.111527 15250 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.107985 14809 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.154412 15213 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:08.165162 15215 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:08.174021 15313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.010s	sys 0.024s
I20260709 13:17:08.208526 15360 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.239722 15446 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:08.200173 15440 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.281208  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:08.296066 10323 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:08.297056 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 229055us
W20260709 13:17:08.300024 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 233775us
W20260709 13:17:08.303894 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.311152 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.313032 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.338999 10397 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:08.340906 15213 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.343024 15439 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.344688 15439 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:08.345897 15374 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.002s
I20260709 13:17:08.346933 15374 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.355125 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.355432 15446 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:08.356523 15440 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.356865 15222 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.360721 15250 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.361449 14809 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.360937 15439 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:08.368806 10393 raft_consensus.cc:2410] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:17:08.377235 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 347509us
I20260709 13:17:08.398950 15440 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.401791 15440 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.403920 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:08.407183 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:08.395140 15446 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.409471 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.412725 15446 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.421177 10391 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:08.426723 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:08.428120 15455 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:08.429551 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2475) took 1195 ms. Trace:
I20260709 13:17:08.429615 15455 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:08.431607 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2470) took 1277 ms. Trace:
I20260709 13:17:08.431960 15455 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:08.433329 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 77740.4us
I20260709 13:17:08.434088 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 950) took 1054 ms. Trace:
W20260709 13:17:08.434556 10362 leader_election.cc:336] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.648s (SENT)
I20260709 13:17:08.435333 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:08.435478 15439 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.432126 10394 rpcz_store.cc:276] 0709 13:17:07.153531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.156700 (+  3169us) service_pool.cc:224] Handling call
0709 13:17:08.431153 (+1274453us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b5400032354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.431378 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1577190272}
I20260709 13:17:08.430104 10390 rpcz_store.cc:276] 0709 13:17:07.233482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.233602 (+   120us) service_pool.cc:224] Handling call
0709 13:17:08.429035 (+1195433us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400032854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.429265 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205074816}
I20260709 13:17:08.440666 14512 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:08.441282 14512 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:08.434643 10398 rpcz_store.cc:276] 0709 13:17:07.379145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.525006 (+145861us) service_pool.cc:224] Handling call
0709 13:17:07.527795 (+  2789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.529569 (+  1774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.433657 (+904088us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b54002dd050. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.433902 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5738240}
I20260709 13:17:08.442541 15374 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.448284 10396 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:08.441979 10390 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:17:08.455044 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:08.456589 15440 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.456763 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:08.457226 15440 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.457731 15440 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.457785 14809 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.450397 10390 pending_rounds.cc:85] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 9
I20260709 13:17:08.458689 14809 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.459425 10390 pending_rounds.cc:107] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:17:08.459905 10390 raft_consensus.cc:2889] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.476308 15189 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.476073 15004 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.488191 15439 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:08.489077 15439 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:08.490275 15004 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.490847 15215 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.502645 15215 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:08.491011 15439 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.491899 15452 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.493782 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59349.7us
I20260709 13:17:08.496029 15446 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.496433 14512 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.470072 14809 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.498802 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.510198 15446 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.511260 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.512051 10390 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:17:08.513145 15446 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.513145 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.514727 14809 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.515902 15452 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.515672 14809 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:08.519521 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.521234 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.530063 10362 leader_election.cc:336] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.686s (SENT)
I20260709 13:17:08.530784 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:08.531842 15344 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:08.532626 10362 leader_election.cc:336] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.709s (SENT)
I20260709 13:17:08.533198 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:08.534108 15344 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.552736 14512 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.552913 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:08.553977 10390 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:08.514825 15390 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:08.555167 15390 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:08.556758 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:08.558643 15394 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:08.560338 15175 consensus_meta.cc:287] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.015s
I20260709 13:17:08.561002 15175 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.573789 15020 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.574854 15020 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.578938 15449 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.579691 15449 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.578040 15020 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.580868 15020 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.582423 15020 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.584141 15305 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.585274 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:08.584894 15305 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.592499 15305 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:08.593294 15441 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.924s	user 0.008s	sys 0.006s
I20260709 13:17:08.607199 15419 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.607208 15447 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:08.608523 15447 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:08.608182 15419 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.585151 15452 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.588340 15175 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.611999 15175 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.617615 10249 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:08.618120 10244 raft_consensus.cc:1217] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Deduplicated request from leader. Original: 11.10->[13.11-15.12]   Dedup: 13.11->[15.12-15.12]
I20260709 13:17:08.618814 10244 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:17:08.621323 15359 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.622263 15359 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.623039 15075 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.623736 15075 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.624245 15075 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.625254 15359 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.630167 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.630442 15449 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.631832 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.632818 15004 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:08.634047 15004 consensus_queue.cc:1243] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:08.609915 15447 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.638842 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.639935 10244 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:08.646284 15020 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.649302 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2927) took 1407 ms. Trace:
I20260709 13:17:08.650286 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:08.660050 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 127489us
I20260709 13:17:08.662530 10396 raft_consensus.cc:2410] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:08.662628 10362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.194:44995 timed out after 1.789s (SENT) [suppressed 21 similar messages]
I20260709 13:17:08.649806 10241 rpcz_store.cc:276] 0709 13:17:07.241570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.306978 (+ 65408us) service_pool.cc:224] Handling call
0709 13:17:07.307342 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.332908 (+ 25566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.332961 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.340294 (+  7333us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.529896 (+189602us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.529932 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.530007 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.592007 (+1062000us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:08.648825 (+ 56818us) raft_consensus.cc:1685] finished
0709 13:17:08.648846 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.649109 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25151,"raft.queue_time_us":25677,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":40266,"spinlock_wait_cycles":37762944,"thread_start_us":156584,"threads_started":1,"wal-append.queue_time_us":218874}
I20260709 13:17:08.594183 15395 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.655115 15417 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.664479 15417 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.659768 15175 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:08.660979 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:08.658069 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 91483.5us
I20260709 13:17:08.659546 11000 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:08.667958 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:08.568673 15440 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.666515 10396 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:08.675458 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:08.651044 14809 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.649608 15445 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.653692 15485 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.683512 15485 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:08.684736 15391 consensus_meta.cc:287] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.009s
I20260709 13:17:08.685251 15391 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.686749 10399 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 16: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:08.686954 15485 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.658741 15452 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:08.690758 15419 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:08.717175 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.679932 15449 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.725122 10390 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:08.728472 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.729324 10244 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:08.723548 15445 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:08.738552 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.738821 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.739643 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2746) took 1274 ms. Trace:
I20260709 13:17:08.740134 10322 rpcz_store.cc:276] 0709 13:17:07.465576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.465685 (+   109us) service_pool.cc:224] Handling call
0709 13:17:07.465951 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.626724 (+160773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.626759 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.626809 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:07.626851 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.739143 (+1112292us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540022d8d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:08.739226 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.739456 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369237760}
I20260709 13:17:08.741792 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.742660 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2071) took 1153 ms. Trace:
I20260709 13:17:08.742955 15215 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.743155 10246 rpcz_store.cc:276] 0709 13:17:07.588714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.588923 (+   209us) service_pool.cc:224] Handling call
0709 13:17:07.589307 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.740138 (+1150831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.740183 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.740240 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:08.740277 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.742107 (+  1830us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400328554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:08.742150 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.742456 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830149,"raft.queue_time_us":909837,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"spinlock_wait_cycles":246413568,"thread_start_us":196254,"threads_started":1}
I20260709 13:17:08.745468 15215 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:08.747484 15440 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.751581  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:08.754312 11000 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:17:08.756006 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:08.756938 11002 raft_consensus.cc:2368] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12.
I20260709 13:17:08.756969 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.728070 15449 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.766484 15449 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.783195 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.795866 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.736821 15445 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.797061 15445 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.797699 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.798364 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.794574 15449 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.800719 10321 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:17:08.801740 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.804322 15178 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.805032 15178 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.758651 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.808518 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34184 (request call id 2579) took 1129 ms. Trace:
I20260709 13:17:08.809056 10325 rpcz_store.cc:276] 0709 13:17:07.679369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.705484 (+ 26115us) service_pool.cc:224] Handling call
0709 13:17:07.868609 (+163125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.875587 (+  6978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.808037 (+932450us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400114250. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.808298 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371251072}
I20260709 13:17:08.727413 15419 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.800900 15449 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:08.820313 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.821091 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.811069 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.758605 15165 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:08.828094 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.828411 15178 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.829687 11000 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:08.811138 15417 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:08.837211 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:08.838483 10325 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:08.839529 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:08.840212 11002 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.848598 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:08.847846 10395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 943) took 3034 ms (client timeout 1782 ms). Trace:
I20260709 13:17:08.853814 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:08.853736 10395 rpcz_store.cc:269] 0709 13:17:05.813449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.825898 (+ 12449us) service_pool.cc:224] Handling call
0709 13:17:08.844027 (+3018129us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54002dd554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.847575 (+  3548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5013865856}
I20260709 13:17:08.844390 15165 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:08.781037 14512 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.812177 15215 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.867165 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.874543 15486 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.874904 10250 raft_consensus.cc:2410] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:17:08.875108 15165 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.876550 15486 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.879065 15215 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.879716 15165 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.885495 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.885804 15419 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.886557 10318 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:08.887346 10994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 1020) took 1539 ms. Trace:
I20260709 13:17:08.887437 14512 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.887864 10994 rpcz_store.cc:276] 0709 13:17:07.348254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.373385 (+ 25131us) service_pool.cc:224] Handling call
0709 13:17:07.805291 (+431906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.806021 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.886945 (+1080924us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400637c50. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.887162 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992434560}
I20260709 13:17:08.889822 14512 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:08.890152 10248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54378 (request call id 1063) took 1718 ms (client timeout 2085 ms). Trace:
I20260709 13:17:08.869635 15445 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:08.894577 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:08.894771 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:08.895393 15400 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.885039 15486 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.898488 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:08.899116 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:08.901479 11000 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
W20260709 13:17:08.902597 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.900296 10241 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:08.885617 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:08.900790 10248 rpcz_store.cc:269] 0709 13:17:07.171679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.183284 (+ 11605us) service_pool.cc:224] Handling call
0709 13:17:08.889666 (+1706382us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540009f454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:08.889933 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681674112}
W20260709 13:17:08.905138 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.910518 15417 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:08.914913 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.903714 15419 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:08.909631 15391 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:08.939811 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.939913 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:08.940721 10244 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:08.942524 15486 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:08.943353 10325 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 11: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:08.943439 15486 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:08.944852 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.945712 10250 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:08.942567 10246 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:08.952111 10244 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:08.935142 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.955629 10317 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:08.936533 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.957808 10323 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:08.959612 10248 raft_consensus.cc:1217] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Deduplicated request from leader. Original: 11.10->[13.11-15.12]   Dedup: 13.11->[15.12-15.12]
I20260709 13:17:08.959679 10316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2756) took 1396 ms. Trace:
I20260709 13:17:08.961006 10248 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:17:08.938608 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:08.961934 10316 rpcz_store.cc:276] 0709 13:17:07.562880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.563205 (+   325us) service_pool.cc:224] Handling call
0709 13:17:07.563537 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.747230 (+183693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.959216 (+1211986us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003dd954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:08.959510 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420180736}
I20260709 13:17:08.965975 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.969513 15445 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:08.971663 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.911331 15075 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:08.982755 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49692.4us
W20260709 13:17:08.991657 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.996454 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.995311 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:09.004573 15309 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.004896 10250 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:17:09.005802 15391 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:09.005522 15309 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:09.009143 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 1.23881e+06us
I20260709 13:17:09.006289 15391 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.010577 15391 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.019830 15309 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.020512 15465 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:09.047080 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.068043 15465 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.070183 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:08.986109 15486 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.071429 10249 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:09.003077 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.985554 15452 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.074785 10248 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:08.958030 15390 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.079767 10244 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:09.091449 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:08.998476 15417 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.094242 10996 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:09.085609 14809 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:09.100323 15287 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:09.074093 15391 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.106833 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.093124 15175 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:17:09.117931 15287 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.120389 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.121816 10243 raft_consensus.cc:2393] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 10: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:09.109679 14809 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:09.123873 14809 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.118413 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2937) took 1221 ms. Trace:
W20260709 13:17:09.131250 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.127172 15287 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:09.136845 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 126702us
I20260709 13:17:09.114650 15490 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.151917 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.159797 15455 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.164105 15391 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.165519 10324 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:09.166291 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:09.166548 10967 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:09.166772 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:09.167312 10248 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:09.167748 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:09.178987 10424 heartbeater.cc:646] Failed to heartbeat to 127.8.238.254:38317 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.238.254:38317 timed out after 15.000s (SENT)
I20260709 13:17:09.168709 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:09.165959 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:09.140731 15175 consensus_queue.cc:1243] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:09.185724 10323 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.179031 10318 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
W20260709 13:17:09.196298 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.187126 15075 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.189615 10317 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:17:09.199018 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.192935 15215 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.127458 10242 rpcz_store.cc:276] 0709 13:17:07.762929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.768649 (+  5720us) service_pool.cc:224] Handling call
0709 13:17:07.769031 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.593162 (+824131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.593208 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.593938 (+   730us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.883160 (+289222us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:08.883197 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.907473 (+ 24276us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.980384 (+ 72911us) raft_consensus.cc:1685] finished
0709 13:17:08.980403 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.984214 (+  3811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751799,"raft.queue_time_us":825120,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":20125,"thread_start_us":318419,"threads_started":2,"wal-append.queue_time_us":371140}
I20260709 13:17:09.199231 10244 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:17:09.201593 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 59908.6us
I20260709 13:17:09.202634 10967 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:09.198357 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.209717 15445 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:09.210429 15445 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.210955 15445 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.217291 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:09.221040 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.222121 10399 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:09.224299 15465 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:09.224826 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 61541.3us
I20260709 13:17:09.219343 15490 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:09.239789 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.239923 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:09.240666 10398 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.241221 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:09.198817 15455 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.243542 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.244560 10392 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:09.216234 15452 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:09.246001 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.246338 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:09.249955 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 65990.9us
I20260709 13:17:09.252370 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.256294 10399 raft_consensus.cc:2410] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:17:09.230788 15391 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.261524 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:09.268165 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.254437 15317 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.284893 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.274749 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:09.286554 10390 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.288347 10395 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:17:09.272502 15396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.017s	sys 0.029s
W20260709 13:17:09.291972 15396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.017s	sys 0.029s
I20260709 13:17:09.293298 15061 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.284657 10364 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:09.296394 10391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 952) took 1475 ms (client timeout 1542 ms). Trace:
W20260709 13:17:09.296837 10391 rpcz_store.cc:269] 0709 13:17:07.820609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.820775 (+   166us) service_pool.cc:224] Handling call
0709 13:17:09.285622 (+1464847us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540010b654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:09.296315 (+ 10693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328175872}
I20260709 13:17:09.263077 15490 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.304057 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:09.293980 15061 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:09.305912 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.307346 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 68482us
I20260709 13:17:09.306588 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:09.308794 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.313426 10965 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:09.317040 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 44290.9us
I20260709 13:17:09.315692 10392 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:17:09.314888 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:09.331864 15455 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.309940 15061 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.312232 15452 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:09.308003 15417 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:09.337072 10391 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:09.322877 15396 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:09.346295 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.334861 15400 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:09.348814 15068 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.318078 15215 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:09.344137 15452 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.356812 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:09.308192 15391 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.351143 15396 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.366359 10243 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:09.370009 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.357465 15068 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.359143 15215 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:09.376075 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 52310.4us
I20260709 13:17:09.385870 10362 leader_election.cc:400] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12.
I20260709 13:17:09.386404 10362 leader_election.cc:403] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.388396 10247 raft_consensus.cc:1275] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:17:09.390502 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 159867us
I20260709 13:17:09.391978 10967 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:09.399282 11002 consensus_meta.cc:287] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.002s
I20260709 13:17:09.400125 11002 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:09.372481 15396 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.368062 15452 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.430626 10967 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:09.364393 15455 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.383384 15068 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.401592 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.391947 15215 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:09.452832 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75412.4us
I20260709 13:17:09.428912 15400 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:09.461369 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 134679us
I20260709 13:17:09.469244 15309 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:09.384433 15417 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:17:09.470132 15309 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.480990 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:09.474328 15439 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.471344 15400 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.483706 10391 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
W20260709 13:17:09.463135 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 95388.8us
W20260709 13:17:09.482796 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 115724us
I20260709 13:17:09.504554 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.505868 10246 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:09.496482 15400 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.520661 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:17:09.517798 15443 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.889s	user 0.001s	sys 0.014s
I20260709 13:17:09.519642 15390 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.489567 15455 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.536646 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:09.542860 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.551003 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:17:09.553313 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 81502.9us
I20260709 13:17:09.515012 15456 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:17:09.553875 15495 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:17:09.558483 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:09.551054 15165 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.006s
I20260709 13:17:09.545775 15175 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.571316 15507 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.573936 15375 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.574970 15500 log.cc:927] Time spent T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:09.574644 15375 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.576947 15375 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:09.577103 15498 log.cc:927] Time spent T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:17:09.555671 15465 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:09.597776 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 120823us
I20260709 13:17:09.561133 15299 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:09.533217 15439 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.596086 10398 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
W20260709 13:17:09.601259 15504 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:09.600946 15455 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.617483 10323 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
W20260709 13:17:09.601985 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.602999 10393 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:17:09.610728 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 65755.1us
I20260709 13:17:09.577696 15287 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:09.628161 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 48611.7us
I20260709 13:17:09.569087 15175 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.627264 15299 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:09.640303 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:09.653519 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.656654 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.657795 10245 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:09.661087 10965 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:09.667200 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.635030 14512 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.667976 10398 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:09.651634 15455 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:09.681053 15445 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:09.669850 15501 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:17:09.684710 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 47168.5us
I20260709 13:17:09.659996 15511 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:09.676506 15455 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.672077 15375 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.693336 15445 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.673772 15391 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:09.670006 15456 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:09.703756 15439 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.713603 15511 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.728605 15511 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:09.726755 15456 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.659549 15068 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:09.770200 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 47657.1us
W20260709 13:17:09.760802 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45018us
W20260709 13:17:09.722200 15497 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 13:17:09.689076 15309 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:09.782092 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 379160us
I20260709 13:17:09.721014 15455 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.792136 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:09.775024 15445 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.804173 10398 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:09.805912 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.809734 10994 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:09.810438 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.811101 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.726778 15514 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.157s
I20260709 13:17:09.712237 14512 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.813617 11000 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:09.809540 15439 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.787246 15519 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.822978 10399 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:09.823837 10244 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:17:09.787333 15465 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:17:09.783670 15375 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.833081 10397 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:17:09.813761 15456 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.801750 15516 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:09.834496 10245 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
I20260709 13:17:09.838737 10398 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:09.841616 10396 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:09.842015 10395 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:17:09.854638 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 69683.4us
I20260709 13:17:09.855068 15068 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.855724 15439 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.801368 15299 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:09.857277 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.858623 15514 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.859221 15514 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:09.868417 10390 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:17:09.868820 10390 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:09.870072 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.872026 10396 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:09.872274 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:09.858109 15439 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.842701 15522 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:09.878372 15490 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:09.876720 15215 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.888439 15215 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.890388 15376 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:09.871924 15175 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:09.842945 15519 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.894028 15519 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.898399 15288 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.899075 15288 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:09.900408 10244 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:09.901201 15288 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:09.901444 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.904903 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:09.890492 10394 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:09.915759 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46079.4us
I20260709 13:17:09.921005 10243 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:09.867333 15452 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.839636 15396 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.933459 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:09.936637 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:09.909050 15507 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12.
I20260709 13:17:09.921427 15529 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:09.942131 10396 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.945070 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:09.947315 14512 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.950559 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:09.951407 15396 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:09.951735 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:09.955591 15514 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:09.958575 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 96428.9us
I20260709 13:17:09.930904 15522 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.960749 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:09.961202 15522 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.961002 15400 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.962610 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:09.963651 15507 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:09.964674 15507 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.965107 15507 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.965502 15507 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.967331 15375 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:09.938795 15511 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:09.969619 15511 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:09.973155 15061 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
I20260709 13:17:09.973834 10392 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:09.921985 15445 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:10.015028 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52570.4us
I20260709 13:17:10.016923 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.017791 14512 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:09.978469 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46322.8us
I20260709 13:17:09.980281 10244 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:09.973770 15529 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:09.981389 15288 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:10.020008 15288 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.020496 15288 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:09.982371 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:09.958519 15490 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:10.022652 10243 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:17:09.984222 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:09.951757 15452 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.981520 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.030987 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.031850 15075 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:10.031962 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 86974.2us
I20260709 13:17:10.033257 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.036336 15526 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:10.036572 15400 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.037066 15526 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.039594 15526 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:10.040295 15375 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.040863 15375 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.042467 15465 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.998930 15061 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.044641 15061 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:09.819188  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:10.046438 10246 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:10.047055 15455 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.049043 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.051483 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.053846 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.049841 15455 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.055279 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.055629 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:10.056708 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.059211 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.059437 15391 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:10.061139 15391 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.061511 15391 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.061870 15391 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.010130 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:10.062700 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 52661.2us
I20260709 13:17:10.062894 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.063448 10967 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:10.064214 15526 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.064575 15526 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.064926 15526 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.065608 15286 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:10.066586 15467 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:10.066967 15467 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:10.067937 15467 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.069059 15375 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.070564 10967 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:10.055960 10249 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.070923 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.075886 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.076279 15509 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:09.958056 10396 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
W20260709 13:17:10.122061 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 98147.1us
W20260709 13:17:10.125056 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54214.2us
I20260709 13:17:10.126135 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.127056 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.127636 10390 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.075228 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.126763 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.130044 10399 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:10.126875 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 175262us
I20260709 13:17:10.131134 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.071545 15452 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:10.129712 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.075197 15467 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.134518 10395 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.126531 15509 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:17:10.121302 15375 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.146546 15375 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.126376 15522 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:10.147559 10395 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:10.147951 15522 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.148805 15375 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.153504 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.154501 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.156069 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.156708 10243 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.158694 15288 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.160571 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.160985 15288 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:10.166621 15535 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:17:10.167532 15525 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:10.168159 15525 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.168448 15075 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.168295 15514 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.169147 15400 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:10.169315 15514 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.169513 15445 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.169731 15400 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.170784 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.134256 15452 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.174469 15439 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:10.172012 15400 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:10.174669 15452 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.171489 15519 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:10.124415 15455 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:10.178849 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53038.5us
W20260709 13:17:10.180984 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 52574.6us
W20260709 13:17:10.182817 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.173897 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.186394 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.205776 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.247283 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.207530 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:17:10.254434 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 47997.1us
I20260709 13:17:10.180222 15490 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:10.185653 15522 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:10.260450 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 79610.5us
I20260709 13:17:10.173998 15526 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.199293 15455 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:10.261292 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80624.4us
I20260709 13:17:10.273662 10392 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 8.
I20260709 13:17:10.205818 15529 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:10.272351 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:10.281221 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 73026.9us
I20260709 13:17:10.207867 15400 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.184589 15287 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:10.285566 10390 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:10.250712 15525 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:10.207959 15509 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.263141 15522 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:10.293565 10243 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:10.156106 15507 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.282205 15317 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.257158 15456 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:17:10.304252 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 122150us
W20260709 13:17:10.304227 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 96836us
I20260709 13:17:10.306689 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:10.386826 10399 raft_consensus.cc:2468] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
W20260709 13:17:10.318392 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.319672 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.406558 15529 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.420667 15507 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:10.423098 10249 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:10.306340 15317 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.387408 15534 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.386788 15391 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.357370 15490 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.335755 15509 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.472874 15509 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.431053 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.431535 15526 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.434618 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.474697 10249 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:10.435292 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.437425 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.439985 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:10.336935 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 65737.5us
I20260709 13:17:10.481012 15511 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:10.480929 15467 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:10.481621 15511 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:10.481760 15288 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:10.439301 15545 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:10.442895 10323 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:10.461334 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.484951 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.308158 15222 consensus_queue.cc:1048] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:17:10.485623 10246 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.487262 15510 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:10.487349 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.487834 15510 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:10.488758 15510 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:10.490552 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 171028us
I20260709 13:17:10.491456 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.492283 14512 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.493695 15545 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:10.438169 15452 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.460300 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.452806 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.494606 15390 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:10.462110 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.446182 15507 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.462023 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.397441 15286 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:10.446899 15534 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.323716 15419 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:17:10.356882 15455 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.466992 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.505955 10321 raft_consensus.cc:2368] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:17:10.507989 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.509285 15534 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.485769 15075 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:10.511653 15222 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:10.512137 15222 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:10.513118 15222 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:10.515506 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.518918 15222 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.523671 10246 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:10.524392 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:10.530611 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 50019.8us
I20260709 13:17:10.334271 15465 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:10.468784 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.469529 15391 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.470252 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:10.429831 15541 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:10.536391 10322 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
W20260709 13:17:10.462735 10213 connection.cc:256] RPC call timeout handler was delayed by -2.5725807849999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:17:10.485144 15546 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:10.482632 15511 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.496881 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.305970 15287 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.496088 15545 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:10.490024 15510 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.501737 15452 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.535326 10364 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:10.537819 10213 connection.cc:256] RPC call timeout handler was delayed by -2.4501807849999295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:17:10.551103 10213 connection.cc:256] RPC call timeout handler was delayed by -2.4348807849999048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:17:10.542364 15287 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.551827 15545 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.543910 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:10.544857 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48054.3us
I20260709 13:17:10.553362 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:10.554277 15375 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:10.554697 15375 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:10.545176 15467 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:10.551586 10213 connection.cc:256] RPC call timeout handler was delayed by -2.2455844060000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:17:10.545775 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.554426 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.558743 10246 raft_consensus.cc:2410] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:10.559358 15545 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.561082 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.562187 15503 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.562642 15503 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:10.563027 15503 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.563236 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.564795 15287 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.565546 15287 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:10.566596 15216 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:10.567440 15509 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:10.567724 15216 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:10.567942 15509 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:10.568184 15216 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:10.569114 15509 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.569188 15216 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.573743 10322 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:17:10.575191 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49027.1us
I20260709 13:17:10.578819 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.580067 15546 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.580741 15546 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.559813 15391 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:10.582167 15391 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:10.582677 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.583361 10322 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:17:10.583150 15391 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.585753 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:10.586020 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.586386 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.586565 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.586930 10323 raft_consensus.cc:2393] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 9: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:10.578951 15317 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.588018 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.588663 10319 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:10.582029 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.549408 15390 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.591008 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:10.592250 15288 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.593034 10317 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:10.555089 15375 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.599681 15309 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:10.600131 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 293507us
W20260709 13:17:10.595448 10213 connection.cc:256] RPC call timeout handler was delayed by -2.0055807849998928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:17:10.597138 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:10.601004 10213 connection.cc:256] RPC call timeout handler was delayed by -1.9848807849998593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22650000000000003s for a response
I20260709 13:17:10.599171 15522 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:10.601349 10213 connection.cc:256] RPC call timeout handler was delayed by -1.8052309459999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 13:17:10.602161 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.598922 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:10.607755 10213 connection.cc:256] RPC call timeout handler was delayed by -1.7122638210000787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:17:10.607836 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.600241 15309 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.610482 10391 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:10.583072 15546 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:10.608407 10213 connection.cc:256] RPC call timeout handler was delayed by -1.7122638210000787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:17:10.608633 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53567.5us
I20260709 13:17:10.612067 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:10.616855 10213 connection.cc:256] RPC call timeout handler was delayed by -1.6173649330000899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 13:17:10.617394 10213 connection.cc:256] RPC call timeout handler was delayed by -1.53909163000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:17:10.617837 10213 connection.cc:256] RPC call timeout handler was delayed by -1.4364916300000914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2324s for a response
I20260709 13:17:10.597049 15288 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.618993 10994 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:10.610494 15452 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:17:10.620048 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:10.620935 10317 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:10.603502 15445 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:10.622292 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:10.623127 10996 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:10.622864 15445 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.608242 15525 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:10.624635 15522 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.625200 15525 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.625614 15525 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.625979 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.626689 10245 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:10.627671 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.628235 10249 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.614245 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:10.630015 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:10.630716 10243 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:17:10.618295 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2406638210002257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:17:10.633030 10213 connection.cc:256] RPC call timeout handler was delayed by -1.183963821000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
I20260709 13:17:10.614501 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.639251 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.643325 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.643353 10391 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:10.647441 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.648167 10393 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.655493 10249 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:17:10.661109 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.655200 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.613139 15216 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:10.662114 10394 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:10.664927 10965 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.669003 10967 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:10.669389 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:10.673046 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:10.660280 15456 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:10.682593 15400 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:10.657126 15390 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:10.649003 15544 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.670729 15519 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.690863 10243 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:10.696779 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.705262 10390 raft_consensus.cc:2410] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:17:10.699472 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 50347.6us
I20260709 13:17:10.701633 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:10.629221 15534 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.668208 15445 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:10.674017 15455 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:10.704921 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.730540 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.699470 15287 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 13:17:10.720124 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 44810.1us
I20260709 13:17:10.696888 15439 raft_consensus.cc:2804] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:10.737759 10996 raft_consensus.cc:2393] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:10.736258 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.741161 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.713477 15400 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:10.702967 15507 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.919040 15507 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.919584 15507 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.752357 10244 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:10.751659 15455 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:10.804708 10147 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 8 to 9, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 9 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:10.806109 10146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 317) took 16796 ms (client timeout 15000 ms). Trace:
I20260709 13:17:10.800730 15514 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:10.817921 15554 log.cc:927] Time spent T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.180s	user 0.000s	sys 0.002s
I20260709 13:17:10.711935 15544 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.703999 15375 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.686035 15546 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:17:10.895396 15551 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.139s	user 0.000s	sys 0.005s
I20260709 13:17:10.896418 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:10.747766 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 74801.9us
I20260709 13:17:10.898195 15534 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.898516 11002 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:10.899036 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.901257 10393 raft_consensus.cc:2468] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:10.901173 15525 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.903205 15439 raft_consensus.cc:697] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:10.729717 15395 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:17:10.967839 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.978145 15561 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:10.914568 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.979775 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 235674us
I20260709 13:17:10.699792 15390 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.915706 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:10.967279 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.981415 15490 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.916625 15417 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.919898 15309 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:10.930379 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 178337us
I20260709 13:17:10.982937 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.971551 15544 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.983598 10394 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.983680 11000 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:10.985198 15439 consensus_queue.cc:237] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.713356 15286 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.980675 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.906388 15503 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:10.991217 15417 raft_consensus.cc:3055] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:10.969283 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.991660 15417 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:10.991886 10997 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:10.992908 15417 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.993331 15503 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.981386 15390 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:10.968621 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.994550 15490 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.996729 15525 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:10.744356 15452 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.998189 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:10.999853 10393 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.975725 15375 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:10.919656 15400 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:10.979430 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:10.977759 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.007043 11001 raft_consensus.cc:2410] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:10.957792 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.008602 10996 raft_consensus.cc:2410] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:10.968385 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.005837 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:11.010056 10249 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:11.019481 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.021040 15544 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.028529 10393 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:11.031834 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.034257 15525 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.035610 15525 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:11.038326 15525 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.040336 10395 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:11.047230 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.991585 15288 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:11.059089 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.061244 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:10.998608 15452 raft_consensus.cc:697] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:11.002497 15417 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.056943 10245 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.008993 15519 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.081528 10245 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:11.084885 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 331552us
I20260709 13:17:11.010701 15526 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:11.086894 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.056136 15561 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.081274 15445 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.093402 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.096212 10399 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:11.064321 15514 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.074324 15309 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.098978 10965 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:11.102821 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.121676 10399 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:11.064448 15490 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:10.970835 15455 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.091782 15288 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:11.132779 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.135814 10399 raft_consensus.cc:2410] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:11.120905 10147 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 5 to 8, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:11.147784 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 90388.4us
I20260709 13:17:11.136906 15309 raft_consensus.cc:2804] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:11.150313 15309 raft_consensus.cc:697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:11.159134 15395 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.159739 15395 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:11.160257 15570 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:17:11.159886 15309 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.150658 15456 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:17:11.163213 10390 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:11.163408 15439 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:11.163929 15439 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:11.163960 15452 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.131174 15544 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:11.162806 15568 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:11.092944 15526 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.174885 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:11.172928 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:11.091490 15519 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:10.948762 10146 rpcz_store.cc:269] 0709 13:16:53.952199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.952417 (+   218us) service_pool.cc:224] Handling call
0709 13:17:10.739583 (+16787166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:01.641973 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:02.009973 (+368000us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:02.027631 (+ 17658us) write_op.cc:435] Acquired schema lock
0709 13:17:02.027659 (+    28us) tablet.cc:662] Decoding operations
0709 13:17:02.144120 (+116461us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:02.144230 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:02.144261 (+    31us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:17:02.215960 (+ 71699us) tablet.cc:701] Row locks acquired
0709 13:17:02.255950 (+ 39990us) write_op.cc:260] PREPARE: finished
0709 13:17:02.278529 (+ 22579us) write_op.cc:270] Start()
0709 13:17:02.315387 (+ 36858us) write_op.cc:276] Timestamp: P: 1783603022261662 usec, L: 0
0709 13:17:02.323064 (+  7677us) op_driver.cc:348] REPLICATION: starting
0709 13:17:02.412701 (+ 89637us) log.cc:844] Serialized 11773 byte log entry
0709 13:17:02.967634 (+554933us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:04.222559 (+1254925us) op_driver.cc:464] REPLICATION: finished
0709 13:17:04.864402 (+641843us) write_op.cc:301] APPLY: starting
0709 13:17:04.864529 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:05.498965 (+634436us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:05.499013 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:06.695226 (+1196213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:06.765334 (+ 70108us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=0,mrs_lookups=0
0709 13:17:06.771600 (+  6266us) write_op.cc:312] APPLY: finished
0709 13:17:07.012707 (+241107us) log.cc:844] Serialized 260 byte log entry
0709 13:17:07.134610 (+121903us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:07.139546 (+  4936us) write_op.cc:454] Released schema lock
0709 13:17:07.290811 (+151265us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:07.512609 (+221798us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:07.517766 (+  5157us) write_op.cc:454] Released schema lock
0709 13:17:07.827421 (+309655us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
Metrics: {"mutex_wait_us":58042,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":626201,"apply.run_cpu_time_us":72835,"apply.run_wall_time_us":2597885,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129587,"num_ops":30,"prepare.queue_time_us":169502,"prepare.run_cpu_time_us":36611,"prepare.run_wall_time_us":1157801,"raft.queue_time_us":509083,"raft.run_cpu_time_us":45546,"raft.run_wall_time_us":489371,"replication_time_us":1856480,"spinlock_wait_cycles":500926208,"thread_start_us":1241018,"threads_started":5,"wal-append.queue_time_us":729656,"wal-append.run_cpu_time_us":33138,"wal-append.run_wall_time_us":3786303}]]}
W20260709 13:17:11.194170 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 463703us
I20260709 13:17:11.198091 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.203033 10394 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 9.
I20260709 13:17:11.215898 15519 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:11.205219 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.206930 15465 raft_consensus.cc:3060] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.207150 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.207916 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.210549 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.211051 15534 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:11.159739 10147 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 9 to 10, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 10 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.218724 10323 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 16: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:11.219555 10394 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:11.162132 15395 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:11.218199 10324 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:11.225162 10147 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 7 to 10, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 10 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:11.226636 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51854.4us
I20260709 13:17:11.230615 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.231513 10323 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:11.151324 15507 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.240669 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.243945 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.246310 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.246758 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.250304 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.250994 10325 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:17:11.252440 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.246061 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:11.221333 15534 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:11.257789 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:11.258426 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.228843 15467 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.236128 15286 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.275200 10392 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:11.283209 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.296353 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:11.262429 15534 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.293272 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.298583 10399 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:11.267727 15467 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:11.299825 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:11.306169 10246 raft_consensus.cc:2393] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:11.300988 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.302266 10390 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:11.304741 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.311965 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:11.269042 15490 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:11.306911 11001 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:17:11.317534 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.318632 10399 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 17: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:11.319267 10249 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:11.310372 10325 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:11.319737 10249 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:11.316144 10392 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:11.322499 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.323616 10394 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:11.326614 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:11.329401 10999 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:11.330899 10390 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:11.333355 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:11.334504 10399 raft_consensus.cc:2368] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:11.315326 15467 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.336184 10147 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 7 to 8, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 8 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.341342 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:11.337944 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 85557.7us
I20260709 13:17:11.338187 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:11.344002 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:11.344673 10392 raft_consensus.cc:2368] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:11.346182 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.346601 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.347121 10996 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:11.348721 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.297807 15390 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.340174 15503 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.362056 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:11.365115 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.367776 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.372903 10392 raft_consensus.cc:2368] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:17:11.366585 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.377743 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.378209 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.379565 10998 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:11.374380 10249 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.358103 15222 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:11.385353 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:11.385571 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.386204 10998 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.386543 10394 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:11.389636 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:11.391541 10249 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.392206 10288 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.399894 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:11.400038 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.406867 10994 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.408660 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.409570 10321 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:11.410653 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.411310 10321 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.413453 10325 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:11.376551 15503 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.392282 15526 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:11.419287 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:11.420274 15576 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:11.425184 10325 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:11.392500 15583 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.426512 10321 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:11.430965 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:11.394814 15490 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:11.418808 15563 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:17:11.441677 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:11.440608 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48483.5us
W20260709 13:17:11.441481 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 70651.8us
I20260709 13:17:11.443663 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:11.445255 10242 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:11.447297 10394 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:11.449370 10321 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:11.418599 15507 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:11.450657 10249 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:17:11.451041 10249 pending_rounds.cc:85] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 9
I20260709 13:17:11.451327 10249 pending_rounds.cc:107] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:11.451650 10249 raft_consensus.cc:2889] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:11.431147 10320 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:11.459956 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.458719 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.443282 15545 raft_consensus.cc:2804] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:11.468889 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.480283 15465 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.482496 15390 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:11.486776 15578 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:17:11.488427 15579 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:11.491308 10245 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.492429 10245 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.497345 10999 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:11.503479 10396 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.506618 10390 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:11.507802 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.508921 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:11.509418 10324 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:11.510756 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.500393 15503 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:11.508212 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.513747 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.515516 15395 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:11.516067 15395 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:11.516026 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.516114 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.517446 15395 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.517892 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.519281 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:11.520486 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.520453 15391 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:11.522851 10362 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.523381 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.536202 10394 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:11.538512 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:11.540944 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.548540 10320 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:11.471843 15545 raft_consensus.cc:697] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:11.551518 10395 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:11.556960 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.558660 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:11.563555 15309 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.563937 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.566300 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:11.568172 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.533423 15455 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.537626 15391 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.486040 15525 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.549537 15561 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.551592 15490 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.558007 15519 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:11.574328 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 63706.1us
I20260709 13:17:11.534490 15452 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:17:11.569236 15309 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.534677 15544 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:11.571942 15391 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:11.662809 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.669653 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:11.670360 15586 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:11.670454 10317 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:11.671581 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.673142 10317 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:11.683241 15391 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.691274 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:17:11.696527 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 173751us
I20260709 13:17:11.698244 10362 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.704723 10998 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:11.667562 15390 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:11.711068 15503 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.733126 10245 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:11.733585 10245 pending_rounds.cc:85] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 6
I20260709 13:17:11.733816 10245 pending_rounds.cc:107] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:11.734066 10245 raft_consensus.cc:2889] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:11.748540 10242 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:11.750406 15503 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.750567 15309 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:11.751184 15525 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:11.754208 15549 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:11.703996 15545 consensus_queue.cc:237] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.754812 15467 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.730671 15490 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.758013 15490 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:11.758466 15490 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:11.759370 15590 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:11.759980 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.760633 10324 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.766767 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:11.786578 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:11.787546 10998 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:11.711464 15534 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.754761 15549 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:11.797832 10998 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:11.809077 10324 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:11.734926 15567 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.770305 15467 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:11.816991 10246 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:11.819239 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:11.820220 10324 raft_consensus.cc:3060] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:11.823874 15509 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:11.826038 15507 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:11.850008 15594 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:17:11.854532 15391 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:11.854432 15549 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.856200 15549 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:11.858582 15503 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:11.863895 15534 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:11.865166 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:11.877736 10288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.879485 10324 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:11.888983 10316 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:17:11.908668 15589 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 13:17:11.919384 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.919775 15216 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:11.920392 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:11.921833 15503 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:11.922490 15503 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:11.923673 15216 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:11.923502 15503 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.924698 15549 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.925096 15549 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:11.925959 15549 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.927270 15549 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:11.932325 15592 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:17:11.960632 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:11.966948 15608 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:17:11.972316 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.972755 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:11.972348 15490 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:11.977528 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2115) took 1424 ms. Trace:
W20260709 13:17:11.979679 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.978113 10244 rpcz_store.cc:276] 0709 13:17:10.553261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.555292 (+  2031us) service_pool.cc:224] Handling call
0709 13:17:10.555655 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.948224 (+392569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.977251 (+1029027us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540043cbd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:11.977460 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435580544}
I20260709 13:17:11.978046 15571 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.988955 15571 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:11.991250 15571 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:11.994136 15567 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.977604 15490 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:11.964483 15417 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:11.994772 15567 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.005375 10248 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.005365 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:12.008217 10394 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:17:12.010432 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:12.011441 10241 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:17:12.014369 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 49169.7us
W20260709 13:17:12.018827 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 327619us
I20260709 13:17:12.022141 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.023036 15490 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.027436 10362 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:12.035084 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:12.035965 10998 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:12.054514 10322 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:17:12.054970 10322 pending_rounds.cc:85] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 11
I20260709 13:17:12.055145 10999 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:12.055189 10322 pending_rounds.cc:107] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:17:12.055668 10322 raft_consensus.cc:2889] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.056205 15490 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:12.061380 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.061921 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.065531 10391 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:12.066166 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:12.068857 10213 leader_election.cc:400] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:17:12.069222 10213 leader_election.cc:403] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:12.014853 15417 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:12.072685 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:12.075960 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.074424 10998 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:12.077780 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:12.078608 10322 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:12.080717 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:12.105582 15569 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.152s	user 0.003s	sys 0.011s
I20260709 13:17:12.108273 15567 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.086820 10321 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:12.030666 14512 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:17:12.047485 15596 raft_consensus.cc:2804] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:12.083267 11001 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:12.151839 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:12.101032 15309 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:12.082094 15514 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:12.156106 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:12.156635 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.153873 10242 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:12.100694 15455 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:12.073494 15490 raft_consensus.cc:3060] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.074862 15525 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.112424 15417 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:12.176040 15417 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.176993 15417 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.178498 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:12.164911 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.170642 15596 raft_consensus.cc:697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.170799 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:12.102288 15549 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:17:12.171702 10241 raft_consensus.cc:3055] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:12.167368 15514 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.193638 10241 raft_consensus.cc:740] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:12.194010 15514 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:12.194841 15614 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:12.194434 15596 consensus_queue.cc:237] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.194684 10241 consensus_queue.cc:260] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.195752 10241 raft_consensus.cc:3060] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:12.196554 15612 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:12.197634 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:12.198995 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.191520 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.167124 15455 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:12.203513 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:12.214748 15615 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:17:12.113320 15510 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:17:12.115427 15597 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.087s
W20260709 13:17:12.216472 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 140561us
I20260709 13:17:12.175509 15620 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.193222 15288 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.201850 15390 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:12.291397 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 92467.5us
I20260709 13:17:12.215924 15455 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.299290 15561 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:12.215546 15591 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.305953 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:12.296077 15619 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:12.309530 10247 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:12.190387 15525 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.315172 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.316551 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.222779 15610 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
W20260709 13:17:12.308674 15563 log.cc:927] Time spent T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:12.302405 15390 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.302063 15288 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.322502 15618 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:12.305588 15605 raft_consensus.cc:2764] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:17:12.330850 15591 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.319507 15534 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.259640 15514 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:12.345216 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 55524.7us
I20260709 13:17:12.350068 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.352679 10994 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:12.342808 15618 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.355557 10247 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:12.356549 15618 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:12.358567 10999 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:12.339210 15390 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.338792 15288 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.343228 15439 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.366431 15625 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:12.367338 15439 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.367893 15625 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.368654 15625 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:12.369336 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:12.370151 10996 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:12.377015 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.378748 10241 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:17:12.379287 10241 pending_rounds.cc:85] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:17:12.379657 10241 pending_rounds.cc:107] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:17:12.380041 10241 raft_consensus.cc:2889] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.314419 15561 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.385629 15561 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:12.386699 15624 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:17:12.378595 15626 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:12.385869 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:12.390493 10993 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 9.
I20260709 13:17:12.391530 15625 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:12.398124 15546 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:12.398697 15546 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:12.399634 15546 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:12.401132 15546 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.416405 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.429010 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:12.445796 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:12.446565 10248 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.404033 15288 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.410826 15525 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:12.449044 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 132564us
I20260709 13:17:12.413199 15514 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:12.437628 15624 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:12.453370 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:12.415202 15561 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:12.476468 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.458273 15534 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:17:12.494268 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.485960 15455 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.505368 10999 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:12.493819 15610 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:12.514557 15627 log.cc:927] Time spent T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:17:12.526111 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.534893 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.471057 15623 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:17:12.542960 15390 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:12.544647 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 2983) took 1191 ms. Trace:
I20260709 13:17:12.545181 15390 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:12.547206 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:12.548653 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 357272us
I20260709 13:17:12.550179 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.550382 10998 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.551460 15507 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.551946 15507 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.552412 15507 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.553119 15375 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:12.545114 10246 rpcz_store.cc:276] 0709 13:17:11.352917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.353153 (+   236us) service_pool.cc:224] Handling call
0709 13:17:11.353583 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.818531 (+464948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.544355 (+725824us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540043dad4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:12.544574 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065230208}
I20260709 13:17:12.555936 10994 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:12.551383 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:12.558125 10998 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:17:12.559461 10248 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:12.565086 10248 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:12.533753 15610 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:12.581404 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.592446 11001 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: [13.11-16.13]
I20260709 13:17:12.592676 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:12.593639 15606 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:12.553951 15628 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.553712 15375 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.559655 15534 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.577775 15596 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.571950 15605 raft_consensus.cc:2764] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:12.554272 15288 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.615330 10395 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:12.616807 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.617585 10398 raft_consensus.cc:1275] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:12.595516 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.600183 10391 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:12.616832 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:12.613478 10392 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:12.593983 15642 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:12.626837 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.627135 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:12.628041 10391 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.628219 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:12.602797 15567 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:12.594293 15606 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.631601 15490 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:17:12.597194 15623 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:17:12.643311 10395 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:12.636911 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:12.648257 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:12.649914 10323 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:17:12.641561 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 88109.6us
I20260709 13:17:12.629118 15391 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:12.642379 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:12.641579 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 420005us
I20260709 13:17:12.627252 15642 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:12.632565 15390 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:12.656993 10319 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [10.6-13.8]
I20260709 13:17:12.697218 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:12.696998 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:12.683790 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.698372 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:12.699029 10321 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:12.635046 14512 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:12.707952 10247 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:17:12.709378 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.711338 10322 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:12.615382 15596 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.712759 10241 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:12.696650 15642 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.645876 15567 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.641880 15618 consensus_queue.cc:1048] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:17:12.646127 15519 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:12.656009 15503 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:12.715732 15637 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:12.735554 15606 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.738591 15534 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:12.739187 15534 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:12.739749 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.741092 10213 leader_election.cc:400] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:12.741345 15534 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:12.741535 15591 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:12.742444 15628 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:12.742476 15636 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:12.743016 15628 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:12.744149 15628 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:12.745607 15628 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.643807 15525 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:17:12.722819 15503 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.747057 15503 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.696954 15584 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.751223 15584 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:12.753484 15631 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.249s	user 0.006s	sys 0.000s
I20260709 13:17:12.753635 15584 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.718484 15544 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:12.755739 15641 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.756319 15641 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.757858 15597 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.762688 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:12.768862 10999 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.769724 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:12.695114 15391 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.741355 10213 leader_election.cc:403] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:17:12.766814 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.715073 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 83621.9us
I20260709 13:17:12.635370 15625 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:17:12.632287 15620 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:12.776686 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.722551 15580 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:12.721947 15567 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.783023 10243 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.793247 15455 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:12.783034 15591 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:12.796147 10325 raft_consensus.cc:2410] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:12.787808 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:12.741963 15534 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:17:12.808244 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:12.810976 10323 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.811072 10391 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:12.767556 15390 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.813921 15642 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.814299 15390 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:12.815384 10392 raft_consensus.cc:1240] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:12.816387 15642 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.768945 14512 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.824115 10999 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:17:12.827368 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:12.835228 10320 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:12.838984 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:12.839818 10316 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:12.810056 15641 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:12.853788 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 112825us
I20260709 13:17:12.854590 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.823624 15620 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.857309 10323 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:12.871047 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:12.873267 15641 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:12.874313 15641 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:12.876559 15644 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:12.877140 15644 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:12.776180 15375 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:12.848021 15642 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:12.893857 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 83664.4us
I20260709 13:17:12.906297 10392 raft_consensus.cc:1275] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:12.907262 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:12.909579 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:12.911082 10391 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.777833 15597 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.913311 10399 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:12.871233 15610 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:12.901764 15643 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:17:12.934881 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80362.5us
I20260709 13:17:12.935796 10213 leader_election.cc:400] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:12.947062 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:12.950466 15646 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:17:12.962893 15596 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.962458 15656 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:12.965075 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.927608 15625 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.977712 10391 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
W20260709 13:17:13.041008 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 102796us
I20260709 13:17:12.889343 15391 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:13.052930 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 87966.2us
I20260709 13:17:13.056756 10213 leader_election.cc:400] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15.
I20260709 13:17:13.058641 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:12.929160 15537 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:17:12.967556 15549 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.965427 15591 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:13.080664 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.056744 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:13.066053 15507 consensus_meta.cc:287] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:17:13.096541 15507 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.100183 15507 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.102319 15650 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:13.103034 15650 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.103482 15650 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:13.103785 15597 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:12.890142 15644 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.107551 15644 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.089305 15490 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.115185 15490 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:13.082947 15561 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:13.117313 15561 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:12.933286 15642 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:17:13.060580 15625 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.064658 15620 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.126739 15510 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.127477 15510 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.092957 15591 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:13.130100 15537 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:13.130668 15549 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.130859 15537 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:13.144939 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 235420us
I20260709 13:17:12.940326 14512 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.147248 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.148659 10248 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 12: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:13.056756 15534 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:13.151381 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 94768.1us
I20260709 13:17:13.161685 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.165904 15395 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:13.167577 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.167476 15638 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:13.172178 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.158727 15537 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.183833 10999 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:17:13.186116 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 105540us
I20260709 13:17:13.187947 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.188483 10323 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:13.190860 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:13.191757 10999 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 16: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:13.193420 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:13.198572 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:13.175426 15549 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.206589 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.211452 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:13.214159 10998 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:13.214713 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:13.210901 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:13.221104 10316 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.217896 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:13.228494 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:13.157469 15591 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.235359 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:13.236202 10324 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.246461 10324 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:13.198869 15638 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:13.233541 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:13.253070 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:13.210826 15510 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.211241 15628 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.224471 15490 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:13.258479 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.259749 10999 raft_consensus.cc:1275] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:17:13.258726 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 102604us
I20260709 13:17:13.224793 15561 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.264995 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:13.227140 15534 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:17:13.260818 15636 consensus_meta.cc:287] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.517s	user 0.016s	sys 0.000s
W20260709 13:17:13.275243 10362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.276507 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:13.282892 15653 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:17:13.290068 10316 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:13.290076 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:13.315436 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 98498.8us
I20260709 13:17:13.295965 11001 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:13.319662 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:13.320886 10399 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:13.275501 15597 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.337481 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:13.339069 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:13.280861 15636 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:13.279114 15591 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:13.278208 15649 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:13.268342 15580 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:17:13.269217 15638 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.329165 15549 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:13.278586 15662 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:17:13.363266 15662 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:13.363670 15662 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:13.364148 15610 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.358862 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:13.364432 15662 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.365800 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:13.354010 15649 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.369292 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:13.371030 15649 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:13.373675 15652 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 13:17:13.374903 10248 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:13.347162 15597 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.377857 15628 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:13.405059 15649 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:17:13.416730 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:13.418941 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.419438 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.421689 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.392733 15644 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:13.424612 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.424875 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:13.427342 10391 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
W20260709 13:17:13.429319 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 99982us
I20260709 13:17:13.431159 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.437776 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.422307 15623 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.453692 15636 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:17:13.462163 15677 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.463097 15636 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:13.463496 15636 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:13.464510 15636 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.465925 15636 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.432054 15519 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.444247 15567 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.444830 15668 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:13.482741 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.444473 15534 consensus_queue.cc:1059] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:17:13.440547 15597 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.479226 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:13.478619 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 196553us
I20260709 13:17:13.431221 15656 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:17:13.484736 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.488430 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:13.448011 15549 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:13.480479 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51506.4us
I20260709 13:17:13.434017 15644 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.494704 10244 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:17:13.499718 15666 log.cc:927] Time spent T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:17:13.484575 15680 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.479254 15623 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.512267 15623 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.482501 15519 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.493230 14512 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:13.497390 15286 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:17:13.515021 15519 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.485668 15567 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:13.498396 15503 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.000s
I20260709 13:17:13.518752 15503 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.519623 15567 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.521004 15503 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.530383 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:13.531461 10316 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:13.540841 10324 raft_consensus.cc:1240] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:13.543674 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:13.544389 10318 raft_consensus.cc:2368] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14.
I20260709 13:17:13.545362 10321 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:13.546216 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:13.531944 15656 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:13.547798 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:13.548584 10390 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:13.532202 14512 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:13.558056 10396 raft_consensus.cc:1217] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 13:17:13.558735 10396 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:13.558991 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:13.559628 10244 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.566732 10320 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:13.487169 15650 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.557548 14512 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.572705 15638 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:13.525056 15390 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:13.575618 10316 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:13.577167 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.580660 10244 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:13.587489 10393 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:13.579002 15606 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.588445 15606 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.595394 15467 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:13.638906 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 145552us
I20260709 13:17:13.532428 15680 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.595932 15467 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:13.586195 15390 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.657253 10317 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:13.613031 15656 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:13.674785 15668 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.688618 15668 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.690723 15680 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.690850 15668 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.684206 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:13.685737 10999 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:17:13.696995 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.716475 15391 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.723327 15390 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.726257 15650 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:13.659147 15519 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:13.645165 15682 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:13.750905 15656 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.738004 15519 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.760473 15644 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:13.765929 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:13.837499 10395 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.783017 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:13.809828 15681 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:17:13.811015 15628 raft_consensus.cc:3055] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:13.812790 15606 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.815500 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.845719 10243 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:13.816222 10244 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:13.817809 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1001) took 1206 ms. Trace:
I20260709 13:17:13.819634 10394 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:13.824713 15467 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.825421 15519 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.832442 10247 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:17:13.850656 10247 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 11
I20260709 13:17:13.850925 10247 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:17:13.851184 10247 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.833982 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.835251 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.837980 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:13.597407 15549 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.852458 10246 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:13.856693 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.857366 10247 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:17:13.859412 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:13.863420 15503 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:13.842672 15628 raft_consensus.cc:740] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:13.847543 10397 rpcz_store.cc:276] 0709 13:17:12.611812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.612002 (+   190us) service_pool.cc:224] Handling call
0709 13:17:12.623666 (+ 11664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.783395 (+159729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.783424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.796202 (+ 12778us) log.cc:844] Serialized 26 byte log entry
0709 13:17:12.923887 (+127685us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:12.923939 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.817390 (+893451us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540010b654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:13.817443 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.817486 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:13.817501 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.817721 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24173,"raft.queue_time_us":12045,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":21764,"spinlock_wait_cycles":341196160,"thread_start_us":127294,"threads_started":1,"wal-append.queue_time_us":285906}
W20260709 13:17:13.869920 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.869092 15619 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.874065 15619 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:13.874563 15619 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.871280 15503 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:13.878682 15503 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.885810 15519 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:13.886445 15519 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.889211 15683 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:13.889801 15683 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.892115 10998 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:13.896328 15683 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.896503 15691 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.897303 15691 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.871840 15618 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:17:13.899951 15691 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:13.899785 15628 consensus_queue.cc:260] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.901109 15628 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:13.901357 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:13.904116 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:13.907094 15662 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.889213 15519 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.909420 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.913071 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.925915 10395 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:13.927891 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:13.936661 15580 consensus_queue.cc:1059] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:13.937433 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:13.938233 15583 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:13.938433 15288 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:13.942366 15288 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:13.917132 15618 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:13.943326 15288 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:13.943671 15618 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.945864 15618 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:13.949388 15619 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:13.951447 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:13.952554 10248 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:17:13.975422 10248 pending_rounds.cc:85] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:17:13.975802 10248 pending_rounds.cc:107] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:17:13.976101 10248 raft_consensus.cc:2889] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.953862 15467 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:13.964488 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.982769 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:13.984330 10999 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:13.987771 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:13.988628 15642 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:13.988934 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.989794 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:13.990499 10998 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:13.991362 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:13.991771 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.000195 10362 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:14.077075 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.100307 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 98493us
I20260709 13:17:14.101500 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:14.120843 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 127314us
I20260709 13:17:14.122198 10399 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:14.138837 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:17:14.143800 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 144479us
I20260709 13:17:14.144737 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:14.147933 10247 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:14.141824 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:13.999502 15628 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:13.990497 15606 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.159932 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:14.160648 10249 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:14.163173 10396 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:14.100268 15395 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.120391 15664 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.118892 15618 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:14.100714 15597 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:14.149461 15636 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:14.119772 15690 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:14.099304 15650 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:17:14.119962 15519 consensus_queue.cc:1059] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:17:14.156781 15668 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:14.474972 15698 log.cc:927] Time spent T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:14.474663 15668 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.434903 15687 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.476491 15703 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.477095 15668 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.477207 15703 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.477963 15668 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.478820 15668 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.165975 15662 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.151541 15605 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:17:14.268095 15537 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.145169 15503 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.158787 15490 consensus_queue.cc:1059] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 13:17:14.187330 15628 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:14.333200 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 229844us
I20260709 13:17:14.300467 15664 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.380034 15619 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.364530 15288 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:14.370039 15580 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:17:14.401397 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 244714us
I20260709 13:17:14.469839 15519 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:14.470878 15641 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:14.473001 15692 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:17:14.474049 15695 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:14.464286 15636 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.135020 15390 consensus_queue.cc:1048] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:17:14.480216 15703 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:14.478749 15694 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:17:14.480414 15618 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:14.547410 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.574092 10397 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:14.575162 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.547770 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.577117 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:14.550137 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.541469 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:14.571503 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.579223 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.552031 15519 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:14.591049 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:14.595335 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 453595us
W20260709 13:17:14.585822 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 275806us
I20260709 13:17:14.538436 15537 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.599107 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.544065 15642 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:17:14.570016 15636 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.559183 15455 consensus_queue.cc:1059] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:17:14.630431 10362 leader_election.cc:400] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14.
I20260709 13:17:14.554525 15288 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.637665 10362 leader_election.cc:403] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:14.633688 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 54528.8us
I20260709 13:17:14.589643 15490 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.594952 15703 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.579934 15705 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.650600 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:14.566618 15641 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.593412 15650 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.627091 15567 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.603953 15395 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.553802 15580 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.654664 15619 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:14.684485 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 77601.7us
I20260709 13:17:14.656527 15703 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:14.709151 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 78901.5us
I20260709 13:17:14.682086 15391 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14.
W20260709 13:17:14.689672 15697 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.297s	user 0.000s	sys 0.002s
I20260709 13:17:14.685308 15544 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.713253 15719 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.716365 15465 consensus_queue.cc:1048] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.725708 15625 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.699271 15703 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:14.728221 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.717324 15580 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.717558 15641 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.714066 15619 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.719033 15288 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.671838 15567 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.708487 15584 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.681739 15395 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.642444 15628 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.688390 15708 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:14.665766 15490 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.669221 15705 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.723821 15719 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.717249 15713 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.668448 15650 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.760231 15395 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:14.753074 15584 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.762364 15650 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:14.668484 15712 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:17:14.763175 15584 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:14.723228 15702 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 13:17:14.760362 15490 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.766573 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.767866 15490 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:14.768688 15707 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:14.768522 15490 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.771714 15605 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.772215 15605 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:14.773141 15490 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.773064 15605 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:14.773809 15467 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.002s
I20260709 13:17:14.739365 15706 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.750743 15455 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:14.778688 15706 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.779372 15674 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:14.779734 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.779932 15674 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:14.781145 15706 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.739118 15503 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.780968 15674 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.745411 15452 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:17:14.739599 15711 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:14.736528 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 86027.5us
I20260709 13:17:14.720427 15668 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.711691 15638 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:14.678493 15519 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.737603 15619 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.756428 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.758988 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.806818 10323 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:14.759904 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.807663 10324 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:14.738250 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1003) took 2111 ms. Trace:
I20260709 13:17:14.747354 15664 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.784595 15605 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.795749 15537 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.715267 15618 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.795775 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.762215 15719 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.792954 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:14.800463 15606 consensus_meta.cc:287] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.630s	user 0.003s	sys 0.008s
I20260709 13:17:14.829228 15606 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:14.829377 15706 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.829638 15662 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:14.830122 15705 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:14.830852 10290 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:14.832149 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:14.834466 15730 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.834753 15729 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:14.834843 15509 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:14.830075 15662 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:14.835412 15729 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.835206 15730 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.807874 15619 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.834019 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:14.808782 10398 rpcz_store.cc:276] 0709 13:17:12.621904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.622064 (+   160us) service_pool.cc:224] Handling call
0709 13:17:12.632824 (+ 10760us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:12.638938 (+  6114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.638995 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:12.644866 (+  5871us) log.cc:844] Serialized 52 byte log entry
0709 13:17:13.809268 (+1164402us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b1800099880. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:13.966785 (+157517us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:13.987904 (+ 21119us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.988145 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.988223 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.728752 (+740529us) raft_consensus.cc:1685] finished
0709 13:17:14.733105 (+  4353us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.733286 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42159,"prepare.queue_time_us":32098,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":21088,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":55272,"spinlock_wait_cycles":284821632,"thread_start_us":157306,"threads_started":1,"wal-append.queue_time_us":1484409}
I20260709 13:17:14.830120 15706 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.843742 15703 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.844681 15490 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.815464 15668 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.843799 15719 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:14.849383 15567 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.871773 15733 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.872395 15733 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.873448 15706 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.874795 15733 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:14.851661 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 58811.5us
I20260709 13:17:14.791147 15455 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:14.878042 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 44106.4us
I20260709 13:17:14.833959 15636 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.850512 15729 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:14.879050 10395 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:14.880035 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.863267 15705 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:14.881713 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.791435 15713 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.881935 10325 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:14.800422 15711 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.874075 15706 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:14.886363 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.886701 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.808063 15638 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.903156 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.901417 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.904047 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.880861 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.882933 15509 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:14.895943 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.908160 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.908540 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:14.909107 10323 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:14.909253 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.896102 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:14.913154 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.913926 10398 raft_consensus.cc:2393] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:14.914726 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.915725 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.916340 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:14.917068 10391 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:14.922426 15720 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:14.923091 15720 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.923504 15716 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:14.925359 15703 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:14.926513 15704 log.cc:927] Time spent T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.332s	user 0.004s	sys 0.000s
I20260709 13:17:14.928927 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1007) took 2005 ms. Trace:
I20260709 13:17:14.929065 10390 raft_consensus.cc:1240] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.884529 15455 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.929315 10392 rpcz_store.cc:276] 0709 13:17:12.924002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.924424 (+   422us) service_pool.cc:224] Handling call
0709 13:17:12.924839 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.930411 (+  5572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.930440 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.936890 (+  6450us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.146903 (+1210013us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800154c60. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:14.405775 (+258872us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:14.405834 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.405950 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.925860 (+519910us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:14.928668 (+  2808us) raft_consensus.cc:1685] finished
0709 13:17:14.928691 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.928855 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10241,"raft.queue_time_us":17296,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":86212,"spinlock_wait_cycles":14327296,"thread_start_us":258618,"threads_started":1,"wal-append.queue_time_us":1479290}
I20260709 13:17:14.931339 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2511) took 1584 ms. Trace:
I20260709 13:17:14.931722 10390 rpcz_store.cc:276] 0709 13:17:13.347002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.549174 (+202172us) service_pool.cc:224] Handling call
0709 13:17:14.928855 (+1379681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.929574 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.931134 (+  1560us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002dd050. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:14.931279 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3172253440}
I20260709 13:17:14.932176 15711 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.864426 15730 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.899619 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.934617 15730 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.900116 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.901077 10321 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:14.936376 10317 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:14.937491 10321 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:14.906704 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.939465 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3004) took 1489 ms. Trace:
I20260709 13:17:14.940217 15638 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.939857 10248 rpcz_store.cc:276] 0709 13:17:13.449606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.449761 (+   155us) service_pool.cc:224] Handling call
0709 13:17:13.450086 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.985616 (+535530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.939229 (+953613us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54000b95d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:14.939402 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154540928}
I20260709 13:17:14.870323 15490 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.941817 15519 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:14.942737 15490 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.925477 15720 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.877748 15668 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.945793 15668 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.897928 15662 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.947027 10392 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:14.947165 15662 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.949210 15623 raft_consensus.cc:3055] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:14.949661 15623 raft_consensus.cc:740] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:14.950609 15623 consensus_queue.cc:260] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.951172 10323 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:14.952244 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.898653 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.954357 10322 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:14.955400 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56862.8us
I20260709 13:17:14.956398 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:14.959082 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.959394 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.959987 10325 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:14.963209 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:14.963905 10245 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:14.964641 10246 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:14.962635 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:14.968523 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:14.958652 15623 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:14.977443 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:14.981736 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:14.959115 15618 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.985246 15625 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.985486 15725 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:14.985862 15625 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.986091 15725 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.986676 10325 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:17:14.986981 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.985366 15719 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:14.988049 15719 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.990332 15719 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.990543 15651 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:14.991219 15651 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.993484 15651 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.993664 15636 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.986413 15606 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:14.986402 15625 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.995235 15606 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.997498 15606 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:14.998292 15708 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.998943 15391 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:14.998768 15708 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.999475 15391 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.000496 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:15.000995 15708 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:15.001513 15391 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.002892 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:15.005563 15650 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:15.008203 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:14.960879 15490 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.009410 15455 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.009820 15490 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.012193 15490 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:14.961051 15668 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.013227 15668 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:14.906075 15706 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:14.990625 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:15.019829 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.018915 10249 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:15.040561 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:14.986600 15725 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:15.054924 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.067900 10999 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:15.060832 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.069123 10998 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:15.051980 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:15.066669 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.001542 15708 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.038429 15544 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:15.085619 15544 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:15.086164 15544 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.041814 15638 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:15.091187 15638 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.093019 15729 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.093693 15638 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.094496 10319 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:15.102375 15708 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.104887 15708 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:15.108013 15736 log.cc:927] Time spent T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:15.108974 15738 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.078209 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 99192us
I20260709 13:17:15.078640 15503 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:15.111580 15503 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.111981 15503 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:15.114614 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.116078 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.117278 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.117899 10999 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 10.
I20260709 13:17:15.074658 15467 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:15.118440 15467 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.118817 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.119468 11001 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:15.120316 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:15.111191 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.118852 15467 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:15.005436 15619 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.125178 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:15.125622 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:15.147789 10391 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:15.129540 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.130988 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.134981 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.139133 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.141534 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.142186 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.109563 15738 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.158812 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:15.149266 10994 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:15.149318 10250 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:15.154117 10318 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:15.161055 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:15.154516 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:15.167325 10397 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.168787 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:15.169131 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.169818 10244 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:15.170673 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.171394 10316 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:15.171288 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:15.175732 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:15.177803 10398 raft_consensus.cc:2393] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 12: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:15.180262 15656 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:15.180779 15656 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.182134 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:15.161484 15455 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.147334 15519 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:15.188397 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.184875 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:15.163131 15638 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:15.162483 15605 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.111191 15625 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.183032 15618 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.154141 15537 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:15.182530 15636 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.162300 15391 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:15.189002 15705 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.189033 15597 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:17:15.243522 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:15.247090 15738 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.209890 15636 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.209623 15710 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:15.307945 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 55076.6us
I20260709 13:17:15.249106 15668 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.206657 15733 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.215557 15728 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:15.162580 15687 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:15.216301 15658 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.205288 15713 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.215039 15735 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:15.216675 15684 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.244367 15490 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:15.245344 15729 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.250101 15544 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.211768 15618 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.200801 15638 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.193055 15455 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.199932 15580 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:15.256035 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.199282 15519 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.200096 15605 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.177605 15651 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:17:15.257355 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:15.259312 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.262914 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.263134 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2514) took 1915 ms. Trace:
I20260709 13:17:15.243957 15706 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:15.278339 10364 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.193:40671 timed out after 1.670s (SENT) [suppressed 1 similar messages]
I20260709 13:17:15.308552 10246 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:15.355397 10396 rpcz_store.cc:276] 0709 13:17:13.347879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.559585 (+211706us) service_pool.cc:224] Handling call
0709 13:17:13.560286 (+   701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.163755 (+603469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.262893 (+1099138us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400032854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:15.263058 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386037504}
W20260709 13:17:15.370481 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.197126 15656 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:15.319339 10399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2173) took 2036 ms (client timeout 2050 ms). Trace:
W20260709 13:17:15.322788 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.407349 10399 rpcz_store.cc:269] 0709 13:17:13.283108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.338763 (+ 55655us) service_pool.cc:224] Handling call
0709 13:17:15.319182 (+1980419us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54003b9cd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:15.319284 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798791552}
I20260709 13:17:15.315136 15662 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.329309 15619 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.427230 10243 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:17:15.427738 10243 pending_rounds.cc:85] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 12
I20260709 13:17:15.427977 10243 pending_rounds.cc:107] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:17:15.428210 10243 raft_consensus.cc:2889] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.326030 15733 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.309641 15647 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.309588 15391 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.310801 15636 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.310217 15705 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.311467 15710 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:15.337668 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 161965us
I20260709 13:17:15.451795 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.452003 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:15.344066 15490 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.409376 15713 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.410560 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.412859 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.349476 15580 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:15.330511 15503 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:15.435173 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 108401us
W20260709 13:17:15.453964 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 129135us
I20260709 13:17:15.453969 10320 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:15.455359 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.467303 10246 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:15.467624 10245 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:15.404039 15712 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:15.470431 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:15.437213 15733 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.488263 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.481199 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.485442 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:15.348176 15684 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.450552 15706 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.508040 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:15.467641 15490 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.345453 15735 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.456655 15710 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.529897 10250 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:15.549993 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.551334 10249 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 9.
I20260709 13:17:15.471956 15580 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:15.475203 15391 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.472963 15747 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:15.437817 15662 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.404101 15725 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.542382 15683 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.519516 15745 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.479756 15713 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.482213 15647 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.649526 10250 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 13:17:15.644642 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 366311us
I20260709 13:17:15.690783 10250 pending_rounds.cc:85] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:17:15.691769 10250 pending_rounds.cc:107] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:15.684966 15760 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.688125 10243 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
W20260709 13:17:15.649863 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 176952us
I20260709 13:17:15.692552 10243 pending_rounds.cc:85] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:17:15.692950 10243 pending_rounds.cc:107] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:15.693246 10243 raft_consensus.cc:2889] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:15.646449 15467 consensus_meta.cc:287] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:17:15.694355 10250 raft_consensus.cc:2889] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.522482 15706 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.646095 15745 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.720203 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.721292 10250 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:15.655818 15738 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:17:15.703094 15743 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:17:15.747558 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 277358us
I20260709 13:17:15.648571 15683 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.740448 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.573342 15747 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.754792 10250 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:15.701593 15760 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:15.703342 15746 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.728801 15745 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:15.739643 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.780166 10246 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:15.781769 15747 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.723649 15642 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:15.704871 15467 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.749461 15519 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.752988 15544 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.803488 10246 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:15.753746 15619 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:15.806521 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 315381us
I20260709 13:17:15.761327 15605 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.757966 15760 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.816272 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.821398 10321 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:15.746819 15738 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.823170 10364 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.787403 15455 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:15.822449 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 335744us
I20260709 13:17:15.810062 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:15.835327 10245 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:15.835848 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:15.838079 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:15.839018 10316 raft_consensus.cc:2410] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:15.815718 15519 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:15.851424 10316 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:15.841054 10324 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:15.841885 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.822402 15638 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.824935 15503 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.826534 15651 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:15.861649 15605 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.817355 15597 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:17:15.834003 15747 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:15.777876 15746 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.852619 15507 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:15.856181 15662 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.821518 15619 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.857514 15705 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:15.876000 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:15.861785 15770 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:15.872376 15708 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:15.874153 15597 consensus_queue.cc:1243] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:15.884397 10245 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:15.858822 15519 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.897756 15705 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.898384 15705 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.900939 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.901603 10994 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:15.877861 15735 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:15.902878 10999 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:15.879056 15747 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.875007 15605 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.920683 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.891180 15713 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:15.901791 15744 log.cc:927] Time spent T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:17:15.928364 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:15.929600 10245 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:17:15.930287 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.931624 10999 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:17:15.933993 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.938994 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.942314 15519 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:15.944401 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:15.929811 15766 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.969462 15766 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:15.921525 15391 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:15.890501 15656 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:15.983604 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 141784us
I20260709 13:17:15.984834 10998 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
W20260709 13:17:15.992355 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.995285 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.902295 15770 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:15.934039 15684 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.005832 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.013718 10993 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:16.018151 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:16.005085 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.983989 15725 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.027072 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:16.030382 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.006596 15713 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:17:16.074100 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 43778.4us
I20260709 13:17:16.078698 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:15.998656 15768 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:16.012445 15735 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:16.013130 15683 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:15.981072 15745 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.035452 15507 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:16.086459 10242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.012s
W20260709 13:17:16.085067 10318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.000s	sys 0.028s
W20260709 13:17:16.076365 15636 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.005s
I20260709 13:17:16.092384 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.006919 15467 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.077073 15662 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:16.095679 10242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.000s	sys 0.012s
I20260709 13:17:16.121146 10248 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.095933 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.105018 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.033663 15620 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:17:16.116408 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:16.015245 15391 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:17:16.035830 15779 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:16.122412 10993 raft_consensus.cc:2468] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:16.082909 15597 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:16.093801 15623 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.029s
I20260709 13:17:16.124017 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.093571 15507 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:16.123394 15591 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.122453 15636 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.131352 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.132719 15619 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:16.133780 15747 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.134995 15656 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:16.135833 15746 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.090499 15768 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.147080 15768 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.148216 10996 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:17:16.151574 15490 consensus_meta.cc:287] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:17:16.152063 15490 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.153337 15687 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:16.153752 15687 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:16.154599 15687 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.154811 15591 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.155714 15687 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.155906 15490 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.155418 15745 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.111728 15738 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:16.161587 15710 consensus_meta.cc:287] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.003s
I20260709 13:17:16.162919 15658 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.163024 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.163511 15658 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.163750 10997 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:16.167078 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.168268 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:16.169560 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.140473 11001 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:17:16.085502 15713 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.142601 15507 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.176136 15713 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.178859 15662 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:16.181497 15753 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.477s	user 0.001s	sys 0.001s
W20260709 13:17:16.182541 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.186187 15591 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.187261 15770 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.140985 15597 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:17:16.189703 15748 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.643s	user 0.002s	sys 0.000s
I20260709 13:17:16.189831 15597 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.190641 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.193502 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.197397 15788 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:16.200771 15580 consensus_meta.cc:287] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
I20260709 13:17:16.201251 15580 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.203230 15391 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:16.203819 15391 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.208459 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.209300 11001 raft_consensus.cc:2393] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:16.210405 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.210919 10998 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.211022 15605 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.212031 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.213307 15580 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.178015 15636 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.216802 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2181) took 1253 ms. Trace:
I20260709 13:17:16.217101 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:16.217887 10997 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:16.217334 10242 rpcz_store.cc:276] 0709 13:17:14.963370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.965828 (+  2458us) service_pool.cc:224] Handling call
0709 13:17:14.976859 (+ 11031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.344892 (+368033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.344921 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.404490 (+ 59569us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.121638 (+717148us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:16.121682 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.121749 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.216567 (+ 94818us) raft_consensus.cc:1685] finished
0709 13:17:16.216588 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.216739 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13717,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":1032145,"threads_started":2,"wal-append.queue_time_us":779715}
I20260709 13:17:16.219029 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.219817 10323 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:16.222479 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:16.223232 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:16.122908 15735 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:16.206024 15391 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:16.225136 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.170169 15623 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.000s	sys 0.030s
I20260709 13:17:16.238699 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.224710 10320 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.247172 10244 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:16.243930 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:16.248430 10243 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.248745 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:16.242849 15584 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:16.252139 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.252534 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.253365 10323 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:16.250737 10290 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:16.244848 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 211950us
I20260709 13:17:16.257506 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:16.251847 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.260476 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.263136 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.260253 15391 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.264189 15391 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.264581 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:16.265704 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.266460 15656 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.266922 15656 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.267341 15656 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.162039 15710 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.270283 15710 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.270510 15391 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:16.271325 15733 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.001s
I20260709 13:17:16.271787 15733 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.273979 10249 raft_consensus.cc:1240] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.275720 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.276175 10395 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:16.276727 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.277041 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.277336 10249 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:16.277814 10398 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:16.278120 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.278563 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.278759 10395 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:16.279668 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.279719 10967 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:16.282262 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.282620 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.282773 15712 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.283027 15619 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:16.283303 15712 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.283500 15619 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.283931 15619 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:16.284204 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.284816 10393 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:16.285739 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.286438 10391 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:16.249694 15774 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.287215 15618 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.287751 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2180) took 1324 ms. Trace:
I20260709 13:17:16.283042 10997 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:16.288712 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2176) took 1326 ms. Trace:
I20260709 13:17:16.289069 10241 rpcz_store.cc:276] 0709 13:17:14.961845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.964644 (+  2799us) service_pool.cc:224] Handling call
0709 13:17:14.964937 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.965241 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.965272 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.973738 (+  8466us) log.cc:844] Serialized 26 byte log entry
0709 13:17:15.943681 (+969943us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b180021ebc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:16.122999 (+179318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.123036 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.123797 (+   761us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.288424 (+164627us) raft_consensus.cc:1685] finished
0709 13:17:16.288445 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.288658 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3025,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":4381,"spinlock_wait_cycles":20467456,"thread_start_us":179134,"threads_started":1,"wal-append.queue_time_us":1252107}
I20260709 13:17:16.288167 10247 rpcz_store.cc:276] 0709 13:17:14.963096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.965370 (+  2274us) service_pool.cc:224] Handling call
0709 13:17:14.965621 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.015880 (+ 50259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:15.407941 (+392061us) log.cc:844] Serialized 14 byte log entry
0709 13:17:15.738905 (+330964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:15.738982 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:15.740854 (+  1872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.287535 (+546681us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b54000a8a54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:16.287583 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.287696 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3608,"prepare.queue_time_us":669718,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":299338,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":13474,"spinlock_wait_cycles":114960128,"thread_start_us":722107,"threads_started":3,"wal-append.queue_time_us":276665}
I20260709 13:17:16.291962 15774 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.296175 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.283249 10399 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:16.306915 10320 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:16.310149 10320 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:16.310107 10967 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.312908 10320 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:16.316597 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 55883.7us
I20260709 13:17:16.317611 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.318972 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.323840 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.335932 10320 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:16.336380 10399 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.337159 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:16.325198 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2178) took 2647 ms. Trace:
I20260709 13:17:16.339571 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.339468 10394 rpcz_store.cc:276] 0709 13:17:13.677892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.860068 (+182176us) service_pool.cc:224] Handling call
0709 13:17:13.860388 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.860867 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.860908 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.861489 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:17:15.202805 (+1341316us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b18000e8840. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:15.354654 (+151849us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:15.354690 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.354755 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.189108 (+834353us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:16.324911 (+135803us) raft_consensus.cc:1685] finished
0709 13:17:16.324941 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.325126 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1958,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7116,"spinlock_wait_cycles":34889344,"thread_start_us":151667,"threads_started":1,"wal-append.queue_time_us":1575903}
I20260709 13:17:16.322479 15391 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.342535 15391 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.344027 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.326198 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.326423 15620 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:16.347522 15620 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:16.348428 15620 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:16.326542 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.326939 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.292850 15733 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.327131 10318 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.345886 15391 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.322937 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:16.332949 11000 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.293352 15711 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:16.351635 15711 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:16.353163 15711 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.351203 15391 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.358181 15391 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.374919 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.306414 15584 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:16.378371 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 47255.7us
I20260709 13:17:16.416082 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:16.418041 10323 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:16.434726 10399 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:16.444862 10243 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:16.330518 15455 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.332805 15650 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.330564 15781 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:16.327669 15725 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 13:17:16.476912 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.484038 11001 raft_consensus.cc:1240] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:16.466740 15650 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.493474 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.305807 15774 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.492731 15606 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:16.499104 15650 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.516390 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:16.517311 10249 raft_consensus.cc:2368] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15.
I20260709 13:17:16.500905 15729 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.507025 15584 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:16.544723 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 420787us
I20260709 13:17:16.518203 15606 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:17:16.547277 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 221739us
I20260709 13:17:16.549261 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:16.551422 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.476212 15781 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.519025 15733 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.557134 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.557443 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.557631 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:16.570410 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.580514 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 264831us
I20260709 13:17:16.586367 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:16.598173 15490 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:16.598860 15490 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.599354 15490 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:16.568187 15561 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.178s	user 0.018s	sys 0.016s
I20260709 13:17:16.652419 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:16.575383 15779 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:16.571014 15455 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.532528 15729 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.581404 15317 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.664580 15781 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.666872 15774 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.588727 15656 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:16.672681 15794 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:16.653258 15720 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:16.560415 15793 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.653189 15802 raft_consensus.cc:3055] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:16.653577 15561 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.268s	user 0.018s	sys 0.016s
I20260709 13:17:16.554340 15507 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.581678 15391 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.696237 10249 raft_consensus.cc:1217] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[13.11-17.13]   Dedup: 13.11->[15.12-17.13]
I20260709 13:17:16.570781 15733 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.684286 15606 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:16.716046 15760 consensus_meta.cc:287] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.000s
I20260709 13:17:16.717305 15706 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.684314 15455 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.723855 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.724884 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.725040 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.725865 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.727749 10391 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:16.803794 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.817284 10395 raft_consensus.cc:2410] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:16.685679 15317 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:16.753916 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.807874 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.828346 10393 raft_consensus.cc:2393] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:16.809690 10249 pending_rounds.cc:85] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 11
W20260709 13:17:16.810817 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 123315us
I20260709 13:17:16.815120 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.815351 10399 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:16.713675 15779 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:16.817792 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.743642 15780 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.829974 10391 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 10.
I20260709 13:17:16.831173 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.815526 15760 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.833614 10250 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.831010 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:16.835206 10390 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.695447 15802 raft_consensus.cc:740] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:16.847864 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:16.848337 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 185339us
W20260709 13:17:16.849601 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.851969 15779 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:16.854363 15789 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:16.856937 15793 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:16.858085 15745 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.858996 15703 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:16.858757 15745 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.859735 15703 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:16.860255 15703 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:16.861096 15745 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.861610 15733 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:16.864760 15775 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.865439 15775 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:16.867085 15790 log.cc:927] Time spent T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:17:16.867861 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:16.871563 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.876919 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:16.695076 15597 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:16.878352 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:16.839841 15317 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.816095 10394 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:16.831091 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:16.885526 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 328735us
I20260709 13:17:16.894490 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:16.890764 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:16.897256 10244 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:17:16.612928 15787 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:16.835630 10249 pending_rounds.cc:107] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:17:16.904229 10249 raft_consensus.cc:2889] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.846189 15760 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.846467 15729 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.907410 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.908355 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:16.909219 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:16.875783 15606 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.917861 10391 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:17.005040 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 95932.5us
I20260709 13:17:16.911495 10394 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:16.822153 15490 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.016880 15775 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.022137 15490 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:16.878549 15680 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
W20260709 13:17:17.003795 15658 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.840s	user 0.015s	sys 0.000s
I20260709 13:17:16.899386 15467 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:17.033111 15816 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:17.033684 15656 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:17.035336 15687 consensus_meta.cc:287] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.879s	user 0.009s	sys 0.005s
I20260709 13:17:16.901059 15703 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:16.905347 15503 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:16.879371 15796 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:16.918035 15787 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.003398 15735 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:17.004313 15793 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:16.914321 15798 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:17.027559 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 142271us
I20260709 13:17:16.905180 15509 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.906081 15745 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.912257 15720 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:17:17.100616 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:17.046633 10398 raft_consensus.cc:2410] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:17:17.087211 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:17.090166 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:17.082033 15650 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.005s
I20260709 13:17:17.106706 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:17.104218 10323 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:16.911360 15636 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 13:17:17.111171 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:17.115484 10321 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:17.074476 15733 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:17.039953 15467 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:17.076449 15597 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.084522 15503 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.120658 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:17.092002 15745 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:17.044106 15811 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:17:17.132275 15507 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.117008 15650 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.139014 15650 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.139365 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:17.139786 10390 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:17.144658 15787 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.124842 15733 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.149000 15733 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:17.090332 15793 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.152127 15793 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:17.090133 15735 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.154651 15735 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:17.155444 15455 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:17.156196 15712 consensus_meta.cc:287] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.872s	user 0.001s	sys 0.010s
I20260709 13:17:17.156651 15712 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.158208 10323 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:17.040544 15658 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:17.171381 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.162340 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:17.124014 15467 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:17.189378 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 152545us
I20260709 13:17:17.190860 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:17.126401 15503 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:17.194844 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:17.131268 15745 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.093538 15796 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.202212 15823 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.201476 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:17.207177 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:17.196688 15465 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.208382 10397 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:17.199695 15710 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.227190 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:17.230527 15796 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:17.195219 15317 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.238076 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:17.240366 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:17.198174 15729 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:17:17.223634 15811 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.225343 15465 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:17.204568 15597 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:17.255970 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:17.258688 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:17.259119 15658 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:17.259665 15606 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.260123 15606 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.260468 15606 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.261685 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:17.250504 15465 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.264887 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:17.266753 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:17.267964 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:17.269541 15760 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:17.269899 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.270097 15760 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.270533 10392 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:17.270584 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:17.271219 10994 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:17.271842 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.272219 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:17.272526 10392 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:17.272369 15509 consensus_queue.cc:1059] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:17.272822 10995 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
I20260709 13:17:17.205183 15798 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:17.273687 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:17.276460 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.277774 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.247321 15812 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.278769 10249 pending_rounds.cc:85] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:17:17.287849 10249 pending_rounds.cc:107] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:17.280032 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.288147 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.250118 15811 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:17.284164 15815 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.566s	user 0.000s	sys 0.002s
I20260709 13:17:17.285583 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:17.286953 15814 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.572s	user 0.001s	sys 0.001s
I20260709 13:17:17.247991 15712 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:17.288591 10390 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:17.281387 15317 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.275746 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:17:17.283910 15619 consensus_meta.cc:287] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 1.000s	user 0.012s	sys 0.000s
I20260709 13:17:17.289510 10249 raft_consensus.cc:2889] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.290096 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.249199 15636 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.293452 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:17.295264 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.296198 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.250685 15779 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:17:17.272214 15760 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:17.297664 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:17.296252 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 101537us
I20260709 13:17:17.279022 15680 raft_consensus.cc:3055] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:17.293141 15811 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.319808 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:17.316231 10395 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:17.379710 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.380455 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.381227 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.356081 15680 raft_consensus.cc:740] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:17.378132 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:17.381305 10395 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:17.345554 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.345633 15733 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:17.463280 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 85252us
I20260709 13:17:17.465327 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:17.469655 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.474740 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.470464 10394 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:17.476044 10390 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:17.477947 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:17.360877 15317 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
W20260709 13:17:17.425962 15814 log.cc:927] Time spent T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:17.492656 10994 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:17.492707 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:17.500710 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:17.426427 15733 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.407492 15623 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:17.505483 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 236659us
I20260709 13:17:17.510651 10995 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:17.312484 15619 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.515034 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:17.529459 10395 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:17.476114 15754 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:17.595381 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.615072 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 201918us
I20260709 13:17:17.617213 10998 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 18: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:17.618108 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2832) took 2279 ms. Trace:
I20260709 13:17:17.534739 15733 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:17.615978 15729 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.618630 10319 rpcz_store.cc:276] 0709 13:17:15.319342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.404645 (+ 85303us) service_pool.cc:224] Handling call
0709 13:17:15.405053 (+   408us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:15.405600 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.405640 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:15.409796 (+  4156us) log.cc:844] Serialized 78 byte log entry
0709 13:17:15.837473 (+427677us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:15.859469 (+ 21996us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.261351 (+1401882us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b180047c680. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287
0709 13:17:17.261692 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.573000 (+311308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.573129 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.592075 (+ 18946us) raft_consensus.cc:1685] finished
0709 13:17:17.592108 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.598535 (+  6427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12179,"prepare.queue_time_us":24021,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":52712,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":39015,"spinlock_wait_cycles":153089024,"thread_start_us":715730,"threads_started":3,"wal-append.queue_time_us":430829,"wal-append.run_cpu_time_us":2651,"wal-append.run_wall_time_us":1117892}
I20260709 13:17:17.592399 15584 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:17.527153 15317 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.623648 15680 consensus_queue.cc:260] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.644507 15680 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.564499 15623 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:17.652755 10395 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:17.670848 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.672431 10994 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:17.674705 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:17.682462 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:17.633383 15467 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.688560 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:17.650031 15835 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:17:17.674587 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.649504 15745 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.664829 15625 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:17.649322 15584 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:17.658084 15729 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:17:17.678915 15703 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:17.697300 15726 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:17.700519 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:17.682646 15636 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:17.701292 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 173937us
I20260709 13:17:17.691704 15735 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.705950 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:17.750048 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.806588 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 129877us
W20260709 13:17:17.730960 15826 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
W20260709 13:17:17.710724 15832 log.cc:927] Time spent T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:17:18.049901 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.194969 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:17.920490 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:17.952479 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 240693us
I20260709 13:17:18.212667 10290 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:17.710963 15636 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:17.926286 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:17.725543 15719 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.711349 15735 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.215978 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:17.943008 15839 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:17:17.707508 15623 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:17.712416 15834 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:18.219239 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:17.950109 15796 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.807125 15760 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.224995 15856 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.227918 10391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1034) took 1417 ms. Trace:
W20260709 13:17:18.229004 10246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39884 (request call id 3016) took 2818 ms (client timeout 2257 ms). Trace:
I20260709 13:17:18.229112 10248 raft_consensus.cc:1240] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.026070 15467 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.143201 15664 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:18.243919 10246 rpcz_store.cc:269] 0709 13:17:15.410034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.485099 (+ 75065us) service_pool.cc:224] Handling call
0709 13:17:18.228713 (+2743614us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b540006e5d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.228892 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666984704}
I20260709 13:17:18.245877 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:18.247185 10246 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:18.231487 10398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 1024) took 1507 ms. Trace:
I20260709 13:17:18.231263 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:18.147711 15503 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.947s	user 0.011s	sys 0.002s
W20260709 13:17:18.128198 15606 consensus_meta.cc:287] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.000s
W20260709 13:17:18.099601 15846 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:17:17.941375 15837 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:17:18.119309 15465 consensus_meta.cc:287] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.001s
I20260709 13:17:18.240844 15580 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.260221 15465 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.249094 15856 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.262568 15465 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:18.236439 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 310274us
I20260709 13:17:18.262941 15856 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.263562 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:18.253116 15503 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.265671 15503 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.253334 15606 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.268448 15606 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:18.269068 15606 consensus_queue.cc:1059] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:18.270184 10393 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:18.246141 15754 consensus_meta.cc:287] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.002s
I20260709 13:17:18.238642 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:17.706326 15726 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:17.989703 15793 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.035389 15745 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:17.813977 15775 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:17.812630 15619 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:18.223438 15845 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:18.234920 11001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.094s	sys 0.258s
I20260709 13:17:18.009804 15317 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.234011 15719 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:17.914878 15781 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.243798 10391 rpcz_store.cc:276] 0709 13:17:16.813792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.832124 (+ 18332us) service_pool.cc:224] Handling call
0709 13:17:16.832421 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.005153 (+172732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.227587 (+1222434us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b540021b454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.227823 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196011264}
I20260709 13:17:18.290521 15726 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.247995 10243 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.247681 10398 rpcz_store.cc:276] 0709 13:17:16.723710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.723823 (+   113us) service_pool.cc:224] Handling call
0709 13:17:18.231242 (+1507419us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000bbdd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.231420 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526368512}
I20260709 13:17:18.250250 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:18.306535 10246 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:18.307442 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.308025 10246 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:18.239751 15735 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.235244 15636 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.241756 15651 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:17.713802 15703 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.273422 10395 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:18.189276 15811 consensus_meta.cc:287] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.005s
I20260709 13:17:18.276156 10390 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:18.281353 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.282538 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:18.285005 10288 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.095s	sys 0.158s
I20260709 13:17:18.286094 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3047) took 1407 ms. Trace:
I20260709 13:17:18.116480 15733 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.288475 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.245816 15664 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:18.289260 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:18.291890 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 379014us
I20260709 13:17:18.293081 15775 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:18.298874 11001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.095s	sys 0.258s
I20260709 13:17:18.299459 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.266805 15831 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:18.246371 15796 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.287914 15754 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.148976 15647 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.287696 15465 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.303591 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.304840 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.246505 15760 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.312348 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:18.303570 15719 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:18.320492 10288 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.095s	sys 0.159s
I20260709 13:17:18.299233 15793 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.360738 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.382287 10246 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:17:18.382630 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 717042us
I20260709 13:17:18.383965 10319 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:18.384938 10323 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.386395 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:18.386720 10318 raft_consensus.cc:1240] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:18.387501 10316 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:18.396374 10316 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:17:18.396700 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:18.388202 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.397490 10398 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:18.393391 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:18.399586 10242 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:18.400588 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3037) took 2081 ms. Trace:
I20260709 13:17:18.401007 10241 rpcz_store.cc:276] 0709 13:17:16.319404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.663915 (+344511us) service_pool.cc:224] Handling call
0709 13:17:16.664539 (+   624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.861991 (+197452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.862024 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.862830 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.039496 (+176666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:17.039536 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.400213 (+1360677us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400070154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.400268 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.400311 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:18.400324 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.400529 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3127,"raft.queue_time_us":418,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":453150080,"thread_start_us":176342,"threads_started":1,"wal-append.queue_time_us":296721,"wal-append.run_cpu_time_us":1477,"wal-append.run_wall_time_us":1028960}
I20260709 13:17:18.400133 15802 consensus_queue.cc:260] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.411525 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:18.423975 10391 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:18.413462 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 2213) took 1117 ms. Trace:
I20260709 13:17:18.424443 10246 rpcz_store.cc:276] 0709 13:17:17.296382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.312104 (+1015722us) service_pool.cc:224] Handling call
0709 13:17:18.413369 (+101265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.404778 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.343937 10243 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:18.426661 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 2214) took 1122 ms. Trace:
I20260709 13:17:18.382359 10317 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:18.422271 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:18.428223 10994 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:18.334769 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.316344 15711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.959s	user 0.008s	sys 0.052s
I20260709 13:17:18.430183 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:18.432386 10241 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:18.433346 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3049) took 1528 ms. Trace:
I20260709 13:17:18.433768 10241 rpcz_store.cc:276] 0709 13:17:16.904960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.431744 (+1526784us) service_pool.cc:224] Handling call
0709 13:17:18.432150 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.433012 (+   862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.433273 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.320544 10249 rpcz_store.cc:276] 0709 13:17:16.878825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.278285 (+399460us) service_pool.cc:224] Handling call
0709 13:17:17.278600 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.304761 (+ 26161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.304795 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.305257 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.627631 (+322374us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:17.627668 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.627735 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.285809 (+658074us) raft_consensus.cc:1685] finished
0709 13:17:18.285835 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.285978 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":322083,"threads_started":1,"wal-append.queue_time_us":379504}
I20260709 13:17:18.437712 15674 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.438055 15619 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:18.438516 15619 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.438911 15619 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:18.442514 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.443799 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.444824 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.445469 10398 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:18.437611 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:18.448468 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.449383 10316 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:18.405601 15779 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.437856 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:18.458324 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.451547 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2208) took 1185 ms. Trace:
I20260709 13:17:18.459033 10241 rpcz_store.cc:276] 0709 13:17:17.265779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.450742 (+1184963us) service_pool.cc:224] Handling call
0709 13:17:18.451062 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.451239 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.451262 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.451300 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.451327 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.451378 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.451490 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.356552 15857 consensus_queue.cc:1059] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:17:18.381915 15708 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:18.345073 15856 consensus_queue.cc:1059] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:17:18.344972 15811 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.384496 15831 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.309762 15781 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.451737 10390 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:18.470610 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:18.313370 15651 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.447398 15848 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.086s	user 0.000s	sys 0.003s
W20260709 13:17:18.446919 15711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.090s	user 0.008s	sys 0.053s
I20260709 13:17:18.482709 15719 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.485549 15719 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.398912 15760 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.486970 11002 raft_consensus.cc:1240] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:18.487876 15760 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.462193 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.489485 10316 raft_consensus.cc:2410] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:18.460680 10246 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:18.427065 10243 rpcz_store.cc:276] 0709 13:17:17.304113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.230875 (+926762us) service_pool.cc:224] Handling call
0709 13:17:18.426600 (+195725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.465095 10241 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:18.491101 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2210) took 1224 ms. Trace:
I20260709 13:17:18.491425 10241 rpcz_store.cc:276] 0709 13:17:17.274603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.464498 (+1189895us) service_pool.cc:224] Handling call
0709 13:17:18.464904 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.490827 (+ 25923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.491047 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.492918 15719 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.493259 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2212) took 1216 ms. Trace:
I20260709 13:17:18.493409 15719 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.460011 15802 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.473578 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:18.474323 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.475906 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:18.459915 15703 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.469056 15708 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.469794 15664 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.486140 10249 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.498869 15664 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.499106 10322 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:18.499610 15835 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.499728 10391 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:18.500118 15835 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.500661 15811 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.493623 10241 rpcz_store.cc:276] 0709 13:17:17.276637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.492425 (+1215788us) service_pool.cc:224] Handling call
0709 13:17:18.492745 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.492927 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.492966 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.493007 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.493046 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.493099 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.493207 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.472841 15831 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.505463 15619 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.491739 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2211) took 1216 ms. Trace:
I20260709 13:17:18.495599 10321 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:18.544158 10243 rpcz_store.cc:276] 0709 13:17:17.274958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.490957 (+1215999us) service_pool.cc:224] Handling call
0709 13:17:18.491248 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.491422 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.491460 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.491503 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:18.491542 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.491591 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.491689 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.461194 15779 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.461997 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.549501 10324 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.490142 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:18.506440 10241 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.514778 11000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1230) took 2048 ms. Trace:
I20260709 13:17:18.515271 15793 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.506742 15705 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:18.507820 15781 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:18.477043 15651 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:18.516657 15708 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.516958 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:18.513384 15546 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.518766 10390 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:18.450040 10323 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:18.526448 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.513630 15636 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.528366 15625 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.530612 10398 raft_consensus.cc:1240] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.571964 10390 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:18.572685 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.531482 15780 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:18.536724 10391 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:18.538756 10994 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:18.539001 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.576431 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.542804 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.546123 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.579254 15465 consensus_queue.cc:1059] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:18.579412 15625 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.580344 15546 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:18.581328 15546 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.581763 15625 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.575366 15780 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.583117 15735 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.585427 15735 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.552201 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2216) took 1200 ms. Trace:
I20260709 13:17:18.551905 11000 rpcz_store.cc:276] 0709 13:17:16.466188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.466360 (+   172us) service_pool.cc:224] Handling call
0709 13:17:16.483935 (+ 17575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.516505 (+ 32570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.516533 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.516577 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:16.516618 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.514535 (+1997917us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b54001b8354. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.514582 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.514717 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74430208}
I20260709 13:17:18.551200 10999 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:18.590509 10241 rpcz_store.cc:276] 0709 13:17:17.351867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.501947 (+1150080us) service_pool.cc:224] Handling call
0709 13:17:18.506271 (+  4324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.551843 (+ 45572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.552122 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.530143 15733 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.559218 15779 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.591910 15584 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.591965 10241 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:18.593271 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2218) took 1131 ms. Trace:
I20260709 13:17:18.563954 15726 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.593709 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.595443 15726 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.592257 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:18.511040 15720 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:18.596273 15720 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:18.596691 15720 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.553437 15775 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.586088 15465 raft_consensus.cc:3055] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:18.598932 15465 raft_consensus.cc:740] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:18.599884 15465 consensus_queue.cc:260] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.600941 15465 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.573197 10390 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.602584 10390 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:18.587482 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.604015 15619 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:18.604630 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.605192 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.544593 10995 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:18.606444 15636 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.607393 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37922 (request call id 1231) took 2140 ms. Trace:
I20260709 13:17:18.607875 10997 rpcz_store.cc:276] 0709 13:17:16.466610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.466745 (+   135us) service_pool.cc:224] Handling call
0709 13:17:18.516790 (+2050045us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b58001e1898. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c3a22 00007f58c98dcc09 00007f58c8a36ee0 00007f58c8b000ab 00007f58c8b00131 00007f58c8aae0a0 00007f58c8aad984 00007f58c20286d4 00007f58c2028662
0709 13:17:18.607289 (+ 90499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5597952}
I20260709 13:17:18.593571 10241 rpcz_store.cc:276] 0709 13:17:17.461720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.591455 (+1129735us) service_pool.cc:224] Handling call
0709 13:17:18.591777 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.593018 (+  1241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.593216 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.606477 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.610373 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.605248 10316 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:18.611536 10320 raft_consensus.cc:2393] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:18.612362 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2219) took 1143 ms. Trace:
W20260709 13:17:18.548420 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 90178.2us
I20260709 13:17:18.614279 10241 rpcz_store.cc:276] 0709 13:17:17.468464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.610352 (+1141888us) service_pool.cc:224] Handling call
0709 13:17:18.611872 (+  1520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.612046 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.612069 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.612110 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.612137 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.612184 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.612306 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.612016 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.619489 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2220) took 1140 ms. Trace:
I20260709 13:17:18.620134 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.620770 10321 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:18.622364 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.620046 10241 rpcz_store.cc:276] 0709 13:17:17.478809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.618589 (+1139780us) service_pool.cc:224] Handling call
0709 13:17:18.618926 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.619179 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.619202 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.619243 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:18.619270 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.619320 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.619436 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.625061 10390 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:17:18.625429 10390 pending_rounds.cc:85] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 10
I20260709 13:17:18.625671 10390 pending_rounds.cc:107] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:17:18.625905 10390 raft_consensus.cc:2889] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.626710 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:18.627008 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.627876 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.628870 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.626401 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2222) took 1098 ms. Trace:
I20260709 13:17:18.629640 10241 rpcz_store.cc:276] 0709 13:17:17.528432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.625404 (+1096972us) service_pool.cc:224] Handling call
0709 13:17:18.625785 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.626014 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.626039 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.626079 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:18.626115 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.626226 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.626350 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.631258 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2223) took 1083 ms. Trace:
I20260709 13:17:18.631582 10241 rpcz_store.cc:276] 0709 13:17:17.548110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.630514 (+1082404us) service_pool.cc:224] Handling call
0709 13:17:18.630793 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.630955 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.630978 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.631018 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:18.631046 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.631095 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.631209 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.624325 10324 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:18.635002 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.635879 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.635921 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:18.638887 10362 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.597481 15831 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.640435 15606 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:18.644572 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.645533 10324 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:18.640645 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.641183 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.646610 10290 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:18.646974 10321 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:18.644815 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:18.659405 10316 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
I20260709 13:17:18.656131 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:18.662482 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.627519 15708 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:18.634667 15687 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.674191 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:18.675247 10324 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:18.649616 15620 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.638100 15584 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:18.678911 10320 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:18.649782 15606 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:18.649852 15636 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.668954 15703 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.641837 15802 consensus_queue.cc:1059] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:17:18.665197 15288 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:18.661448 15726 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:18.669035 15708 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.669816 15674 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:17:18.682169 15606 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:18.686801 15811 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:18.672421 15580 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:17:18.696216 15288 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:18.693017 15708 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:18.695497 15703 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:18.689389 15636 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.694768 15726 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.714608 15288 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.715873 15651 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.716507 15490 raft_consensus.cc:3055] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:18.716897 15490 raft_consensus.cc:740] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:18.710042 15825 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 1.083s	user 0.005s	sys 0.000s
I20260709 13:17:18.717712 15490 consensus_queue.cc:260] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.718050 15651 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.710783 15811 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:18.722319 15726 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.726538 15831 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.733191 15720 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.733632 15811 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.733671 15796 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:18.737147 15847 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.691s	user 0.001s	sys 0.000s
I20260709 13:17:18.737421 15720 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.735239 15745 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:18.738873 15813 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:18.739399 15813 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:18.738915 15745 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.740244 15813 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.741585 15813 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.743849 15745 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.747370 15760 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:18.747980 15760 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:18.749059 15760 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.750594 15843 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:18.751268 15843 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:18.751585 15780 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.752496 15843 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.753573 15780 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.754031 15843 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.755069 15766 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:18.758883 15775 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.765825 15835 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:18.798877 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 164417us
I20260709 13:17:18.801352 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:18.802754 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.805648 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.807744 10244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3042) took 2293 ms. Trace:
I20260709 13:17:18.809563 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.808399 10244 rpcz_store.cc:276] 0709 13:17:16.513773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.011295 (+497522us) service_pool.cc:224] Handling call
0709 13:17:17.011736 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.012248 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:17.036765 (+ 24517us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.289758 (+252993us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.290214 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.290407 (+   193us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.290439 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.290505 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.642482 (+1351977us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:18.806720 (+164238us) raft_consensus.cc:1685] finished
0709 13:17:18.806969 (+   249us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.807398 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26985,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":439,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":6192,"spinlock_wait_cycles":6230912,"thread_start_us":213751,"threads_started":1,"wal-append.queue_time_us":479170}
I20260709 13:17:18.813354 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.816069 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.817596 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 2221) took 1317 ms. Trace:
I20260709 13:17:18.817888 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.818142 10242 rpcz_store.cc:276] 0709 13:17:17.499747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.188934 (+689187us) service_pool.cc:224] Handling call
0709 13:17:18.817063 (+628129us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000a8f54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.817380 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444390784}
I20260709 13:17:18.819952 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:18.821018 10242 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 12.
I20260709 13:17:18.821858 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2217) took 1410 ms. Trace:
I20260709 13:17:18.822393 10243 rpcz_store.cc:276] 0709 13:17:17.411232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.545290 (+1134058us) service_pool.cc:224] Handling call
0709 13:17:18.545684 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.545972 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:18.801214 (+255242us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.820916 (+ 19702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.821016 (+   100us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.821195 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.821334 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.821597 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175137,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":273319,"threads_started":2,"wal-append.queue_time_us":9723}
I20260709 13:17:18.820243 10241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2224) took 1253 ms. Trace:
I20260709 13:17:18.827502 10245 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:18.829246 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 153354us
I20260709 13:17:18.830013 10243 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:18.831063 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2227) took 1191 ms. Trace:
I20260709 13:17:18.831526 10243 rpcz_store.cc:276] 0709 13:17:17.639855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.828979 (+1189124us) service_pool.cc:224] Handling call
0709 13:17:18.829480 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.830641 (+  1161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.830990 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:18.833880 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.683323 10324 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:18.835698 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2226) took 1207 ms. Trace:
I20260709 13:17:18.836362 10245 rpcz_store.cc:276] 0709 13:17:17.621595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.826167 (+1204572us) service_pool.cc:224] Handling call
0709 13:17:18.826857 (+   690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.828270 (+  1413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.828572 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.838542 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3030) took 3080 ms. Trace:
I20260709 13:17:18.839233 10250 rpcz_store.cc:276] 0709 13:17:15.758449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.760063 (+  1614us) service_pool.cc:224] Handling call
0709 13:17:15.778158 (+ 18095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.869317 (+1091159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.837765 (+1968448us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400101dd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.838276 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2426687360}
I20260709 13:17:18.840819 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2223) took 1357 ms. Trace:
I20260709 13:17:18.844465 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2200) took 2569 ms. Trace:
I20260709 13:17:18.844751 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1021) took 2122 ms. Trace:
I20260709 13:17:18.845120 10399 rpcz_store.cc:276] 0709 13:17:16.722627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.722813 (+   186us) service_pool.cc:224] Handling call
0709 13:17:16.723264 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.829606 (+106342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.844267 (+2014661us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b540027b854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.844572 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211286272}
I20260709 13:17:18.847671 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2209) took 1581 ms. Trace:
W20260709 13:17:18.848475 10397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2530) took 1941 ms (client timeout 1637 ms). Trace:
W20260709 13:17:18.848968 10397 rpcz_store.cc:269] 0709 13:17:16.906638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.907120 (+   482us) service_pool.cc:224] Handling call
0709 13:17:18.848011 (+1940891us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54001a9854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.848217 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683337600}
I20260709 13:17:18.849691 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 1153) took 1926 ms. Trace:
I20260709 13:17:18.850193 10246 rpcz_store.cc:276] 0709 13:17:16.923734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.435815 (+1512081us) service_pool.cc:224] Handling call
0709 13:17:18.436248 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.490386 (+ 54138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.849169 (+358783us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b540009f454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.849531 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55724288}
I20260709 13:17:18.825732 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:18.853000 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.853919 10390 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:18.726732 15703 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.856084 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.856990 10967 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:18.859920 10998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 1068) took 2550 ms (client timeout 2116 ms). Trace:
W20260709 13:17:18.860630 10998 rpcz_store.cc:269] 0709 13:17:16.309108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.310409 (+  1301us) service_pool.cc:224] Handling call
0709 13:17:18.859163 (+2548754us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400660154. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.859500 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2913417600}
I20260709 13:17:18.838564 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:18.848147 10249 rpcz_store.cc:276] 0709 13:17:17.266004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.452588 (+1186584us) service_pool.cc:224] Handling call
0709 13:17:18.452999 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.498570 (+ 45571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.847086 (+348516us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b540006efd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.847460 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75769216}
I20260709 13:17:18.826952 10241 rpcz_store.cc:276] 0709 13:17:17.566492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.632237 (+1065745us) service_pool.cc:224] Handling call
0709 13:17:18.632528 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.799800 (+167272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.799926 (+   126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.800037 (+   111us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:18.800109 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.819698 (+ 19589us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002eca54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.819761 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.820019 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383028992}
I20260709 13:17:18.889007 10395 raft_consensus.cc:2368] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16.
I20260709 13:17:18.890766 15766 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.892051 15766 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.893924 15780 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:18.895656 15780 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.896587 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:18.896607 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.876763 15490 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.884068 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:18.903157 10397 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.902220 10243 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.915410 10213 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.916181 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.922042 15835 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.923506 15835 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.927069 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.927798 15761 consensus_queue.cc:1059] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:18.929158 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:18.930099 15625 raft_consensus.cc:3055] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:18.930794 15625 raft_consensus.cc:740] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:18.930866 15642 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:18.933578 15642 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:18.934543 15745 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:18.933252 15625 consensus_queue.cc:260] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.936642 15679 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:18.936911 15625 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:18.937248 15636 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.915330 15788 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:18.944280 10322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2826) took 3803 ms (client timeout 1578 ms). Trace:
W20260709 13:17:18.944860 10322 rpcz_store.cc:269] 0709 13:17:15.141003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.141150 (+   147us) service_pool.cc:224] Handling call
0709 13:17:18.943828 (+3802678us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b54002bcd54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.944054 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7703503104}
I20260709 13:17:18.841369 10394 rpcz_store.cc:276] 0709 13:17:17.483248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.483432 (+   184us) service_pool.cc:224] Handling call
0709 13:17:17.483890 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.498252 (+ 14362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.498303 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.528886 (+ 30583us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.803830 (+274944us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:17.803879 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.803969 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.736564 (+932595us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:18.839968 (+103404us) raft_consensus.cc:1685] finished
0709 13:17:18.840010 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.840491 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18102,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":17629,"spinlock_wait_cycles":22083968,"thread_start_us":182513,"threads_started":1,"wal-append.queue_time_us":450072}
W20260709 13:17:18.950981 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.952795 10364 connection.cc:256] RPC call timeout handler was delayed by -1.0300087760001588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:17:18.952929 15796 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.844931 10396 rpcz_store.cc:276] 0709 13:17:16.274757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.283495 (+  8738us) service_pool.cc:224] Handling call
0709 13:17:16.283773 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.900438 (+1616665us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:17.929131 (+ 28693us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.074444 (+145313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.074519 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.074594 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.843277 (+768683us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b1800405820. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09c92a6 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419
0709 13:17:18.843910 (+   633us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54003b97d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:18.843978 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.844251 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10579,"prepare.queue_time_us":29040,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1481,"raft.queue_time_us":141,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3149,"spinlock_wait_cycles":3843893248,"thread_start_us":144693,"threads_started":1,"wal-append.queue_time_us":161970}
I20260709 13:17:18.897702 15780 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.953953 15796 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:18.955582 15843 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:18.957084 15796 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:18.958397 15754 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:18.959792 15642 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:18.960713 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2219) took 1488 ms. Trace:
I20260709 13:17:18.960929 15754 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:18.961154 10392 rpcz_store.cc:276] 0709 13:17:17.472409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.472585 (+   176us) service_pool.cc:224] Handling call
0709 13:17:18.890813 (+1418228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.891474 (+   661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.891504 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.891589 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.891632 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.891721 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.960417 (+ 68696us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001a9850. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.960554 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223506176}
I20260709 13:17:18.963097 10248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 1137) took 2849 ms. Trace:
I20260709 13:17:18.963622 10248 rpcz_store.cc:276] 0709 13:17:16.113187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.283933 (+170746us) service_pool.cc:224] Handling call
0709 13:17:18.228880 (+1944947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.245303 (+ 16423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.962624 (+717321us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b540006e5d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:18.962889 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4472243456}
I20260709 13:17:18.965306 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:18.966607 10364 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:18.967181 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51937.5us
I20260709 13:17:18.967198 15713 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.937256 15679 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:18.968432 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:18.970789 10242 raft_consensus.cc:2368] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13.
W20260709 13:17:18.970646 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.930814 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.980284 10250 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:18.994710 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.970145 10364 leader_election.cc:400] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15.
I20260709 13:17:18.961159 15642 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:19.003994 10364 leader_election.cc:403] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:19.004254 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:19.006388 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:18.986671 15713 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:19.018803 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.019954 10248 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:13.872156  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.010350 15796 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:19.026991 15796 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.029462 15796 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:19.030630 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.971429 15708 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.031193 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.032812 15708 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:19.033706 15813 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:19.035940 15831 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:19.036676 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:19.037501 10242 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.039089 15754 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:19.039697 15754 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:19.041098 15754 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.043990 15719 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:19.028460 10143 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 11 to 15, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 15 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.088052 15754 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:19.088558 10316 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:19.041774 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.088073 15760 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:19.091673 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 121846us
W20260709 13:17:19.091955 15656 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:17:19.092751 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.094314 15781 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:19.094795 10244 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:19.095852 10241 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:19.089977 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48606.7us
I20260709 13:17:19.098052 15509 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:19.098695 15509 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:19.100186 15509 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.103389 10143 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 7 to 8, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 8 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:19.109869 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 453693us
I20260709 13:17:19.109565 10143 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.052542 10397 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:19.044737 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.036675 15831 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:19.061543 10965 connection.cc:256] RPC call timeout handler was delayed by -2.3838579829998707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 13:17:19.063712 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:19.064601 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:19.064607 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.067342 15780 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.069653 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.070393 15803 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:19.072052 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:19.075083 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.076591 15606 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.078007 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.078641 15835 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:19.079412 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.080711 15317 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.081231 10323 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:19.081511 15620 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:19.082733 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2537) took 1805 ms. Trace:
W20260709 13:17:19.051594 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47939.7us
W20260709 13:17:19.085503 10325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34170 (request call id 2842) took 2762 ms (client timeout 2141 ms). Trace:
I20260709 13:17:19.119448 10243 raft_consensus.cc:2468] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 10.
W20260709 13:17:19.127126 10325 rpcz_store.cc:269] 0709 13:17:16.323286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.336892 (+ 13606us) service_pool.cc:224] Handling call
0709 13:17:19.085115 (+2748223us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54002bc854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:19.085310 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6025642752}
I20260709 13:17:19.131851 10396 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:19.133172 10993 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:19.134549 10398 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:19.135939 10392 raft_consensus.cc:2410] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:17:18.970285 15679 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.140893 15780 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:19.144567 15719 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.146773 10390 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:19.149051 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3038) took 2829 ms. Trace:
I20260709 13:17:19.138417 15803 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.149452 10247 rpcz_store.cc:276] 0709 13:17:16.319746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.692944 (+373198us) service_pool.cc:224] Handling call
0709 13:17:16.693721 (+   777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.834109 (+140388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.834155 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.855243 (+ 21088us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.837075 (+1981832us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800436480. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:19.126840 (+289765us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:19.126905 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.143174 (+ 16269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.144607 (+  1433us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54004a2020. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3a5ddbe 00007f58c3a68930 00007f58c3a688d8 00007f58c3a68858 00007f58c3a68813 00007f58c3a67a9c 00007f58c9953626 00007f58c994ddd8 00007f58c3aa47cb 00007f58c3aa72c0
0709 13:17:19.148686 (+  4079us) raft_consensus.cc:1685] finished
0709 13:17:19.148707 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.148886 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139761,"raft.queue_time_us":152541,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140,"spinlock_wait_cycles":148209280,"thread_start_us":157351,"threads_started":1,"wal-append.queue_time_us":2217636}
I20260709 13:17:19.152336 15803 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:19.153021 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.153780 10965 connection.cc:256] RPC call timeout handler was delayed by -1.6674579829998493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2686s for a response
I20260709 13:17:19.156064 15831 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:19.157063 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 64529.4us
I20260709 13:17:19.158288 10364 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.160513 10364 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.161337 15796 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:19.162756 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 190682us
I20260709 13:17:19.165102 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.141971 15679 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:19.168509 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 151268us
I20260709 13:17:19.173393 10241 raft_consensus.cc:2468] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:19.174443 15803 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:19.174680 15544 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:19.176445 10242 raft_consensus.cc:2468] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:19.176623 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.177374 10248 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:19.174001 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:19.178751 10965 connection.cc:256] RPC call timeout handler was delayed by -1.3740462549999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:17:19.182598 10965 connection.cc:256] RPC call timeout handler was delayed by -1.2615462549999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 13:17:19.182785 10249 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:19.183013 10965 connection.cc:256] RPC call timeout handler was delayed by -1.2597462549999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:17:19.183308 10965 connection.cc:256] RPC call timeout handler was delayed by -1.0406591500000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:17:19.183612 10965 connection.cc:256] RPC call timeout handler was delayed by -1.0406591500000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:17:19.183888 10965 connection.cc:256] RPC call timeout handler was delayed by -1.0374462549998498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 13:17:19.126531 10393 rpcz_store.cc:276] 0709 13:17:17.277644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.278457 (+   813us) service_pool.cc:224] Handling call
0709 13:17:17.278724 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.270696 (+991972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.082188 (+811492us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54002dda54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:19.082545 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279706880}
I20260709 13:17:19.184578 10244 raft_consensus.cc:2393] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:19.184417 15803 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:19.185449 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 55525.8us
I20260709 13:17:19.185560 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.185920 15288 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.186836 15683 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:19.186874 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.188262 15288 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:19.189826 10965 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.190493 15845 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:19.202996 10243 raft_consensus.cc:1240] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.125373 15317 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:19.215824 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:19.224399 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59456.4us
I20260709 13:17:19.224915 15317 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.226845 15317 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.187103 15803 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:19.193251 10143 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 10 to 11, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 11 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:19.235234 15544 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.238749 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.235699 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.240862 10998 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16.
I20260709 13:17:19.238111 15544 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:19.246665 10290 leader_election.cc:400] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13.
I20260709 13:17:19.264060 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.261808 15656 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15.
I20260709 13:17:19.270417 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.260108 15683 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.290818 10998 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:19.295019 10993 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:19.309417 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 119720us
I20260709 13:17:19.316747 10993 raft_consensus.cc:2468] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 11.
I20260709 13:17:19.320303 15857 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:19.320550 15683 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:19.321481 15683 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:19.324337 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 93915.4us
I20260709 13:17:19.324884 15683 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:19.322041 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.334175 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.335184 10250 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:19.335712 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.336709 15683 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.337440 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.338397 15683 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:19.340453 10246 raft_consensus.cc:2410] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:17:19.341346 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 108385us
I20260709 13:17:19.345494 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.346328 10997 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:19.347556 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.354920 10998 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
W20260709 13:17:19.361552 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 141207us
I20260709 13:17:19.350301 15606 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:19.371496 10246 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.365520 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.374545 15719 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:19.373154 15620 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.376572 10143 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:19.379585 15876 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.081s	user 0.003s	sys 0.001s
I20260709 13:17:19.385656 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:17:19.394723 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.396927 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59671.9us
I20260709 13:17:19.394047 15651 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:19.404982 10998 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:19.403345 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.410560 10995 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:19.407483 10246 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:19.410733 10147 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 311) took 39103 ms (client timeout 15000 ms). Trace:
I20260709 13:17:19.413684 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:19.422273 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.424966 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.425307 15651 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:19.425981 15651 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.428289 15651 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:19.428829 15651 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:19.429157 15651 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
W20260709 13:17:19.435140 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49632.5us
I20260709 13:17:19.438616 10995 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
W20260709 13:17:19.442579 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 136386us
I20260709 13:17:19.439513 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.444799 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.453647 10325 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:19.453887 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.454339 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:19.454727 10322 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:19.455065 10393 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
W20260709 13:17:19.455977 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.456142 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.450634 15835 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.456763 10393 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:19.458860 10399 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:19.438830 15831 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:19.446913 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.452143 10364 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.452646 10967 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:19.465798 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:19.466773 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.467137 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.471060 10392 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.471171 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.473330 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:19.474316 15606 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:19.474436 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.475368 10390 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:19.472982 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.469960 15796 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.461845 15831 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:19.476943 15831 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.476701 15796 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.472234 15544 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:19.479137 15796 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:19.479693 10316 raft_consensus.cc:1240] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:19.480011 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 83379us
I20260709 13:17:19.474973 15606 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.482313 15606 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:19.471907 10997 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:19.484004 15803 raft_consensus.cc:2804] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:19.484386 15544 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:19.484606 15803 raft_consensus.cc:697] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:19.430009 15651 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.492026 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.493906 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.494585 15620 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:19.494753 15623 consensus_queue.cc:1059] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:19.495530 10322 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:19.495635 15623 raft_consensus.cc:3055] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:19.519310 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.525631 10316 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:19.485682 15803 consensus_queue.cc:237] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:19.490155 15884 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:19.519870 10213 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.528990 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.524670 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.485611 15544 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.523447 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.536732 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:19.537438 10391 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:19.540663 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.525363 15623 raft_consensus.cc:740] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:19.548859 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 56188.5us
I20260709 13:17:19.554068 10391 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:19.556216 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.524135 15620 consensus_queue.cc:1059] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:19.523820 15625 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:17:19.559087 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:19.413206 10147 rpcz_store.cc:269] 0709 13:16:40.306271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.307050 (+   779us) service_pool.cc:224] Handling call
0709 13:17:19.407161 (+39100111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:12.154246 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:12.333111 (+178865us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:12.333165 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:17:12.333184 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:12.333964 (+   780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:12.334058 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:12.334086 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:17:12.334751 (+   665us) tablet.cc:701] Row locks acquired
0709 13:17:12.334800 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:12.334970 (+   170us) write_op.cc:270] Start()
0709 13:17:12.335122 (+   152us) write_op.cc:276] Timestamp: P: 1783603032334899 usec, L: 0
0709 13:17:12.335164 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:17:12.335848 (+   684us) log.cc:844] Serialized 2132 byte log entry
0709 13:17:12.794922 (+459074us) op_driver.cc:464] REPLICATION: finished
0709 13:17:13.122651 (+327729us) write_op.cc:301] APPLY: starting
0709 13:17:13.122778 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:13.286455 (+163677us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:13.286596 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:13.290153 (+  3557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:13.290516 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:17:13.290607 (+    91us) write_op.cc:312] APPLY: finished
0709 13:17:13.290989 (+   382us) log.cc:844] Serialized 57 byte log entry
0709 13:17:13.336312 (+ 45323us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:13.348038 (+ 11726us) write_op.cc:454] Released schema lock
0709 13:17:13.355669 (+  7631us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:13.356198 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:13.356233 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4041,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":327318,"apply.run_cpu_time_us":11262,"apply.run_wall_time_us":233568,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":184554,"prepare.run_cpu_time_us":28190,"prepare.run_wall_time_us":410089,"raft.queue_time_us":130268,"raft.run_cpu_time_us":14885,"raft.run_wall_time_us":253085,"replication_time_us":459532,"thread_start_us":491942,"threads_started":4,"wal-append.queue_time_us":189243,"wal-append.run_cpu_time_us":44692,"wal-append.run_wall_time_us":1822648}]]}
W20260709 13:17:19.561105 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 72527.5us
I20260709 13:17:19.561275 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:19.567163 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 131066us
I20260709 13:17:19.569654 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:19.570026 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.573649 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.573813 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.563534 15651 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.533979 15683 consensus_queue.cc:1059] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:17:19.575225 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.567281 15719 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:17:19.582971 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.585158 10362 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16.
I20260709 13:17:19.585561 10362 leader_election.cc:403] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:19.585764 10993 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.588929 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.591739 15719 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:19.591969 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.592770 10245 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:19.593055 15719 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.586643 10997 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:19.594565 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:19.597011 15679 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:19.597342 10993 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:17:19.598353 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.597081 10320 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:19.599895 10392 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:19.601794 10393 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:19.602669 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.603051 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.604045 10322 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:19.599212 15857 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:19.606745 15549 raft_consensus.cc:2764] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:17:19.607318 15857 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:19.611680 10325 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:19.614166 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.615499 10362 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:17:19.615499 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47673.8us
I20260709 13:17:19.616681 10364 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.606380 15796 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:19.618563 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:19.622712 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 51867.7us
I20260709 13:17:19.614104 15656 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16.
I20260709 13:17:19.627027 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.621515 15857 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.631465 10290 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.632051 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.620604 15796 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:19.639072 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.648151 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.659706 10321 raft_consensus.cc:1240] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:19.661568 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.637576 15642 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:19.662407 15726 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:19.663985 10322 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:19.665176 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.665413 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.665844 10322 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:19.645534 15813 raft_consensus.cc:2804] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:19.666186 10325 raft_consensus.cc:2410] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:17:19.666819 15813 raft_consensus.cc:697] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:19.667506 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:19.667652 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:19.668196 15813 consensus_queue.cc:237] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.669248 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.670099 10325 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:19.647253 15845 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.642992 15760 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:19.672456 10393 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:19.671994 15760 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.674407 15656 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:19.641299 15796 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:19.685881 10393 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:19.687821 15761 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:19.688568 15625 raft_consensus.cc:3055] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.695243 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.619801 15623 consensus_queue.cc:260] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.698194 10993 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.699995 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.648818 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
W20260709 13:17:19.701365 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 53280.3us
I20260709 13:17:19.701527 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:19.702414 10391 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
W20260709 13:17:19.706602 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 75257.1us
W20260709 13:17:19.709149 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 71002.5us
I20260709 13:17:19.712162 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.712680 10362 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:19.712919 10995 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:19.696486 15625 raft_consensus.cc:740] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:19.746869 15317 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:19.747069 15625 consensus_queue.cc:260] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.748059 15317 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:19.748389 15625 raft_consensus.cc:3060] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.748422 15317 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:19.749536 15317 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.696599 15761 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:19.717021 15623 raft_consensus.cc:3060] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.750999 15761 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.752229 15761 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:19.719094 10398 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.753782 10364 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:19.755517 15317 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:19.728389 10993 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
W20260709 13:17:19.757661 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 55265.9us
I20260709 13:17:19.738857 10391 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:19.712215 15642 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:19.740079 10394 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:19.740806 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.741129 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.741983 11002 raft_consensus.cc:1240] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:19.742288 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.742914 15710 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:19.776458 15710 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.776917 15710 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:19.785717 10967 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:19.745126 15845 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:19.790001 15845 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:19.790380 15845 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:19.791283 15845 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.792495 15845 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.755857 15656 raft_consensus.cc:2804] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.793399 15656 raft_consensus.cc:697] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:19.731564 10999 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.772711 15831 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.795569 10396 raft_consensus.cc:1240] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.773422 10364 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:17:19.762465 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52196.9us
I20260709 13:17:19.798522 15651 raft_consensus.cc:2804] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:19.798728 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:19.799949 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:19.771011 15813 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:19.801442 15813 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:19.802707 15813 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.770875 10996 raft_consensus.cc:2368] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:19.771095 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.771564 10393 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.774554 11002 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 18. Current term is 19. Ops: []
W20260709 13:17:19.770309 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.742795 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.807921 10245 raft_consensus.cc:1240] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:19.809760 15620 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:19.810300 15620 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.810657 15620 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:19.773676 15642 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.812070 15642 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:19.787442 15606 raft_consensus.cc:3055] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:19.772476 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.815215 11000 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:19.799067 15651 raft_consensus.cc:697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:19.799867 15796 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.771862 10994 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 18: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:19.772292 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:19.827005 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:19.827071 15831 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:19.817296 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:19.774313 15760 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:19.831036 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.831581 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:19.837080 10288 leader_election.cc:400] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16.
I20260709 13:17:19.831835 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.820696 15606 raft_consensus.cc:740] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:19.846702 15651 consensus_queue.cc:237] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.848240 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.852504 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.859833 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:19.863042 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.864053 10249 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:19.823377 15803 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:19.868238 10997 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:19.867872 15803 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:19.870344 15868 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:19.871836 15868 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.837725 15656 consensus_queue.cc:237] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.872205 15868 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:19.872872 15811 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:19.873454 15811 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:19.874485 15811 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:19.878309 15781 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:19.879135 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46533us
I20260709 13:17:19.879958 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:19.883272 10364 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:19.884379 15781 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:19.885234 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.890983 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:19.892760 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.894743 15455 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:19.896116 10965 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.898577 15761 raft_consensus.cc:2764] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:19.902673 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.902949 15754 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:19.903970 15845 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:19.906720 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:19.898132 15606 consensus_queue.cc:260] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:19.870596 15803 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:19.909740 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 242346us
W20260709 13:17:19.919083 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.922073 10250 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:19.887058 15893 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:19.915618 10244 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:19.938110 10244 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:17:19.944078 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.945106 10244 pending_rounds.cc:85] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:17:19.945699 10244 pending_rounds.cc:107] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:19.946425 10244 raft_consensus.cc:2889] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.948727 15813 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:19.959151 10248 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:19.961016 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:19.959729 10248 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:19.967625 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:19.928622 15893 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:20.010370 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 103388us
I20260709 13:17:19.996986 15893 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.014050 10248 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.020118 10248 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.029238 10248 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:20.029717 10248 pending_rounds.cc:85] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 7
I20260709 13:17:20.030005 10248 pending_rounds.cc:107] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 14.8
W20260709 13:17:20.030684 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 128112us
I20260709 13:17:20.003218 15845 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:20.033737 10248 raft_consensus.cc:2889] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.041203 15868 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.008822 15623 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:20.043859 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.018206 15811 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.071729 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.073184 15845 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.079953 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:20.033571 15796 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.082361 15898 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:20.064903 15606 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.087944 15899 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.088132 15620 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.090291 15775 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:20.090883 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.091285 15683 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.091998 15703 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.091552 15710 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:20.093294 15896 log.cc:927] Time spent T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:17:20.094288 15895 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:20.133242 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:20.108170 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 145298us
W20260709 13:17:20.110792 10213 connection.cc:256] RPC call timeout handler was delayed by -1.392692186999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:17:20.125056 15455 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:20.127791 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:20.136372 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3849295369998345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:17:20.136795 10213 connection.cc:256] RPC call timeout handler was delayed by -1.3444295369999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:17:20.136690 15455 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.128089 10322 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:20.139242 15455 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:20.128613 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:20.129402 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:20.132550 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:20.141858 10321 raft_consensus.cc:2376] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13. Re-sending same reply.
I20260709 13:17:20.165676 15917 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:20.167133 15710 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.114701 15898 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:20.108563 15811 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.170964 15898 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.172619 15811 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:20.081185 15906 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:17:20.174564 15760 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 13:17:20.175797 15901 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:20.115921 15775 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.185770 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:20.132625 15892 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:17:20.192034 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 125623us
I20260709 13:17:20.188532 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.106428 15623 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:20.198558 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 60705.5us
I20260709 13:17:20.202469 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:20.206190 10390 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:20.206540 10396 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:20.189785 15775 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.190310 15703 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:20.233471 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:20.190558 15710 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:17:20.183156 15906 consensus_queue.cc:1059] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:20.192938 15811 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:17:20.268455 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 58797.5us
I20260709 13:17:20.207424 15845 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.273082 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 84680.1us
I20260709 13:17:20.118961 15899 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.292028 15899 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:20.304430 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.305987 15708 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:20.278117 15904 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:17:20.278656 15913 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:20.280664 15835 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:20.282647 15623 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:20.283035 10213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.238.196:35437 timed out after 1.894s (SENT) [suppressed 15 similar messages]
I20260709 13:17:20.289960 15642 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.283668 15620 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.283449 15845 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.306661 15919 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.314409 15845 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:20.286875 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.311682 15835 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:20.316002 15835 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.317051 15835 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:20.289005 15544 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.317668 15544 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.318496 15868 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:20.321267 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.324895 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.325659 10241 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:20.271232 15780 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.326378 15544 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:20.325850 10250 raft_consensus.cc:2393] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 11: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:20.327237 10248 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:17:20.312347 10213 connection.cc:256] RPC call timeout handler was delayed by -1.2148295370000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 13:17:20.329279 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1941295369999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 13:17:20.329615 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1446295369999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 13:17:20.329916 10213 connection.cc:256] RPC call timeout handler was delayed by -1.1095295369998439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:17:20.270517 15754 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:20.331259 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:20.331547 15754 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.333595 15754 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.306164 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.340875 10396 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
W20260709 13:17:20.361228 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 158762us
W20260709 13:17:20.363385 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 57316.1us
I20260709 13:17:20.367309 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.372165 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:20.313861 15642 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.382537 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.363219 15726 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:20.379719 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:20.386016 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:20.389792 10993 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.387337 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:20.390496 11000 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.387575 10248 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:20.387676 10242 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:20.365883 15919 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.317915 15893 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.365646 15831 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:20.366466 15710 consensus_queue.cc:1243] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer 73825599c2644b898cebaafbccd86e99 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:20.390755 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:20.402390 11002 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.392264 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.396096 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.395946 15919 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.404150 15893 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:20.405158 15857 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:20.405669 15919 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:20.395890 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38076f481679473aac7854c07b22e381"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:20.407119 10393 raft_consensus.cc:606] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:20.407472 10393 raft_consensus.cc:614] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:20.409379 15906 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.410452 15909 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:20.410614 10995 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:20.410879 15909 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:20.411764 15909 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.413000 15909 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.413565 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:20.414247 10996 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:20.415742 15921 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:17:20.420746 15509 consensus_queue.cc:1059] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:20.420775 15288 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:17:20.424017 15907 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:20.424397 15907 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:20.425258 15907 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.409921 15906 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.391844 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.399434 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:20.400094 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:20.396272 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 93273.2us
I20260709 13:17:20.427623 15915 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:17:20.388626 15726 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.478790 15726 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:20.465237 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.465397 10996 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:20.369999 15623 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:17:20.468824 10993 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:20.471633 10247 raft_consensus.cc:3060] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.483080 11001 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:20.391492 15924 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:17:20.472991 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:20.473404 10244 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
W20260709 13:17:20.473440 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 91311.7us
I20260709 13:17:20.474129 10998 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:20.484802 10999 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:20.474618 10390 raft_consensus.cc:2410] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:17:20.486514 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 69608.2us
I20260709 13:17:20.487579 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:20.474457 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.475629 15775 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:20.479877 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.489022 10995 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:20.488238 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.489241 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.497434 10997 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:20.490585 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:20.377607 15683 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:17:20.470813 15917 raft_consensus.cc:3055] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:20.498449 10248 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:20.494421 15642 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:20.496153 15288 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.494124 15831 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:17:20.503772 10288 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:20.501617 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.486073 15710 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:17:20.486423 15620 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:20.506556 15775 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.507119 15620 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.509588 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:20.510133 15845 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.510592 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:20.510762 15845 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.511262 10324 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:20.511821 10393 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:20.512382 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:20.512879 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:20.513111 15845 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:20.503199 15288 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.514371 15620 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.519027 15620 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:20.513005 10323 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.506757 15754 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:20.487093 15803 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.001s
I20260709 13:17:20.495191 15907 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:20.516554 15899 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:20.516886 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:20.517290 10324 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:20.519364 10999 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:20.500504 15917 raft_consensus.cc:740] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:20.520431 15918 log.cc:927] Time spent T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
I20260709 13:17:20.520453 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:20.510373 10321 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:20.522501 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:20.515292 15288 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.498291 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.525064 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:20.546466 10316 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:20.515862 11000 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:20.549957 10393 raft_consensus.cc:606] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:20.550446 10393 raft_consensus.cc:614] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:20.553244 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:20.554968 15813 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:20.555362 15813 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.555402 10243 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:20.555783 15813 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:20.558202 15915 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:20.559473 15913 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:20.559689 15915 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:20.560101 15913 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:20.561859 15906 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.571794 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:20.576299 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:20.580853 10323 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:20.586781 10393 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:20.591284 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:20.595078 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 43631.7us
I20260709 13:17:20.541728 15899 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:20.544207 15754 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:20.598997 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.621392 10998 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:20.621855 10393 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:20.602928 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:17:20.616051 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.624110 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:20.624557 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 126532us
I20260709 13:17:20.624753 10997 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:20.626662 10999 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:20.627532 10393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:20.628379 10393 raft_consensus.cc:606] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.628808 10393 raft_consensus.cc:614] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:20.632356 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.633057 10396 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:20.541461 15803 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.594595 15924 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:20.602802 15912 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.635916 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:20.632483 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.638077 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:17:20.635790 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.586730 15796 consensus_queue.cc:1059] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:17:20.561095 15913 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.597431 15317 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:17:20.661020 10288 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:20.664335 15899 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.665705 15899 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:20.668490 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:20.662726 15796 consensus_queue.cc:1243] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:17:20.669183 10396 raft_consensus.cc:606] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.669560 10396 raft_consensus.cc:614] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:20.672165 10994 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:20.644508 15912 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.673141 15912 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.677083 15898 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:20.678442 15898 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:20.679593 15780 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.680495 15679 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:20.680042 15898 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.680917 15679 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:20.681556 15679 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.687769 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:20.690634 15845 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:20.691442 15845 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.690442 15679 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.692169 15845 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.694064 15679 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.690692 15317 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:20.698313 15317 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.698865 15317 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.701056 15919 raft_consensus.cc:3055] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:20.701705 15919 raft_consensus.cc:740] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:20.708503 15754 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.712963 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:20.713642 15606 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:20.714195 15656 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:20.714788 15656 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:20.715708 15656 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.660084 15917 consensus_queue.cc:260] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.717823 15917 raft_consensus.cc:3060] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.716153 15781 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.721688 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:20.734611 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 96635.7us
W20260709 13:17:20.741856 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 115804us
W20260709 13:17:20.730983 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 44856.6us
I20260709 13:17:20.747786 15803 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:20.721230 15781 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.751006 15781 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:20.754704 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:20.755290 11002 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:20.756305 15927 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:20.756908 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.757715 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:20.760959 10250 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:20.764169 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.766357 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:20.769520 10396 raft_consensus.cc:606] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.770045 10994 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:20.779955 10243 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 18 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:20.783560 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:20.772395 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:20.786693 10995 raft_consensus.cc:1275] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:20.808900 11000 raft_consensus.cc:1275] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:20.809999 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.814522 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.810840 10250 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:20.820502 10362 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:20.821835 10364 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:20.822374 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:20.773742 15919 consensus_queue.cc:260] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.824764 15642 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:20.825491 15919 raft_consensus.cc:3060] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:20.820506 15906 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.828926 15906 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.831137 15288 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.831764 15288 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.834275 15708 consensus_queue.cc:1048] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:17:20.834606 15915 raft_consensus.cc:2804] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:20.834127 15647 consensus_queue.cc:1048] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:20.818001 15620 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:20.839309 15620 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:20.839919 15620 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:20.843890 15835 consensus_meta.cc:287] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.004s
I20260709 13:17:20.843370 15726 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:20.844923 15933 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:17:20.845239 10245 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:20.846503 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:20.847409 10321 raft_consensus.cc:2410] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 18 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:20.852254 10246 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:20.866299 10324 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:20.788830 15710 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:20.878949 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 106608us
I20260709 13:17:20.882197 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:17:20.897683 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 129275us
I20260709 13:17:20.767918 15651 consensus_queue.cc:1059] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
W20260709 13:17:20.902529 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.786595 15927 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.907830 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:20.870473 15899 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:20.819473 15831 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:17:20.872298 15710 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.882660 15642 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:20.889091 15920 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.420s	user 0.003s	sys 0.003s
I20260709 13:17:20.865160 15915 raft_consensus.cc:697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:20.912526  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:20.922019 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:20.919764 10394 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:20.930181  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:20.901868 15868 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:20.940539 10998 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:20.941784 10998 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:20.910439 15679 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:20.953739 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.958647 15288 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:20.958506 10998 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:20.959873 10998 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:20.962121 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.963342 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:20.964126 10392 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.967285 10244 raft_consensus.cc:1240] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:20.969481 15813 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:20.970575 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:20.976497 10247 raft_consensus.cc:2468] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:20.939265 15899 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:20.940465 15710 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.980005 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:21.008112 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.032344 10392 raft_consensus.cc:2468] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:21.034459 10393 raft_consensus.cc:2393] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:20.925834 15683 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:17:21.049604 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.072101 10998 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:21.077153 10399 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:21.080665 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:21.085088 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 163150us
I20260709 13:17:21.017442 15924 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:21.087932 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 266154us
I20260709 13:17:21.041112 15754 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.099658 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:21.102610 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.145926 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:21.096200 15868 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.147293 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.188529 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 103299us
I20260709 13:17:21.106848 15924 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:21.167182 15951 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.213666 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 235364us
I20260709 13:17:21.193145 15898 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:21.105561 15754 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.197736 15509 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.178977 15868 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.226374 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.223083 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:21.232648 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.232987 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.233665 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.238199 10324 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:21.106529 15915 consensus_queue.cc:237] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.258611 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.260623 10321 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 11.
W20260709 13:17:21.234812 15907 consensus_meta.cc:287] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.001s
I20260709 13:17:21.193830 15899 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:21.267391 15943 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:17:21.261404 15912 consensus_meta.cc:287] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.003s
W20260709 13:17:21.275558 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 129759us
W20260709 13:17:21.264359 15941 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:17:21.221553 15951 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.262097 15927 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.237064 15509 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.321333 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:21.291852 15813 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:21.327500 15754 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:21.333179 15317 consensus_meta.cc:287] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.000s
I20260709 13:17:21.300789 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.304533 15868 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:21.309383 15845 consensus_meta.cc:287] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 13:17:21.269423 15726 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.312789 15912 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.337677 15961 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:21.350425 15946 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:17:21.340124 15781 raft_consensus.cc:3055] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:17:21.341799 15950 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:21.342271 15651 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:21.268929 10391 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:17:21.349673 15952 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:21.349503 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
W20260709 13:17:21.341132 15620 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:17:21.351414 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:21.352790 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.359814 10318 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:21.385947 10998 raft_consensus.cc:2376] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13. Re-sending same reply.
I20260709 13:17:21.367872 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.371999 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.338434 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:17:21.372855 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.374039 15919 consensus_meta.cc:287] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.005s
I20260709 13:17:21.398648 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.397002 10965 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:21.374908 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 146639us
I20260709 13:17:21.378731 10390 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:21.382818 10993 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:21.355798 15944 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:17:21.389586 10320 raft_consensus.cc:2368] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:21.389991 10995 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 18: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:21.374058 15811 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.370447 15317 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.405642 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.409142 10392 raft_consensus.cc:1275] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:21.374997 15781 raft_consensus.cc:740] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:21.380522 15868 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.383931 15726 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:21.370069 15845 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.314458 15924 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.430462 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:21.436246 10323 raft_consensus.cc:2368] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15.
I20260709 13:17:21.389267 15651 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.400653 15955 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.418380 15961 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.397611 15620 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.446069 10316 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:21.448554 10318 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:21.443656 10993 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:21.461211 10319 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:17:21.451071 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.481616 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.484102 10241 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:21.416518 15811 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:21.458595 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 70597.8us
W20260709 13:17:21.489641 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 92730us
W20260709 13:17:21.447954 15947 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 13:17:21.503551 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 165249us
I20260709 13:17:21.506798 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:21.509768 10396 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:21.509963 10965 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:21.458369 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:21.511505 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54325.7us
W20260709 13:17:21.515846 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.451377 15967 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.446270 15708 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:21.517383 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.490468 15683 raft_consensus.cc:2804] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:21.448915 15703 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.524525 15912 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:21.509001 15917 consensus_meta.cc:287] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.000s
I20260709 13:17:21.511338 15923 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:21.521525 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.525233 15970 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:21.528406 10999 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 10.
I20260709 13:17:21.430763 15868 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.524120 15967 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.532692 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:21.456164 15710 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.549674 10390 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 18: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:21.541564 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:21.542721 11002 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:21.449220 15726 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.545861 10322 raft_consensus.cc:1275] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:21.544667 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 97982.9us
W20260709 13:17:21.528968 15939 log.cc:927] Time spent T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:17:21.560271 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.525242 15975 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:21.521389 15775 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.541724 15923 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.561457 10995 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:21.595786 10242 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:21.596822 10993 raft_consensus.cc:1240] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:21.573155 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56975.6us
I20260709 13:17:21.600587 10390 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:21.600519 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:21.605291 10316 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:21.541209 15708 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:21.593843 15940 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 13:17:21.642925 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:21.549482 15683 raft_consensus.cc:697] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:21.495064 15955 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.567845 15908 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:21.594446 15509 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.504688 15961 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.601986 15923 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:21.545683 15703 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:21.644692 15944 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:17:21.678087 10996 raft_consensus.cc:1240] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.608675 15951 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:21.667833 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 146139us
W20260709 13:17:21.685161 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 154136us
W20260709 13:17:21.688194 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45361.4us
I20260709 13:17:21.664618 15978 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.689656 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:21.693526 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37924 (request call id 1121) took 1102 ms. Trace:
I20260709 13:17:21.667339 15811 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:21.671618 15898 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:21.560786 15970 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.640904 15775 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.697959 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.698437 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:21.706353 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.658778 15931 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.241s
I20260709 13:17:21.689047 15317 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.695410 11001 rpcz_store.cc:276] 0709 13:17:20.587297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.587605 (+   308us) service_pool.cc:224] Handling call
0709 13:17:20.620377 (+ 32772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.629606 (+  9229us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:20.629641 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.634637 (+  4996us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.708629 (+ 73992us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b48002721d8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f 00007f58c8afff37 00007f58c8b1455c 00007f58c8b14508 00007f58c8b14488 00007f58c8b14443 00007f58c8b136ec 00007f58c7a3da96
0709 13:17:20.868784 (+160155us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.868827 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.868894 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.677299 (+808405us) raft_consensus.cc:1685] finished
0709 13:17:21.677333 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.689282 (+ 11949us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":2870,"raft.run_wall_time_us":84640,"spinlock_wait_cycles":6909312,"thread_start_us":174242,"threads_started":1,"wal-append.queue_time_us":443219}
I20260709 13:17:21.688862 15845 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.716706 10247 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:21.734539 10318 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:21.720712 15973 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:21.721385 15971 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
W20260709 13:17:21.722894 15936 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:21.699199 15965 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.732823 10249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3084) took 1170 ms. Trace:
I20260709 13:17:21.768262 10390 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:21.779650 10247 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:21.708292 15974 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:21.785422 15726 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.787523 15967 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.788341 15868 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.789363 15651 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:21.790525 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 96445.1us
I20260709 13:17:21.791694 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:21.776355 10249 rpcz_store.cc:276] 0709 13:17:20.562873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.563022 (+   149us) service_pool.cc:224] Handling call
0709 13:17:20.563345 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.602675 (+ 39330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.602708 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.645219 (+ 42511us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.913504 (+268285us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:20.913580 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.913735 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.732430 (+818695us) raft_consensus.cc:1685] finished
0709 13:17:21.732465 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.732734 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30491,"raft.queue_time_us":55618,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5757,"thread_start_us":217682,"threads_started":1,"wal-append.queue_time_us":386733}
I20260709 13:17:21.711454 15620 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.719274 15983 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:21.793038 15978 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.704516 15908 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.813380 15974 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.807005 15967 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.806666 15726 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:21.828495 10393 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:21.826395 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.844473 10318 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:21.840098 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.846290 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.847532 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:21.848217 10324 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:21.850001 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:21.850163 10249 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 17: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:17:21.856416 15994 log.cc:927] Time spent T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:21.857906 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:21.861948 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:21.845708 15974 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.862607 15906 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.862912 10317 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:21.863356 15726 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.864105 15726 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.797627 15965 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.868372 15965 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.870800 10325 raft_consensus.cc:2368] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15.
I20260709 13:17:21.817752 15899 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.875634 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:21.876542 10999 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.846683 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:21.864641 15974 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:21.751870 15683 consensus_queue.cc:237] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.870362 15987 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:21.885938 10994 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:17:21.844367 15710 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.913574 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:21.915464 11002 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:21.916949 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:21.917603 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:21.917835 11000 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:21.918257 11001 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:21.920863 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.921008 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:21.922456 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64641.2us
I20260709 13:17:21.923609 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:21.928362 15503 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.146s
I20260709 13:17:21.930512 15984 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.931100 15984 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.932763 15908 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.910400 15987 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.933969 15991 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
I20260709 13:17:21.934585 15987 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:21.847134 15967 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.939900 15967 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.921700 15899 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:21.942329 15985 consensus_queue.cc:1059] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.166s
I20260709 13:17:21.945277 15955 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:21.917392 15708 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.946444 15726 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.946480 10316 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 19.
I20260709 13:17:21.947625 15961 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.948879 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.949218 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:21.951340 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 133735us
I20260709 13:17:21.960120 10999 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:21.925607 15972 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:21.969619 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 411429us
I20260709 13:17:21.930512 15998 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.973572  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:21.973662 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 198905us
I20260709 13:17:21.933305 15984 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:21.970557 15991 raft_consensus.cc:2764] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:21.983565 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:21.985255 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.006301 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:22.007036 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.007493 10320 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 13: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:22.008827 10248 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:22.015681 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.017544 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.014007 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.021075 10319 raft_consensus.cc:2410] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:17:22.013298 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.012559 15726 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.979808 15998 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:21.982007 15984 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.980314 15961 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.025820 10213 leader_election.cc:400] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:22.035830 10213 leader_election.cc:403] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.024114 10245 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:22.032833 10995 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:22.040133 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.006039 15813 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.044870 10245 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 11.
I20260709 13:17:22.022156 11002 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:22.047317 15978 raft_consensus.cc:3060] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.053112 15997 consensus_queue.cc:1059] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:17:22.026048 15726 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.056813 15726 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.049079 15961 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.060262 15961 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.034376 15703 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.025981 16004 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:22.061578 16004 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.061955 16004 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.037124 15985 raft_consensus.cc:3055] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:22.029444 15899 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.027436 15990 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:22.029901 15984 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.069793 15990 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.070153 15781 consensus_queue.cc:260] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.071676 15781 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.072008 15990 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.028379 15998 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.073647 15923 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.075847 15923 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.077175 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:22.063637 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 140119us
I20260709 13:17:22.039208 15974 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:21.981998 15972 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.069221 15813 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:22.091111 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.097949 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 123255us
I20260709 13:17:22.104070 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.065541 15985 raft_consensus.cc:740] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:22.067655 15703 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.072008 15984 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.138008 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:22.108527 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.138638 10396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2268) took 1254 ms. Trace:
I20260709 13:17:22.138525 15703 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.139058 10396 rpcz_store.cc:276] 0709 13:17:20.883876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.884817 (+   941us) service_pool.cc:224] Handling call
0709 13:17:22.138438 (+1253621us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540010b654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:22.138586 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382261504}
I20260709 13:17:22.139504 10213 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:22.139771 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.140280 10395 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.140391 10999 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:22.141033 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.109241 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.109938 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.142407 10248 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.110658 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.143203 10249 raft_consensus.cc:3060] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.110580 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.113895 15845 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.114929 15961 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.117811 15642 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:22.118420 15966 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.597s	user 0.003s	sys 0.000s
I20260709 13:17:22.118813 16007 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.121691 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.165328 10246 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:22.122560 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.122826 15919 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:22.124548 15955 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:22.140959 15703 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.128031 15963 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.133680 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:22.183435 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 49828.5us
I20260709 13:17:22.134793 15970 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.149605 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.156037 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.188232 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.188478 10250 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:22.151758 15726 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:22.166811 10245 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.167936 11002 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:22.142356 15761 raft_consensus.cc:3055] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:22.126600 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.184244 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.137821 16004 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.187369 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.195398 16003 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.195643 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.192298 15931 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:22.098810 15974 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:22.209445 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 82905.2us
I20260709 13:17:22.221874 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.229351 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.226383 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.232213 10246 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.230381 10243 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:22.235538 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.240139 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.241168 10397 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:22.212643 10248 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:22.218357 11001 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:22.189190 15775 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.227279 15981 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.246652 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.253715 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.254221 10243 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:22.156894 15845 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.182644 16007 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.260342 15845 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.227690 15931 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:22.261222 15931 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.253758 15981 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.263458 15981 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.264113 10396 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:22.267128 16002 log.cc:927] Time spent T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:22.251557 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:22.252039 16008 log.cc:927] Time spent T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:22.192862 15963 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.269061 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.271072 15963 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.236640 15970 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.272073 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.272796 10243 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:22.252770 15974 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.273952 10290 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:22.274809 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 105975us
I20260709 13:17:22.276307 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.277318 15708 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.278110 15708 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.284016 16001 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.285142 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:22.284938 16001 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.287531 15999 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:22.260427 16007 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.227851 15907 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.289939 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.293099 15931 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.345619 10318 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:22.346524 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.348567 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.341598 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:22.295735 15813 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.281764 15970 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:22.218878 15985 consensus_queue.cc:260] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.165570 15961 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.380162 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2892) took 1858 ms. Trace:
W20260709 13:17:22.380952 15683 consensus_queue.cc:1175] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73825599c2644b898cebaafbccd86e99" responder_term: 13 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:22.382715 15961 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:22.319218 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.243439 15288 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:22.383783 15288 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.384232 15288 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:22.384619 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.385269 10250 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.326330 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52922 (request call id 921) took 1104 ms. Trace:
I20260709 13:17:22.387626 10321 rpcz_store.cc:276] 0709 13:17:21.221719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.221910 (+   191us) service_pool.cc:224] Handling call
0709 13:17:22.326102 (+1104192us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b540022ddd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:22.326213 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58136320}
I20260709 13:17:22.225241 15984 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:22.388944 15984 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:22.380633 10322 rpcz_store.cc:276] 0709 13:17:20.522273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.522651 (+   378us) service_pool.cc:224] Handling call
0709 13:17:20.540374 (+ 17723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.551079 (+1010705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.379874 (+828795us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003dd954. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:22.380074 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309152512}
I20260709 13:17:22.389940 15984 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.225363 15623 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:17:22.246923 15651 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.199944 15761 raft_consensus.cc:740] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:22.195461 15726 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:22.222172 15703 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.334100 10999 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:22.334757 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.336692 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.337183 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.253110 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.289145 15972 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.287335 15913 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:22.343240 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.342015 15999 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.357620 15898 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.358153 15931 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.358536 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.428908 10397 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:22.360034 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.361864 15978 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
W20260709 13:17:22.432459 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 156260us
I20260709 13:17:22.434293 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.418212 10250 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:22.363610 10393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38154 (request call id 1048) took 1290 ms. Trace:
I20260709 13:17:22.436774 10393 rpcz_store.cc:276] 0709 13:17:21.073787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.080379 (+  6592us) service_pool.cc:224] Handling call
0709 13:17:22.363394 (+1283015us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b540045c754. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:22.363531 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709152512}
I20260709 13:17:22.365625 10996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37922 (request call id 1267) took 1796 ms. Trace:
I20260709 13:17:22.368156 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.439179 10390 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:22.370492 10245 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:22.349463 15708 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.380229 15985 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.341948 15907 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.402886 10290 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.409471 10394 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:22.405910 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.415812 10249 raft_consensus.cc:2468] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:22.274873 15963 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:22.417939 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 69476.5us
I20260709 13:17:22.413163 15983 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:22.413244 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 47586.2us
I20260709 13:17:22.429755 15831 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.462248 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1047) took 1427 ms. Trace:
I20260709 13:17:22.462723 10392 rpcz_store.cc:276] 0709 13:17:21.034817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.038975 (+  4158us) service_pool.cc:224] Handling call
0709 13:17:21.040254 (+  1279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.409757 (+369503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.461979 (+1052222us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540040f454. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:22.462169 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833551104}
I20260709 13:17:22.464031 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:22.431083 10395 raft_consensus.cc:3060] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.362501 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.464685 11000 raft_consensus.cc:2376] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13. Re-sending same reply.
I20260709 13:17:22.438055 10996 rpcz_store.cc:276] 0709 13:17:20.568757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.589149 (+ 20392us) service_pool.cc:224] Handling call
0709 13:17:21.677828 (+1088679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.681423 (+  3595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.365358 (+683935us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540048c6d0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae78ad 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:22.365549 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430177152}
I20260709 13:17:22.448822 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:22.450724 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47957.9us
I20260709 13:17:22.467191 11001 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:22.418534 11002 raft_consensus.cc:2393] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 17: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:22.468575 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:22.469329 10319 raft_consensus.cc:2368] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16.
I20260709 13:17:22.455757 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.470870 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.473673 15811 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:22.474123 15811 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.465157 10324 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:22.474524 15811 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.475353 15980 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.476074 15980 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:22.413054 15703 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.474542 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.484246 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.484586 10242 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:22.431525 15999 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.418843 16000 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.420279 15813 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.490633 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:22.491526 10319 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.472103 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.492223 10399 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.488009 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:22.488108 10213 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.487983 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.494277 11000 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 19: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:22.416901 15651 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.444164 15998 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.444242 16004 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.489881 10391 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:22.486624 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:22.508877 10998 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.449967 15898 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:22.499364 10321 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:22.454975 15907 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.501060 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.501305 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:22.521458 10993 raft_consensus.cc:2368] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16.
I20260709 13:17:22.521545 10995 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 18: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:22.455217 15963 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.454975 15899 raft_consensus.cc:2764] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 13:17:22.501107 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52398us
I20260709 13:17:22.478052 15980 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:22.461905 15835 raft_consensus.cc:2804] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:22.509943 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.505712 15710 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:22.515293 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:22.516806 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.479871 15983 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.545770 10998 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 11.
I20260709 13:17:22.518685 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.519861 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.489122 15961 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.502534 10324 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:22.501567 16000 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.548398 10324 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:22.524153 15970 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.549824 10324 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:17:22.527943 15963 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.550218 10324 pending_rounds.cc:85] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 5
I20260709 13:17:22.550555 10324 pending_rounds.cc:107] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:17:22.550772 10324 raft_consensus.cc:2889] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:22.550899 10993 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:22.525550 10288 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.551887 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.552847 10288 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.553195 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.553793 10288 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:22.517423 15987 consensus_meta.cc:287] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.003s
I20260709 13:17:22.510768 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.559556 11002 raft_consensus.cc:2393] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:22.531303 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.460822 15931 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:17:22.504791 15972 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.529429 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.546766 10392 raft_consensus.cc:2393] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:22.568346 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.553887 10321 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:22.524510 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:22.555325 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:22.571527 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.521946 15726 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.576138 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.576759 10392 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:22.577737 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.578469 10392 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 13: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:22.504042 15813 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.579492 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.580524 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.587036 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.587935 10391 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.581557 10324 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:22.579181 15835 raft_consensus.cc:697] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:22.592794 15703 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.592690 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.594065 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.594834 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.598583 15651 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.589972 15845 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.604240 16001 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.567767 15987 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.621098 15835 consensus_queue.cc:237] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.626454 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.627687 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.628603 15987 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.628758 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.629503 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.629753 10997 raft_consensus.cc:2393] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 18: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:22.630093 10392 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:22.631330 10392 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:22.632098 15288 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:22.608217 15986 log.cc:927] Time spent T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:17:22.583128 15972 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.590294 15961 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:22.611290 15983 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.611726 15978 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:22.521605 15998 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.564764 15927 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:22.562800 10395 raft_consensus.cc:2468] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:22.619369 10394 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:22.575035 15948 raft_consensus.cc:2804] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:22.564818 15960 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:22.635390 10398 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:22.634402 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.645112 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:22.649859 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.660179 10322 raft_consensus.cc:2368] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 19. Current term is 20.
I20260709 13:17:22.599771 15898 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.656450 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.633731 15845 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.661414 10996 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:22.663298 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.642578 15703 consensus_queue.cc:1048] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:22.667727 15972 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.667901 15845 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.646601 15999 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.677196 10391 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
I20260709 13:17:22.682168 10246 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:22.687300 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.638164 15970 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:17:22.688705 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:22.688963 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 54658.3us
I20260709 13:17:22.693270 10321 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:22.693526 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:22.677977 15927 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:22.643101 15974 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:22.670509 16003 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:22.703488 10317 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:22.703861 10213 leader_election.cc:400] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16.
I20260709 13:17:22.667727 15998 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.706522 10213 leader_election.cc:403] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.687041 15972 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:17:22.713055 15979 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:22.713528 15979 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:22.713714 10399 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:22.715648 15503 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:22.716133 15503 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.716501 15503 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.721143 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.722505 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.723614 15813 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:22.724063 10395 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:17:22.696902 15775 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.710572 15927 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.705749 15948 raft_consensus.cc:697] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:22.727147 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.731616 10391 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:22.729418 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.688072 15907 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.734375 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.734989 10396 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:22.696681 15960 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:22.737524 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.738376 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.732676 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.743279 10399 raft_consensus.cc:3060] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.705708 16003 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.739250 10246 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:17:22.740170 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.740198 15288 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.760002 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.760841 15999 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.762713 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.763607 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.763619 10396 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
W20260709 13:17:22.740876 16020 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:22.730463 15972 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16.
I20260709 13:17:22.735728 15961 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.782998 15960 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.755329 15811 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.785758 15811 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.786844 10325 raft_consensus.cc:1240] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.788053 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:22.788618 10325 raft_consensus.cc:3060] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.751526 16003 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.753010 15979 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.792972 15979 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.797751 15948 consensus_queue.cc:237] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.804105 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.804961 10394 raft_consensus.cc:2393] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 18: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:22.806440 10395 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:17:22.813227 16019 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.124s	user 0.000s	sys 0.003s
I20260709 13:17:22.824543 10399 raft_consensus.cc:2468] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:22.826702 10325 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
W20260709 13:17:22.828672 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.840759 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.842479 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.739359 15899 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:17:22.774803 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.851066 10396 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 13.
I20260709 13:17:22.743481 15958 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.845031 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 111941us
I20260709 13:17:22.846392 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:22.847970 10395 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:22.853304 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:22.856920 10325 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.856999 10364 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.858551 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.860230 15983 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:22.771262 15726 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:17:22.860654 15503 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.862062 15961 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:22.862553 15961 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:22.862274 15958 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.863397 15972 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:22.860812 15983 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.862975 15961 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.859959 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.776906 10246 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 20.
I20260709 13:17:22.873610 10248 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:22.876387 10395 raft_consensus.cc:1275] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:22.876480 15726 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.862979 15503 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:22.878609 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.879400 15726 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.880034 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:22.880467 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.881076 10249 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.880955 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:22.884557 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.885370 10213 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:22.766093 15963 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.897620 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.901332 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.874148 10319 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
I20260709 13:17:22.902418 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.902809 10324 raft_consensus.cc:1240] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:22.903852 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.905534 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.905781 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.906616 10246 raft_consensus.cc:2393] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 18: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:22.906699 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.906966 10250 raft_consensus.cc:1275] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:22.907233 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.908004 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.908035 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:22.909703 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:22.910661 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.911082 10250 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 12.
I20260709 13:17:22.911252 10249 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:22.913141 10325 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:22.868494 15606 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.918841 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.920146 10323 raft_consensus.cc:2368] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:22.920725 15831 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:22.921949 10364 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:22.923285 15831 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:22.925940 15975 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:22.928679 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:22.930550 15907 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:22.933842 15831 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:22.935062 16011 log.cc:927] Time spent T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
W20260709 13:17:22.935400 16026 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:22.935412 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:22.939990 15831 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:22.940307 16016 log.cc:927] Time spent T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:17:22.940455 15831 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.941054 15831 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:22.916456 15781 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:22.943624 16029 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:22.945549 16029 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.900559 15726 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:22.956748 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.868912 15978 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:22.959744 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:22.914589 15970 raft_consensus.cc:2764] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:17:22.973110 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 114476us
I20260709 13:17:22.974017 10965 leader_election.cc:400] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15.
I20260709 13:17:22.973628 15761 consensus_queue.cc:260] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:22.975164 15761 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.974380 10965 leader_election.cc:403] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.856145 16003 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:22.979833 10965 leader_election.cc:400] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15.
I20260709 13:17:22.980212 10965 leader_election.cc:403] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.980847 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.981676 10390 raft_consensus.cc:3060] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:22.978812 10364 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:22.986536 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:22.987358 10393 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:22.917222 15623 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:17:22.990738 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:22.984650 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.000445 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.000636 10393 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:23.006968 10965 leader_election.cc:400] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:23.007153 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.007359 10965 leader_election.cc:403] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.009527 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.011379 10242 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:23.011039 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:23.005048 15985 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 13:17:23.017920 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.017393 10390 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:22.998378 15781 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:23.004289 15509 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.989471 15971 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15.
I20260709 13:17:22.989387 15984 consensus_queue.cc:1048] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:17:23.003445 15909 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:23.021487 15948 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:23.020709 15651 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:23.033859 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 148559us
I20260709 13:17:23.016171 15683 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:23.009871 15958 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.016266 15987 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:23.023326 16033 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:23.044133 10320 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:23.023758 10288 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:23.022501 15835 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:23.018719 15907 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.123955 10213 leader_election.cc:400] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437) with higher term. Message: Invalid argument: T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16.
I20260709 13:17:23.130621 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:23.020133 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.016108 15288 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
W20260709 13:17:23.156769 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 133111us
I20260709 13:17:23.034538 15647 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:23.177374 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 157296us
I20260709 13:17:23.046597 15948 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.122824 15651 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.034714 15951 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 13:17:23.042477 16000 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.047564 15781 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.039405 16004 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:23.176295 15503 raft_consensus.cc:2804] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:23.196456 15907 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.129745 15811 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.022142 15845 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.204454 15948 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.198104 10288 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:23.214911 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 91087.6us
I20260709 13:17:23.199389 15981 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:23.239197 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:23.239977 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:23.181193 15987 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.221427 15907 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:23.211036 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 168024us
W20260709 13:17:23.225909 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.248337 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.205755 15651 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.196161 15978 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:23.263029 10321 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:23.199244 16033 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.203755 15647 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.223933 15503 raft_consensus.cc:697] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:23.269106 15978 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.214390 15781 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.268546 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.237358 15983 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.279637 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:23.267047 15909 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:23.232834 15811 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.287946 10390 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:23.253985 15831 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.293859 15984 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.294451 15984 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.296829 15984 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.302677 11001 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:23.305150 15503 consensus_queue.cc:237] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.286463 15726 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:17:23.313006 15647 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.314903 15781 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.315173 15987 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.317126 15811 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.319473 15978 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.321434 10362 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.322928 16033 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.289583 15972 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:23.287104 16003 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.332737 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.324860 15909 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:23.328027 15831 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.285670 15898 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.338858 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.335135 15647 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:23.335712 15781 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:23.353931 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:23.356667 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:23.356990 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:23.358335 15972 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:23.358834 15972 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:23.358613 15909 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.359216 15972 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:23.368613 10393 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:23.369292 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:23.351258 15647 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.374435 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:23.375393 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:23.380192 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:23.375571 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:23.381538 10250 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.384650 10249 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:23.390209 15845 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.376241 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:23.376631 10213 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:23.396867 10213 leader_election.cc:400] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 19. Current term is 20.
I20260709 13:17:23.397330 10213 leader_election.cc:403] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.355957 15898 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:23.398653 15974 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:23.399273 15974 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:23.399639 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.399381 15898 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.400303 15974 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.402420 15978 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 19. Current term is 20.
I20260709 13:17:23.370819 15961 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.404726 15961 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.381182 15647 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:23.409528 15979 consensus_meta.cc:287] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.003s
I20260709 13:17:23.393725 15948 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.412092 15963 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.412835 15948 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.378021 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.418859 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:23.419516 10993 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.421208 15811 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.422983 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:23.423662 10999 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:23.428298 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:23.429450 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 45503.2us
I20260709 13:17:23.431432 10250 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
W20260709 13:17:23.432032 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 183789us
I20260709 13:17:23.433223 10965 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:23.429034 10994 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:23.436115 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.442729 10993 raft_consensus.cc:2468] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:23.445441 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.446209 11002 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:23.449982 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.456701 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:23.457526 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:23.468637 10965 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:23.469903 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:23.476390 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:23.476809 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:23.477068 10319 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:23.477991 10999 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:23.479099 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
W20260709 13:17:23.480721 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.481184 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:23.481946 10317 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:23.486505 10319 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:23.491163 10290 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:23.493801 10393 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:23.435915 15845 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.497165 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:23.498626 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.499372 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:23.436700 15979 raft_consensus.cc:2764] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:23.437269 15983 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:23.509840 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:23.513324 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.475031 15761 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.515717 15845 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.523615 15651 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.525543 16001 consensus_queue.cc:1048] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:23.525914 15651 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.497491 15973 raft_consensus.cc:2804] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:23.527199 15623 consensus_queue.cc:1048] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:23.514792 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.550655 10995 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:23.460770 15683 raft_consensus.cc:2804] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:23.518374 15975 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.437312 15961 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:17:23.538813 10317 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
I20260709 13:17:23.460307 15931 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:23.567210 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:23.542948 10395 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:23.554366 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:23.535714 11001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 1104) took 1071 ms. Trace:
W20260709 13:17:23.558543 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 92623.6us
I20260709 13:17:23.570701 11001 rpcz_store.cc:276] 0709 13:17:22.464237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.487357 (+ 23120us) service_pool.cc:224] Handling call
0709 13:17:23.535463 (+1048106us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54007503d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:23.535622 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861326720}
I20260709 13:17:23.571264 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:23.578747 10362 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.554759 15985 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:23.540388 15970 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.567358 15990 raft_consensus.cc:2764] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:17:23.573872 15973 raft_consensus.cc:697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:23.598074 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.600226 10999 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:23.574867 15683 raft_consensus.cc:697] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:23.554939 15983 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.578836 15997 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 14. Current term is 15.
I20260709 13:17:23.601899 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.585883 15985 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.589526 15970 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:23.604540 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 102501us
I20260709 13:17:23.608281 15781 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:23.609185 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.611824 15978 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:23.580065 15931 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.628360 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:23.630298 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.633701 11002 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:23.635119 10997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37908 (request call id 1108) took 1152 ms. Trace:
I20260709 13:17:23.569387 15975 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.616031 15845 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.635660 10997 rpcz_store.cc:276] 0709 13:17:22.482398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.505095 (+ 22697us) service_pool.cc:224] Handling call
0709 13:17:23.634826 (+1129731us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54004f42d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:23.635038 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137717120}
I20260709 13:17:23.641423 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.644579 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.645606 16000 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:23.646391 16000 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:23.652762 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:23.654371 10394 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:23.654009 15961 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:23.654752 15973 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.655051 15683 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.656514 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:23.657406 15961 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:23.657799 15961 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:23.658178 15961 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.658995 15983 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:23.603688 16044 raft_consensus.cc:2804] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:23.660616 16044 raft_consensus.cc:697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:23.661564 16044 consensus_queue.cc:237] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.632398 15985 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:23.662880 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.664212 15975 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.653944 15978 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.665302 10995 raft_consensus.cc:2410] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:23.665331 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
W20260709 13:17:23.668826 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 160122us
I20260709 13:17:23.673812 11002 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 20.
I20260709 13:17:23.673974 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:23.606469 15811 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:23.683568 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:23.684999 10997 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.642992 15970 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.695197 10999 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:23.699712 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.704764 15978 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.705406 10242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2313) took 1003 ms. Trace:
I20260709 13:17:23.705847 10242 rpcz_store.cc:276] 0709 13:17:22.702221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.702370 (+   149us) service_pool.cc:224] Handling call
0709 13:17:22.702684 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.011867 (+309183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.705176 (+693309us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540043dfd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:23.705341 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709436800}
I20260709 13:17:23.713649 15972 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.715117 10246 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:23.716427 15972 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:23.684218 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:23.680482 15811 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:23.728996 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 61810.8us
I20260709 13:17:23.687453 15909 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.736344 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.694324 15927 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:23.726141 10290 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:23.750607 10997 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:23.762218 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:23.683487 15907 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.749579 15811 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:23.804318 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.807860 10321 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:23.826882 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:23.763290 15679 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:23.760504 16003 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:23.732762 15923 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:17:23.803512 15997 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.804661 15927 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:23.803392 15971 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.748782 15775 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
W20260709 13:17:23.843026 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 264356us
I20260709 13:17:23.846354 10321 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:17:23.852945 10323 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:23.853817 10317 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:23.854120 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:23.848271 15899 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:23.866935 10318 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:17:23.868124 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:23.880726 16056 log.cc:927] Time spent T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:23.865061 15972 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:23.891013 15647 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.892696 10399 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:23.830175 15909 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:17:23.905012 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 178909us
I20260709 13:17:23.863813 15679 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:23.846675 16003 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:23.927855 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:23.928210 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:23.930006 10213 leader_election.cc:400] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:23.930366 10213 leader_election.cc:403] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.931318 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:23.933271 11000 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.934901 10396 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:23.935623 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:23.895968 15899 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.921809 15958 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:23.969426 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:23.975729 10290 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.977635 10290 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:23.978488 10242 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:23.943843 15931 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:23.984848 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:23.942354 15961 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.977802 15288 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:24.005046 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 75145us
I20260709 13:17:24.003350 15967 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:24.008610 15967 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:24.009307 15317 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:24.009819 15317 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:24.009512 15967 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.011171 15967 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.012187 15970 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.016366 11000 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.982549 15845 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.934425 15927 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.028087 16078 consensus_queue.cc:1059] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:24.029301 16078 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:24.001060 15931 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:23.982342 15923 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:23.980492 15958 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:23.987309 15679 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.024037 15898 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14.
I20260709 13:17:24.041386 15647 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:24.021395 15963 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:24.042435 15970 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.048544 15317 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.064339 15899 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.014917 15288 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.066103 15961 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.066486 15288 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.061293 15972 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.067174 15972 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.069621 15972 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:24.074450 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 55733.2us
I20260709 13:17:24.081460 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:24.086333 15961 consensus_queue.cc:1059] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:24.107095 15961 consensus_queue.cc:1243] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer cb71def93f904f619a1527aa48a32294 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:24.086211 15899 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:24.087670 16080 raft_consensus.cc:3055] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:24.116099 15960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.020s	sys 0.023s
W20260709 13:17:24.116815 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 83250.7us
I20260709 13:17:24.108857 15899 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:24.119160 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.127327 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.128659 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:24.119552 15960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.023s	sys 0.023s
I20260709 13:17:24.131213 15970 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:24.134526 15898 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:24.116783 16080 raft_consensus.cc:740] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:24.138865 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:24.142051 10318 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:24.119581 15899 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:24.142628 10317 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.144346 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.152586 16085 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:24.155206 15898 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:24.168838 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:24.169598 10999 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
I20260709 13:17:24.159119 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:24.162343 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:24.118482 16072 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:17:24.121026 16083 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:24.182595 10995 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:17:24.183157 10995 pending_rounds.cc:85] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 11
I20260709 13:17:24.183427 10995 pending_rounds.cc:107] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:17:24.183705 10995 raft_consensus.cc:2889] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.172762 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:24.173194 10967 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.116921 15985 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.186745 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:24.126122 16077 consensus_queue.cc:1059] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:17:24.141899 15972 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:17:24.201081 11001 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:24.187685 16001 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.189532 15973 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.207738 15985 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:24.209057 16073 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.144s	user 0.000s	sys 0.002s
W20260709 13:17:24.210767 16075 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:17:24.222116 15958 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.190963 16083 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:24.203512 15899 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.226707 10397 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:24.187798 15907 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:24.233742 10250 raft_consensus.cc:1240] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.239312 10244 raft_consensus.cc:1240] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:24.256753 10250 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:24.255715 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:24.223107 16080 consensus_queue.cc:260] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.272545 10996 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:24.265719 15972 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:24.275175 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 105080us
I20260709 13:17:24.268249 15811 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.281559 10394 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:24.282747 15811 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.284409 16077 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:17:24.275203 16094 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:24.286721 16094 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.289044 16094 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:24.271827 15899 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.293712 10392 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:24.294687 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:24.295442 10396 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:24.302109 10395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44062 (request call id 2302) took 1062 ms. Trace:
I20260709 13:17:24.308425 10392 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:24.282546 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:24.304875 10395 rpcz_store.cc:276] 0709 13:17:23.239318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.239747 (+   429us) service_pool.cc:224] Handling call
0709 13:17:24.301822 (+1062075us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001a9854. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:24.302019 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694629632}
I20260709 13:17:24.314502 15775 raft_consensus.cc:3055] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:24.245095 16001 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.315009 15775 raft_consensus.cc:740] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:24.275077 16080 raft_consensus.cc:3060] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.280262 15972 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:24.324038 15899 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:24.341969 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.345826 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.343804 10396 raft_consensus.cc:2468] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:24.348745 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:24.275583 15973 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:17:24.351385 15775 consensus_queue.cc:260] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.356642 15979 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:24.348914 10965 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:24.359165 15972 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.360646 15972 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.340842 16094 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:17:24.339486 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.365072 16098 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.369513 15963 consensus_queue.cc:1059] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:24.370162 10397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2591) took 1013 ms. Trace:
I20260709 13:17:24.370462 16070 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:24.370316 15951 consensus_queue.cc:1059] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:24.326918 16000 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:24.374254 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.375623 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.375823 10320 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:24.376405 10319 raft_consensus.cc:2393] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:24.376294 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.270731 16083 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.379242 15963 raft_consensus.cc:3055] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.379685 15963 raft_consensus.cc:740] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:24.380118 16083 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.380688 15985 raft_consensus.cc:2804] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:24.380455 15963 consensus_queue.cc:260] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.381217 10397 rpcz_store.cc:276] 0709 13:17:23.356535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.356814 (+   279us) service_pool.cc:224] Handling call
0709 13:17:24.369978 (+1013164us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54000f32d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:24.370104 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987256192}
I20260709 13:17:24.383083 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:23.242544  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:24.388669 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:24.389461 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:24.392374 10241 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:24.392452 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:24.393410 10394 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.392817 10241 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:24.402626 11000 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:24.405258 10395 raft_consensus.cc:1275] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:24.342655 15899 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.402664 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.411002 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:24.398509 10241 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.412354 10999 raft_consensus.cc:1275] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:24.411568 10396 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:24.412511 10241 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:24.418478 10394 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:24.381193 15985 raft_consensus.cc:697] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:24.422668 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 252904us
I20260709 13:17:24.425625 10242 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:24.427918 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:24.413580 15899 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:24.408886 16083 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:24.433539 10250 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:24.433569 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:24.434623 10998 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:24.430727 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:24.431625 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:24.411814 15963 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.439580 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:24.443187 10245 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:24.441962 10241 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:24.443936 10241 pending_rounds.cc:85] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 8
I20260709 13:17:24.444299 10241 pending_rounds.cc:107] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:24.444661 10241 raft_consensus.cc:2889] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.416965 15983 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:24.370298 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:24.455281 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39872 (request call id 2318) took 1081 ms. Trace:
I20260709 13:17:24.455811 10247 rpcz_store.cc:276] 0709 13:17:23.373696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.374095 (+   399us) service_pool.cc:224] Handling call
0709 13:17:24.444143 (+1070048us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400328554. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:24.455166 (+ 11023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698116864}
I20260709 13:17:24.457841 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:24.458585 10390 raft_consensus.cc:1240] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.459435 10288 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:24.460584 15978 raft_consensus.cc:3055] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.436959 15981 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:17:24.461218 15978 raft_consensus.cc:740] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:24.462297 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.421221 16067 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.466988 16067 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.469313 16067 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:24.470638 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:24.472457 15985 consensus_queue.cc:237] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.473487 10392 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:17:24.474387 10394 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:24.475834 16059 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:24.480711 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:24.482026 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:24.482391 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 112238us
I20260709 13:17:24.482844 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:24.483605 10324 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:24.484681 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:24.485414 10394 raft_consensus.cc:2393] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:24.485572 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.486112 10241 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:24.459597 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:24.484148 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:24.488989 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:24.491860 10392 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
I20260709 13:17:24.488559 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:24.492547 10245 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
I20260709 13:17:24.501644 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:24.502765 10245 raft_consensus.cc:2393] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:24.508141 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.510869 10997 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:24.511760 10213 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:24.491276 10288 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:24.523947 10398 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:24.526566 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:24.518486 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:24.524920 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.527798 10246 raft_consensus.cc:2410] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:24.530674 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:24.497895 16080 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:24.531071 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:24.499235 15907 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.516989 15948 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.513018 15972 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.542516 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:24.543978 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:24.457154 16083 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.524129 15913 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:24.525115 15961 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.521389 16096 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:24.536077 16067 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:24.523072 15898 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:24.539048 16059 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:24.563040 15967 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:24.514825 16098 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:17:24.535924 15970 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:17:24.462311 15978 consensus_queue.cc:260] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.562297 15913 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.568318 16044 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:24.602212 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.602010 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.541399 16076 consensus_queue.cc:1059] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:17:24.552680 15972 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.573192 15813 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:24.607628 15913 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:24.639303 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:24.600682 16059 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:24.663408 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 112210us
W20260709 13:17:24.664575 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 133578us
W20260709 13:17:24.711200 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 186232us
I20260709 13:17:24.719827 10213 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:24.729182 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 63023.1us
I20260709 13:17:24.595914 15898 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.732939 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:24.763432 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 97341.4us
I20260709 13:17:24.767181 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:24.643412 15831 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:24.718881 16086 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:24.634644 16077 consensus_queue.cc:1059] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.136s
I20260709 13:17:24.710389 16080 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:24.743613 16000 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.788756 16058 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:24.839891 10289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.803305 15811 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.793583 15975 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:17:24.825920 10997 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:17:24.843531 15970 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:24.862103 16058 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.891633 16087 consensus_queue.cc:1048] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:17:24.891086 16100 log.cc:927] Time spent T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
W20260709 13:17:24.912674 16108 log.cc:927] Time spent T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:24.909754 16115 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.915154 16083 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:24.914844 16115 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.917752 16115 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:24.804692 15813 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:24.802826 15983 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.812865 15990 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:17:24.886556 16102 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:17:24.888177 16101 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 13:17:24.888888 16103 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:17:24.869513 15811 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:24.939772 15898 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:24.910106 16114 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:24.941046 16116 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.932353 16058 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.936885 15813 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 19 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:24.862044 16059 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.946748 15899 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.884507 15970 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:24.867316 16000 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:24.935488 10290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.848825 16080 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.079371 16067 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:25.076130 16116 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.087546 16067 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.089146 16116 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:25.089385 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.090378 16000 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:25.092325 16079 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 1.024s	user 0.003s	sys 0.000s
I20260709 13:17:25.093544 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.094261 10319 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:25.094412 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.095009 10320 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:25.097133 15970 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.097772 15845 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.957036 16096 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.069820 15683 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.107462 15683 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.108922 16121 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:17:25.109746 15683 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.110913 16125 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.111550 16125 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.113721 16125 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.114837 15317 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.115065 10244 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 19: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:25.115955 15899 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.074153 16081 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.097875 16003 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.123685 16081 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.124264 10244 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:17:25.124815 10244 pending_rounds.cc:85] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 10
I20260709 13:17:25.125103 10244 pending_rounds.cc:107] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:25.125393 10244 raft_consensus.cc:2889] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.098119 10322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2936) took 1623 ms. Trace:
I20260709 13:17:25.126008 10322 rpcz_store.cc:276] 0709 13:17:23.475242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.480139 (+  4897us) service_pool.cc:224] Handling call
0709 13:17:23.480489 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.689363 (+208874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.689411 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.689494 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:23.689539 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.097902 (+1408363us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540021cfd4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:25.097949 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.098067 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479692544}
I20260709 13:17:25.098698 15845 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.129011 15845 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.131306 15813 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.139652 15948 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:25.140385 15948 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.126071 16081 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.148250 10244 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:25.114279 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.153692 15831 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.155745 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.158838 10399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44068 (request call id 2587) took 1804 ms. Trace:
I20260709 13:17:25.159672 10399 rpcz_store.cc:276] 0709 13:17:23.354162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.354337 (+   175us) service_pool.cc:224] Handling call
0709 13:17:23.354802 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.893251 (+538449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.158487 (+1265236us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540042fed4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:25.158762 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236209408}
I20260709 13:17:25.166324 15651 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:25.164772 15831 raft_consensus.cc:493] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:25.151304 16001 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.167667 15831 raft_consensus.cc:515] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.169826 16117 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.171973 16117 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.173463 15831 leader_election.cc:290] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.175140 10246 raft_consensus.cc:1275] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:25.176740 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:25.053325 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.185810 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 418709us
I20260709 13:17:25.185978 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:25.188413 10396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.040s	sys 0.031s
W20260709 13:17:25.188862 10396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.040s	sys 0.031s
W20260709 13:17:25.190132 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 366522us
I20260709 13:17:25.191298 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:25.190377 16119 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.195452 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.203063 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:25.209257 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:25.205269 15651 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.211344 16117 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.212239 16124 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.212827 16044 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:25.213383 16044 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:25.212899 16124 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.214275 16044 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.215657 16044 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.221067 10997 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:25.184964 15831 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:25.199120 16081 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.231976 16081 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:25.232440 10321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2945) took 1260 ms. Trace:
I20260709 13:17:25.233104 16081 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.198477 16001 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:25.237566 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.242432 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 137022us
I20260709 13:17:25.249452 15845 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.250063 15845 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:25.242997 15679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.007s	sys 0.043s
I20260709 13:17:25.235751 16124 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.233004 10321 rpcz_store.cc:276] 0709 13:17:23.971547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.971677 (+   130us) service_pool.cc:224] Handling call
0709 13:17:23.971964 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.059128 (+ 87164us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:17:24.078971 (+ 19843us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.115738 (+ 36767us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.126301 (+ 10563us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.126994 (+   693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.127056 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:24.168734 (+ 41678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.299672 (+130938us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18002de200. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:17:25.107554 (+807882us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b18002de200. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09c92a6 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f
0709 13:17:25.108015 (+   461us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b4800270cd8. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c8a11aa1 00007f58c8a08b37 00007f58c8a089ca 00007f58c8b0026f 00007f58c8afff37 00007f58c8b1455c 00007f58c8b14508 00007f58c8b14488 00007f58c8b14443 00007f58c8b136ec 00007f58c7a3da96
0709 13:17:25.171878 (+ 63863us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18002de200. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:17:25.232130 (+ 60252us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b54001879d4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:25.232198 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.232369 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2260,"prepare.queue_time_us":31553,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":161,"raft.queue_time_us":1581,"raft.run_cpu_time_us":2677,"raft.run_wall_time_us":1030773,"spinlock_wait_cycles":245382656,"thread_start_us":36101,"threads_started":1,"wal-append.queue_time_us":72519}
I20260709 13:17:25.254312 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.288856 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.289436 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.256737 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.259389 15845 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.248591 15317 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.265681 16126 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.251559 15948 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:25.269651 15913 consensus_meta.cc:287] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.003s
W20260709 13:17:25.273729 16110 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.422s	user 0.009s	sys 0.000s
I20260709 13:17:25.252142 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:25.303184 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 51127.1us
I20260709 13:17:25.304298 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:25.284662 16137 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.249018 15811 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.291831 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.292846 10323 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:25.293939 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.308235 10320 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
I20260709 13:17:25.290073 10322 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:25.292901 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.297493 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:25.309901 10997 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:25.286823 15679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.007s	sys 0.043s
I20260709 13:17:25.301851 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:25.306684 15913 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.337632 10997 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 19.
I20260709 13:17:25.299770 15317 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.339752 16137 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.341233 15317 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.342589 16137 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.298190 15997 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.344305 15997 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.331187 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:25.313431 16122 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.313220 15899 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.313534 15908 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.374658 16127 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.354089 15927 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.378261 10321 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:25.363029 16094 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.360332 15679 raft_consensus.cc:493] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.366376 15899 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.364027 16122 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.367033 15948 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:25.406693 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 220731us
I20260709 13:17:25.300012 16126 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.409070 15899 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.422024 10213 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:25.424645 10325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 2946) took 1452 ms. Trace:
I20260709 13:17:25.425069 10325 rpcz_store.cc:276] 0709 13:17:23.971827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.979544 (+  7717us) service_pool.cc:224] Handling call
0709 13:17:23.979869 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.067218 (+ 87349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.067251 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.067296 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:24.067327 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.424403 (+1357076us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b5400113d54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:25.424454 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.424581 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200428928}
I20260709 13:17:25.428293 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.369722 15908 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.410674 16122 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.429653 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.430642 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.434185 10247 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 13: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:25.425288 16126 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.437294 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.438381 15997 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.438537 15979 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.432646 16051 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.439133 15979 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.439489 16051 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.409394 15679 raft_consensus.cc:515] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.441330 16147 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:25.441506 16051 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.435539 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.402568 15927 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.433313 10248 raft_consensus.cc:3055] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:25.450367 10248 raft_consensus.cc:740] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:25.451383 10248 consensus_queue.cc:260] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.375319 16127 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.408815 16094 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.456833 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:25.477236 10247 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 19: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:25.457788 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.458678 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.476016 11002 raft_consensus.cc:1275] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:25.441372 15979 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.418016 16058 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.438200 16146 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:17:25.504954 11002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:25.505971 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:25.506451 10291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.522614 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.443015 16147 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:17:25.510610 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.514482 16051 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:25.514927 10393 raft_consensus.cc:1240] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:25.515224 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.476060 16121 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.513912 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38076f481679473aac7854c07b22e381" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.523092 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:25.532341 10395 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 19: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:25.523653 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.522615 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.522977 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.491281 15811 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:25.551251 10398 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:25.520998 15979 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.558759 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:25.560227 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 120553us
I20260709 13:17:25.552836 15913 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.572330 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.577924 10325 raft_consensus.cc:1240] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:17:25.578195 15978 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.580708 16094 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.556105 16121 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.581990 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.584929 15908 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.564355 15811 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.600651 10391 raft_consensus.cc:2468] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:25.602262 15811 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.587039 15975 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:25.603048 15975 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.587389 16127 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.558120 16080 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:25.605170 15899 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.605734 15975 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.590919 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.606712 16121 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.606750 15927 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:25.607429 15983 consensus_meta.cc:287] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.001s
I20260709 13:17:25.607797 16080 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.607961 15983 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.608301 16080 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:25.609812 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.611250 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:25.587441 16058 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.593483 10316 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
W20260709 13:17:25.617163 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 44920.3us
I20260709 13:17:25.618377 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.619230 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.619887 10316 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 19.
I20260709 13:17:25.621485 15972 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.622403 16119 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:25.622454 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.624249 10242 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:25.626551 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:25.628057 16124 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.628670 16124 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.629710 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.630597 10244 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:25.631403 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:25.632509 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.633577 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.628873 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.560290 15979 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.634552 15835 consensus_queue.cc:1048] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:25.636190 15979 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.637588 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:25.638903 10242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.652824 10242 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.653237 10242 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:25.654037 10242 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.655602 15978 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:25.656068 15978 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.656383 15978 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:25.656406 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.659010 15979 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.679415 16058 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:25.681066 16122 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.683656 16122 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.684381 10249 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.690343 15979 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.692713 15979 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:25.693373 15974 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:17:25.669406 16124 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:25.699448 15899 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.705528 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.709925 15978 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.711477 15775 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.712661 16080 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.718210 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.718948 16080 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.722858 10399 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:25.724232 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.713877 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.727310 10247 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 20.
W20260709 13:17:25.728731 16084 log.cc:927] Time spent T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.652s	user 0.003s	sys 0.012s
I20260709 13:17:25.730739 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:25.733726 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 71003.5us
I20260709 13:17:25.734004 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:25.735520 10390 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:25.735559 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.737247 10241 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:25.738637 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:25.739241 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 121025us
I20260709 13:17:25.740995 10390 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:25.742870 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:25.744103 11000 raft_consensus.cc:2393] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 19: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:25.742727 10213 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.743773 10241 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:17:25.745460 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:25.746527 11001 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:25.748778 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.751924 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.754071 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:25.759009 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:25.759202 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.759927 10241 raft_consensus.cc:1240] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:25.761785 10250 raft_consensus.cc:1240] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:25.766076 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.753298 16080 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:25.739872 15961 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.740059 15913 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:25.776463 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:25.786613 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:25.778584 10250 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:17:25.787235 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.778975 16122 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.780480 16098 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.776268 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:25.773430 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:25.767439 16127 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:25.806118 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.797336 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.807135 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:25.798712 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.808261 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.798638 16140 consensus_queue.cc:1059] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:17:25.786669 15951 consensus_queue.cc:1048] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:17:25.799405 16143 consensus_queue.cc:1059] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 13:17:25.800467 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 73825599c2644b898cebaafbccd86e99 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:25.798151 10316 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:25.801189 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:25.799593 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 50337.9us
I20260709 13:17:25.807715 10325 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:25.808419 10395 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:25.784190 15503 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:25.755864 15923 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:17:25.827883 10316 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:25.817294 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.829212 10396 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
W20260709 13:17:25.821638 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.783979 16119 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:25.830003 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:25.824873 10132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64487.4us
I20260709 13:17:25.814715 15927 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:25.831571 15927 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.831981 15927 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.832801 10316 raft_consensus.cc:1240] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:25.833840 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:25.834502 10320 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:25.834702 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:25.839476 16119 raft_consensus.cc:3055] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:25.839979 16119 raft_consensus.cc:740] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:25.840817 16119 consensus_queue.cc:260] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.842049 16119 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:25.843321 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.843649 16129 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.442s	user 0.001s	sys 0.000s
I20260709 13:17:25.848654 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:25.850890 15927 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.851480 15973 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:25.853135 15973 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.788945 15978 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 20 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:25.849906 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:25.861831 16080 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.863051 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:25.871480 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:25.873631 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.815847 16098 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.815081 15908 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:17:25.863687 16118 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:25.875887 10213 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:25.875993 10392 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:25.853253 15927 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.877234 15964 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.807415 16122 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.878684 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:25.800493 16121 consensus_queue.cc:1059] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:17:25.823706 15710 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:25.814683 16051 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:25.881321 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:25.884413 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 68304.6us
I20260709 13:17:25.815332 15961 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.867164 15973 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.877101 15983 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:25.877184 15974 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.887465 10362 leader_election.cc:304] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:25.889735 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.892495 10321 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:25.890028 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.886410 16051 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.890728 16127 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.894788 16051 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:25.895246 16127 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.886675 15710 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:25.891273 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0de4147226834030b0fd22d4a0948990" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.880097 16118 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:25.877899 16080 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:25.891707 10320 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 20.
I20260709 13:17:25.886118 15978 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:25.957571 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.963186 10242 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.972148 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:25.945578 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 58201.8us
I20260709 13:17:25.887904 10965 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:25.959903 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.940510 10248 raft_consensus.cc:3060] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:26.020011 16076 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.020841 16076 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.020108 15979 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.900436 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:25.897830 16127 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:25.891326 15973 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.959365 16121 raft_consensus.cc:2749] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:25.898373 15710 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.032202 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.023995 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:25.898775 15899 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:25.961581 16122 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:25.938365 16156 log.cc:927] Time spent T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:17:26.018296 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 130503us
I20260709 13:17:25.884804 15964 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:25.958391 15974 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:26.002421 16140 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.887068 15913 consensus_queue.cc:1048] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:17:26.045583 10213 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:26.025931 15908 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.022588 16119 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:25.961421 16098 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.040771 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.054670 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:26.054950 10318 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:26.032699 15978 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:26.056989 10965 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:25.940297 15509 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.104s
I20260709 13:17:26.066681 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:26.035214 15898 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.096583 10316 raft_consensus.cc:2410] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:17:26.060309 10323 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
W20260709 13:17:26.117869 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 60972us
I20260709 13:17:26.056980 15979 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.060254 16127 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:17:26.098074 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 43482.4us
I20260709 13:17:26.125870 16080 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.126520 15975 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:26.128687 15972 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:26.130066 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.130395 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.055697 16143 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:26.133685 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.136068 10242 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:17:26.176602 10242 pending_rounds.cc:85] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 9
I20260709 13:17:26.177021 10242 pending_rounds.cc:107] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:17:26.177368 10242 raft_consensus.cc:2889] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:26.137899 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 71358.2us
I20260709 13:17:26.181907 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:26.165952 10362 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:26.046758 16140 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.134393 16122 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.106460 15981 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:26.229147 15975 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:26.047231 15974 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.130970 15978 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.196903 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:26.095490 16119 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.166042 10248 raft_consensus.cc:1275] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:17:26.225929 15775 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:26.182420 16143 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.220527 15703 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:26.230731 10993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37908 (request call id 1110) took 2753 ms. Trace:
I20260709 13:17:26.118928 15958 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:17:26.068262 15908 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.168778 16137 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:26.284826 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.225162 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.286185 10398 raft_consensus.cc:2410] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:26.237082 10395 raft_consensus.cc:1240] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:17:26.237700 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.286973 10394 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:26.237713 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.238258 10288 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:26.253721 10993 rpcz_store.cc:276] 0709 13:17:23.477452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.477585 (+   133us) service_pool.cc:224] Handling call
0709 13:17:23.516272 (+ 38687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.528182 (+ 11910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.528218 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.425922 (+1897704us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c00013008. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c23e1a11 00007f58c23f1372 00007f58c3b23a01 00007f58c3ae843a 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2
0709 13:17:25.431803 (+  5881us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.586861 (+155058us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:25.586909 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.588234 (+  1325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.222445 (+634211us) raft_consensus.cc:1685] finished
0709 13:17:26.222479 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.230615 (+  8136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11405,"raft.queue_time_us":14166,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":28228352,"thread_start_us":69959,"threads_started":1,"wal-append.queue_time_us":290384}
I20260709 13:17:26.261270 15960 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:17:26.264103 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.316174 10321 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:26.272701 10325 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:26.169309 16098 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.319243 16098 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.321606 16098 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.049317 16118 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.335888 16118 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:26.339103 16161 log.cc:927] Time spent T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:17:26.349061 16140 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.236215 16147 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.350421 16147 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.353260 16147 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.253032 16143 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.239532 16119 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.274266 16122 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.367300 16122 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.163462 15979 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.370959 15979 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:26.372822 16087 consensus_queue.cc:1175] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73825599c2644b898cebaafbccd86e99" responder_term: 17 status { last_received { term: 16 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:26.373862 16076 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.124213 15898 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.376467 15898 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:26.251116 16160 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:17:26.379549 10244 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
I20260709 13:17:26.379994 10244 pending_rounds.cc:85] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 5
I20260709 13:17:26.380244 10244 pending_rounds.cc:107] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:17:26.380522 10244 raft_consensus.cc:2889] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.283282 16117 consensus_queue.cc:1059] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:17:26.387439 16137 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:26.282598 16051 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.392241 16051 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 21 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:26.393575 10216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.254045 10248 pending_rounds.cc:85] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 12
W20260709 13:17:26.202941 16078 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:17:26.289181 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 51036.8us
I20260709 13:17:26.399916 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:26.293165 10213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.296159 16094 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.296267 15775 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:26.297087 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:26.298337 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.405725 10393 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:26.299861 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:26.300946 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:26.408592 16107 log.cc:927] Time spent T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 1.555s	user 0.001s	sys 0.018s
I20260709 13:17:26.409183 10394 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:26.404844 15775 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:26.410950 15775 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.305651 15908 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.234418 16124 raft_consensus.cc:3055] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:26.309944 15606 raft_consensus.cc:493] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:26.312008 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:26.394609 10248 pending_rounds.cc:107] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 17.13
W20260709 13:17:26.401175 10247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.037s	sys 0.036s
I20260709 13:17:26.421851 10248 raft_consensus.cc:2889] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:26.422043 10247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.037s	sys 0.037s
I20260709 13:17:26.416985 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:26.424791 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 112895us
I20260709 13:17:26.425112 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:26.426888 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:26.431759 16114 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:26.421105 16124 raft_consensus.cc:740] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:26.436937 16140 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:26.437569 16140 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.438161 16140 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.435199 15908 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:26.434643 15606 raft_consensus.cc:515] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.441732 15606 leader_election.cc:290] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:26.442414 16083 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:17:26.443115 16058 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:26.415762 15958 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.423230 15964 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.478402 15606 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:26.484637 15961 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.488912 10398 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 19.
I20260709 13:17:26.490741 15775 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.493100 15775 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.505183 10246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2354) took 1561 ms. Trace:
I20260709 13:17:26.510964 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.512705 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.517751 16044 raft_consensus.cc:3055] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:26.518280 16044 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:26.522403 15980 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.523036 15980 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.405910 15979 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.505698 10246 rpcz_store.cc:276] 0709 13:17:24.943794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.176112 (+232318us) service_pool.cc:224] Handling call
0709 13:17:25.176437 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.176621 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:25.364506 (+187885us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.504705 (+1140199us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b18002e0cc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c36904bc 00007f58c09de48b 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287
0709 13:17:26.504828 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.504881 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:26.504929 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.504999 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.505123 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1879,"prepare.queue_time_us":192504,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3672,"raft.queue_time_us":9565,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":3528064,"thread_start_us":228995,"threads_started":2}
I20260709 13:17:26.533208 15710 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.538947 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.471325 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:26.472942 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.437348 16124 consensus_queue.cc:260] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.543853 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.415517 16094 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.545079 10248 raft_consensus.cc:2410] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:17:26.546371 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 75018us
I20260709 13:17:26.562529 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:26.568068 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:26.588660 10241 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:26.591053 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.596964 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:26.565059 16078 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.564541 16119 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:26.595741 16001 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.606923 16094 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.606554 16119 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.606698 16001 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.526054 15979 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.601559 15987 consensus_queue.cc:1048] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:17:26.609346 15979 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.611141 16001 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.611744 16143 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.613421 15974 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.615820 16119 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.592382 16117 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.616149 10993 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:17:26.578365 15973 consensus_meta.cc:287] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 13:17:26.594395 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:26.620867 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15565c698f45442aa353abbe927bfc68" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:26.628064 15974 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:26.628481 15974 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.623109 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.628727 16117 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.628858 15974 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.629484 10249 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 6.
I20260709 13:17:26.602852 16076 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:26.637974 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.642834 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:26.642660 10965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.029s	sys 0.023s
W20260709 13:17:26.647246 10965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.029s	sys 0.023s
W20260709 13:17:26.649658 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 517664us
I20260709 13:17:26.651589 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.649978 10321 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:17:26.653373 10321 pending_rounds.cc:85] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 12
I20260709 13:17:26.653724 10321 pending_rounds.cc:107] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:17:26.654036 10321 raft_consensus.cc:2889] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.656131 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.658118 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:26.662391 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:26.662675 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.663419 10993 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 21: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:26.661996 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.665141 10321 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:26.666390 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.666862 10993 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:26.667318 10323 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:26.647819 10967 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:26.674834 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:26.638257 10324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.065s
I20260709 13:17:26.677400 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:26.678025 10324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.011s	sys 0.065s
I20260709 13:17:26.641538 16076 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.648439 16077 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:26.714414 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.718194 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.630998 16140 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.630791 15973 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.681948 15998 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:26.718901 10321 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:26.716764 16076 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.669159 16094 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:17:26.745424 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:26.732031 16127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.025s
W20260709 13:17:26.746752 16127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.026s
I20260709 13:17:26.746603 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:26.747051 16127 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:26.747298 11000 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:26.746140 10997 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 12.
I20260709 13:17:26.747831 15710 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.729841 15998 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.747123 16143 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.762322 15998 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:26.767625 16164 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.353s	user 0.002s	sys 0.002s
W20260709 13:17:26.769861 16159 log.cc:927] Time spent T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.541s	user 0.000s	sys 0.001s
I20260709 13:17:26.773599 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:26.785998 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.786739 10397 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:26.755470 15913 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.790037 10243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.016s	sys 0.030s
W20260709 13:17:26.793030 10243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.017s	sys 0.030s
W20260709 13:17:26.793351 10242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.006s	sys 0.016s
W20260709 13:17:26.793660 10242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.006s	sys 0.016s
I20260709 13:17:26.792840 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:26.793759 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:26.756513 15978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.022s
W20260709 13:17:26.794669 10396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.017s	sys 0.036s
I20260709 13:17:26.759970 15898 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.802253 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:26.805049 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.806995 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:26.808395 10396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.018s	sys 0.036s
I20260709 13:17:26.747960 16127 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.815871 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:26.796281 16078 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:26.805608 15899 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:26.805356 15978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.023s
W20260709 13:17:26.831085 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.809721 16170 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.812898 16172 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.797034 15913 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.829290 16078 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.823583 15987 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.832501 15899 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.817201 16143 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.828751 16173 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.830132 16117 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.818930 15898 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.833801 16175 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.837491 16140 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.855855 16078 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.858373 15987 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.873706 15987 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.874325 15973 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.859802 16143 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.876977 16143 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.866663 15979 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:26.878057 15979 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.864673 16044 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.850440 16170 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.879134 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.880295 15979 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.880975 16170 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.856863 15899 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:26.882301 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:26.851774 16172 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.879153 16044 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:26.911649 15913 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.923595 15899 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:26.925992 15899 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:26.926520 16172 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:26.927222 10390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2332) took 1188 ms. Trace:
I20260709 13:17:26.928934 15898 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:26.927798 10390 rpcz_store.cc:276] 0709 13:17:25.749197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.758359 (+  9162us) service_pool.cc:224] Handling call
0709 13:17:25.758995 (+   636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.768028 (+  9033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.768058 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.774482 (+  6424us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.414682 (+640200us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b1800096c40. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:26.824976 (+410294us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:26.825020 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.825088 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.926823 (+101735us) raft_consensus.cc:1685] finished
0709 13:17:26.926854 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.927140 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":9162,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11477,"spinlock_wait_cycles":21449600,"thread_start_us":410103,"threads_started":1,"wal-append.queue_time_us":1134863}
I20260709 13:17:26.860113 16173 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:26.939415 10245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 1219) took 1334 ms. Trace:
I20260709 13:17:26.939873 10245 rpcz_store.cc:276] 0709 13:17:25.605166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.618829 (+ 13663us) service_pool.cc:224] Handling call
0709 13:17:25.619165 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.619560 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:25.619588 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.623887 (+  4299us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.496066 (+872179us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800017440. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c36880d1 00007f58c3aa3a0f
0709 13:17:26.820189 (+324123us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:26.820254 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.820355 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.939098 (+118743us) raft_consensus.cc:1685] finished
0709 13:17:26.939118 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.939337 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":861,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":2533120,"thread_start_us":323881,"threads_started":1,"wal-append.queue_time_us":1313461}
I20260709 13:17:26.865763 16175 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:26.960529 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 132546us
I20260709 13:17:26.965345 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:26.965996 10321 raft_consensus.cc:3060] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.971972 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.974766 10396 raft_consensus.cc:2393] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 17: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:26.974819 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f38b8c79f844dc83f9505884422f2a" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:26.974054 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:26.986384 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.986701 10390 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:26.987040 10393 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:26.987479 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.987660 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:26.988188 10393 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:26.988957 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:26.989252 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.989627 11000 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:26.989856 10395 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:26.990823 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.991447 10394 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 18.
W20260709 13:17:26.976998 16169 log.cc:927] Time spent T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:17:26.993145 16173 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:26.977160 16178 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:17:26.994884 10321 raft_consensus.cc:2468] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:26.985132 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:26.996007 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.985656 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:26.998826 10994 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:26.961647 15974 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:27.003332 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.006611 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.007601 10321 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:27.012742 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.018471 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.019562 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:27.010985 16181 log.cc:927] Time spent T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:26.975370 15913 consensus_queue.cc:1059] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:17:27.015149 16174 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.045125 15679 leader_election.cc:290] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.048969 15980 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:27.028661 16186 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.051724 15974 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:27.071413 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.075945 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.076761 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.078855 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.080256 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.080830 11000 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:27.016161 16119 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:17:27.083253 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.084369 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.085378 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.091308 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.092155 11000 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:27.093096 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:27.095752 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.095942 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:27.097159 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4dd97a92804cc6927c6fff64d16f39" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.097487 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.027788 16176 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.100548 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.031661 15703 raft_consensus.cc:3055] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:27.105571 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.102402 10965 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.108245 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.108511 10996 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:17:27.108971 10390 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:27.061033 16175 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:27.113600 15960 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.113976 10395 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:17:27.114177 15960 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.116384 15960 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:27.116269 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.117252 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.124473 15998 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.127952 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.032425 16078 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.107277 15983 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:27.031706 16174 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.106022 15971 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:27.134720 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.143294 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.104573 15703 raft_consensus.cc:740] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:27.144657 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:27.140241 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 121863us
I20260709 13:17:27.149482 10392 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:27.152051 10993 raft_consensus.cc:2393] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 7: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:27.153934 10965 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.141499 16192 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:27.136584 15983 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.144158 15679 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.157842 16193 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:27.164181 10965 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.179848 16175 raft_consensus.cc:2804] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:27.179970 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.180537 16175 raft_consensus.cc:697] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:27.181022 16001 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:27.181473 16001 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.181939 16001 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:27.171056 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.163167 16172 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:27.166040 15975 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.174345 10362 leader_election.cc:304] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.181066 10965 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.173630 15983 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.197695 15703 consensus_queue.cc:260] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.198907 15703 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.158174 16140 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:17:27.161345 15960 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:27.163024 16076 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.181530 16175 consensus_queue.cc:237] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.211953 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.186549 15679 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:27.206605 16124 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.215200 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.214551 16173 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.207297 16186 raft_consensus.cc:2749] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.226249 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:27.210619 16172 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.229094 16193 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.226732 16173 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.240098 16173 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.240707 16001 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.240864 10141 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.215853 15679 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.212430 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:27.206664 15908 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:17:27.248190 16067 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:27.248826 16001 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:27.250145 16165 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.499s	user 0.003s	sys 0.000s
I20260709 13:17:27.231256 16051 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.232932 16176 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:27.263648 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:27.261610 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 49238.5us
I20260709 13:17:27.269001 10288 leader_election.cc:304] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:27.269866 10247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54378 (request call id 1224) took 1404 ms. Trace:
I20260709 13:17:27.271488 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.268748 10393 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:27.273203 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.274155 15503 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.274654 15503 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.274798 15958 raft_consensus.cc:2749] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.275081 15503 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.275241 10141 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 15, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.277158 10141 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.278191 15998 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:27.278987 16082 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:27.278858 10141 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.280719 10141 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.282475 10141 catalog_manager.cc:5697] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:17:27.283368 10143 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 210) took 28438 ms (client timeout 15000 ms). Trace:
I20260709 13:17:27.284096 10141 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.286083 15503 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.286079 10141 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 13, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 13 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.253243 15679 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:27.288782 15503 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:27.291981 16171 log.cc:927] Time spent T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260709 13:17:27.267803 15964 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:27.288710 10141 catalog_manager.cc:5697] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:27.272045 16176 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.303473 16176 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:27.283883 10143 rpcz_store.cc:269] 0709 13:16:58.845071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.846656 (+  1585us) service_pool.cc:224] Handling call
0709 13:17:27.283244 (+28436588us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:19.782347 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:19.783043 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:19.783090 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:17:19.783109 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:19.783869 (+   760us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:19.783973 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:19.783998 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:17:19.784617 (+   619us) tablet.cc:701] Row locks acquired
0709 13:17:19.784666 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:19.784831 (+   165us) write_op.cc:270] Start()
0709 13:17:19.784979 (+   148us) write_op.cc:276] Timestamp: P: 1783603039784762 usec, L: 0
0709 13:17:19.785012 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:17:19.785654 (+   642us) log.cc:844] Serialized 2132 byte log entry
0709 13:17:20.522942 (+737288us) op_driver.cc:464] REPLICATION: finished
0709 13:17:20.971596 (+448654us) write_op.cc:301] APPLY: starting
0709 13:17:20.971726 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:21.348765 (+377039us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:21.348908 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:21.921590 (+572682us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:21.971177 (+ 49587us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:17:21.971258 (+    81us) write_op.cc:312] APPLY: finished
0709 13:17:22.030175 (+ 58917us) log.cc:844] Serialized 57 byte log entry
0709 13:17:22.149910 (+119735us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:22.157161 (+  7251us) write_op.cc:454] Released schema lock
0709 13:17:22.184088 (+ 26927us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:22.247931 (+ 63843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:22.303209 (+ 55278us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":622428,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":396371,"apply.run_cpu_time_us":51125,"apply.run_wall_time_us":1284071,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":135052,"prepare.run_cpu_time_us":16020,"prepare.run_wall_time_us":129596,"raft.queue_time_us":260760,"raft.run_cpu_time_us":22751,"raft.run_wall_time_us":431905,"replication_time_us":687230,"thread_start_us":557535,"threads_started":5,"wal-append.queue_time_us":387726,"wal-append.run_cpu_time_us":24569,"wal-append.run_wall_time_us":2391603}]]}
I20260709 13:17:27.307348 16076 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:27.259171 16067 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:27.308750 16067 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.310247 16067 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.314450 16078 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.314935 10141 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 14, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.324209 10995 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:27.326822 10141 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 16, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 16 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:27.332532 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.270262 10247 rpcz_store.cc:276] 0709 13:17:25.865081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.865213 (+   132us) service_pool.cc:224] Handling call
0709 13:17:25.865543 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:25.866052 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:25.866090 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:25.866945 (+   855us) log.cc:844] Serialized 52 byte log entry
0709 13:17:26.422830 (+555885us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:26.422887 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.422984 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.222577 (+799593us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b4400022b4c. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c0921c85 00007f58c09226a2 00007f58c36941db 00007f58c368faaf 00007f58c368386e 00007f58c3682bb6 00007f58c36827d8 00007f58c368c221 00007f58c368c1d9 00007f58c368c169
0709 13:17:27.265527 (+ 42950us) raft_consensus.cc:1685] finished
0709 13:17:27.265548 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.269800 (+  4252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2845,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6326,"spinlock_wait_cycles":7326080,"thread_start_us":535488,"threads_started":1,"wal-append.queue_time_us":834045}
I20260709 13:17:27.225656 16199 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:17:27.350284 10316 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:27.351640 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.352145 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.353340 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.354059 10320 raft_consensus.cc:2393] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:27.353875 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.354908 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.354789 10322 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:27.355027 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.358285 10317 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:27.363358 10323 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 13:17:27.379801 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 149310us
I20260709 13:17:27.380908 10319 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:27.386920 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.379225 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:27.349905 16118 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:27.357838 16173 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.402467 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.403699 10288 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.404775 15958 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:27.394811 16175 raft_consensus.cc:2749] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.379110 10141 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 12, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:27.399873 15987 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.411763 15987 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.413903 15987 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:27.417621 16094 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.421613 16124 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:27.422297 16124 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:27.422765 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 606968us
I20260709 13:17:27.423846 10213 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.424214 16173 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:27.392997 16118 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.424791 16094 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:27.424947 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:27.426505 16118 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.427122 16179 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.427857 16179 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.428189 16179 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.428525 16179 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.433137 10141 catalog_manager.cc:5697] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.434466 16174 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:27.435776 15899 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:27.436213 15899 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:27.437014 15899 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.438584 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.435233 10141 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 16, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.439240 10247 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:27.439366 16076 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:27.439975 16076 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.440526 10246 raft_consensus.cc:1240] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:17:27.440423 10141 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.441673 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.442327 10244 raft_consensus.cc:2468] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:27.443370 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:27.444123 10241 raft_consensus.cc:2368] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16.
I20260709 13:17:27.445066 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.390354 15963 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:17:27.446499 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.447090 10325 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:27.447860 10243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39884 (request call id 3142) took 2166 ms. Trace:
I20260709 13:17:27.448938 10248 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 16: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:27.448766 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.450006 10241 raft_consensus.cc:1240] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:27.450127 10362 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.451201 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.460597 10213 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.437979 15899 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.465726 10362 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.468995 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.469642 10325 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.473163 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.474164 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.448292 10243 rpcz_store.cc:276] 0709 13:17:25.281558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.633971 (+352413us) service_pool.cc:224] Handling call
0709 13:17:25.634350 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.647672 (+ 13322us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:25.667473 (+ 19801us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.225156 (+557683us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b1800137bc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09dde07 00007f58c9838ab9 00007f58c09fa69b 00007f58c09f893f 00007f58c09fac02 00007f58c368220b 00007f58c3687d23 00007f58c368823a 00007f58c3af2a2a
0709 13:17:26.519503 (+294347us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b1800137bc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb3f3 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:17:26.813346 (+293843us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.057970 (+244624us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800137bc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c09fb522 00007f58c09fd7c1 00007f58c09fd779 00007f58c09fd709 00007f58c09fd6d1 00007f58c09fc9cd 000000000038f354 000000000038f199 00007f58c09de83a
0709 13:17:27.415022 (+357052us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b1800137bc0. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c98c3de1 00007f58c98d05b1 00007f58c0975c0a 00007f58ca0b5219 00007f58c09fda40 00007f58c09f84e4 00007f58c09f8455 00007f58c3ae0060 00007f58c3af2716 00007f58c3b03287 00007f58c3b03208
0709 13:17:27.415207 (+   185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.415676 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.415826 (+   150us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:27.415862 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.415931 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.447651 (+ 31720us) raft_consensus.cc:1685] finished
0709 13:17:27.447670 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.447801 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625330,"prepare.queue_time_us":24212,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":628962,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":14842,"spinlock_wait_cycles":111038848,"thread_start_us":568147,"threads_started":1,"wal-append.queue_time_us":1228532}
I20260709 13:17:27.476343 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.477145 10319 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.477911 10317 raft_consensus.cc:1240] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:27.475502 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.478725 10322 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:27.485340 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.488960 16044 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.489390 16163 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:27.489930 16163 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.490330 16163 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:27.425925 15983 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.490509 16124 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.491531 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.492297 10399 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.467168 16174 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:17:27.448523 16176 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.489493 16044 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.494993 16044 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.495081 16174 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:27.495524 16174 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:27.496400 16174 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.501113 10393 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18.
I20260709 13:17:27.426762 16077 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:17:27.484812 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.479574 16067 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.525985 15898 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:27.526449 15898 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.526916 15898 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:27.528785 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.530040 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.530938 10324 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:27.532061 10141 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.443166 15679 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.471434 15913 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.537024 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:27.537706 10997 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.479592 16098 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:27.428526 15958 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:27.554612 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.555124 10319 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:27.442102 16076 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.559791 10250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39872 (request call id 2376) took 1618 ms. Trace:
I20260709 13:17:27.569190 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.569069 10250 rpcz_store.cc:276] 0709 13:17:25.941316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.961371 (+ 20055us) service_pool.cc:224] Handling call
0709 13:17:25.961668 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.961894 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:26.398712 (+436818us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.559319 (+1160607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.559397 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.559464 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.559565 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.559722 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605042,"prepare.queue_time_us":557793,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":609033,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":991505,"threads_started":3,"wal-append.queue_time_us":536934}
I20260709 13:17:27.563292 10213 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.565122 10399 raft_consensus.cc:2468] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:27.573334 10965 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:27.583081 10997 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:27.585886 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.588369 10325 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:27.591812 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.593547 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.595633 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.599166 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.600318 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.601524 15961 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:27.592773 10243 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
W20260709 13:17:27.604387 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 130004us
I20260709 13:17:27.604836 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.605104 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.605680 10397 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.552645 16174 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.602115 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.612627 10994 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:17:27.608834 10213 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.590019 15958 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:27.619544 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.623554 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:27.624204 10325 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:27.625007 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.593034 15703 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:27.627540 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.631513 10325 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:27.631982 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.590401 16147 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:27.603031 16051 raft_consensus.cc:2804] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:27.603583 16076 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.633024 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.638927 10397 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:27.555377 16077 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:27.642524 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:27.643148 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.643803 10390 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.636248 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.637106 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:27.645367 10250 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 16: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:27.632943 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.602090 15961 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.647800 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.634064 10399 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:17:27.649422 10397 raft_consensus.cc:2393] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 16: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:27.606540 16067 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.616027 16127 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.630602 15974 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:27.606724 16003 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.534040 10141 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 14, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.634538 15978 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.608685 15983 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:27.637964 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.663338 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:27.651549 15961 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:27.651751 15913 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:27.689706 15913 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:27.645881 15679 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.675987 10393 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:27.660581 16067 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.659754 16147 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:27.691414 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:27.692207 10247 raft_consensus.cc:2368] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:27.676072 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:27.664964 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:27.648669 16051 raft_consensus.cc:697] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:27.666570 10213 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:27.680101 10398 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:17:27.680094 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:27.701663 10398 pending_rounds.cc:85] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 9
I20260709 13:17:27.672358 16078 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.692112 15913 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.682570 15958 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.683290 16094 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:27.693979 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.701993 10993 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:27.703293 16051 consensus_queue.cc:237] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.692622 16067 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.698310 10967 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.712780 10250 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:27.698311 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:27.660212 16003 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.722483 10993 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:27.723883 10364 leader_election.cc:400] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16.
I20260709 13:17:27.728426 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:27.736346 10213 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:27.694466 16176 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:27.721940 10390 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
W20260709 13:17:27.750430 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 90152.6us
I20260709 13:17:27.702060 10398 pending_rounds.cc:107] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:17:27.746449 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.744544 16077 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:27.752832 10398 raft_consensus.cc:2889] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.676554 15978 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.722321 16127 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:27.748939 10967 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.757579 10213 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:27.731215 16003 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.692229 16147 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.730618 15998 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.740891 16067 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.746332 15703 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:27.780146 10967 leader_election.cc:400] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:27.780793 10967 leader_election.cc:403] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.754415 16078 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.758939 16117 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:27.771317 15899 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:27.768421 16077 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:27.772502 15998 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.776687 16067 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:27.773408 16127 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:27.761781 16076 consensus_queue.cc:1059] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:27.762017 15974 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:17:27.789714 16192 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:27.836565 16067 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.791512 16175 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:27.875707 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54317.8us
I20260709 13:17:27.835598 15998 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.787617 16163 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.834425 16117 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:27.793442 16122 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:27.839707 15899 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:27.803260 16044 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.703083 10141 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 16 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:27.894464 16098 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:27.894299 16117 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.880199 15981 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.912194 16215 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:17:27.911409 10141 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 13 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:27.912864 10241 raft_consensus.cc:2468] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 7.
I20260709 13:17:27.879720 15703 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.913606 10141 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 13 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:27.921162 10395 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
W20260709 13:17:27.915881 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 167669us
I20260709 13:17:27.922503 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:27.929096 10364 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:27.939237 16222 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.916625 16127 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.916349 15981 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.955827 15978 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:27.891846 16179 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:27.960875 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.972725 10244 raft_consensus.cc:1240] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:27.961601 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:27.966423 16003 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.967813 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:27.968423 15899 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.937235 15961 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.921406 16077 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.915674 15898 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:27.978597 10248 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:27.982051 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:27.993981 16227 log.cc:927] Time spent T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:17:27.995888 16228 log.cc:927] Time spent T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:28.008373 15948 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:28.009076 15948 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:28.034857 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 44011.8us
I20260709 13:17:28.051934 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:28.053884 10244 raft_consensus.cc:2368] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17.
I20260709 13:17:28.058538 10364 leader_election.cc:400] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17.
I20260709 13:17:28.059062 10364 leader_election.cc:403] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.024561 16163 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:28.089856 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 309905us
I20260709 13:17:28.081648 16232 raft_consensus.cc:3060] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:28.110750 10967 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:28.010193 15948 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.095517 15961 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.123059 10998 raft_consensus.cc:1240] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:17:28.130035 16051 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.131920 16051 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.034696 10141 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 13, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.135396 10141 catalog_manager.cc:5697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 13 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:28.137101 10141 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:28.152151 16094 raft_consensus.cc:3055] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:28.152680 16094 raft_consensus.cc:740] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:28.117075 16194 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.156608 16194 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.157514 15981 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.153544 16094 consensus_queue.cc:260] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.116407 16233 raft_consensus.cc:2804] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:28.128517 15948 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:28.122409 16001 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.186502 15898 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.191025 16003 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.186538 16001 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.202279 16194 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.202986 16001 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.170972 10141 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 14, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:28.173007 10965 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18.
I20260709 13:17:28.248857 10965 leader_election.cc:403] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.175798 16233 raft_consensus.cc:697] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:28.181710 16067 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.182900 15998 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.164350 16209 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:28.219594 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 237035us
I20260709 13:17:28.221859 16117 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.222317 15974 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.263756 15974 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.223497 15963 consensus_queue.cc:1059] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:28.224655 16078 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:28.225864 10244 raft_consensus.cc:1240] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:28.231230 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:28.169723 16094 raft_consensus.cc:3060] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.232518 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.283813 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.285179 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.245096 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:28.254768 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 81879.5us
I20260709 13:17:28.287510 10243 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:28.255999 16001 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18.
I20260709 13:17:28.258312 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.258718 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.259382 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.260385 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.261368 10320 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:28.262036 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.262688 16117 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.240154 16044 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.289045 10319 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:28.292655 10323 raft_consensus.cc:2368] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18.
I20260709 13:17:28.293447 10316 raft_consensus.cc:2393] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:28.296387 10393 raft_consensus.cc:1275] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:28.300544 10321 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.304667 15974 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.309484 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.310174 16137 consensus_queue.cc:1059] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:28.315083 16233 consensus_queue.cc:237] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.311045 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:28.322703 10993 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:28.335731 10324 raft_consensus.cc:2368] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
I20260709 13:17:28.282219 16058 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:28.338828 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:28.336973 16165 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:17:28.328302 16242 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.289342 16078 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.356804 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.356957 10321 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:28.359251 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.360157 10396 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:28.361161 10993 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:28.363096 10965 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.329340 15908 consensus_queue.cc:1059] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:28.381812 10965 leader_election.cc:400] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 17. Current term is 18.
I20260709 13:17:28.273514 16209 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.386071 10993 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:28.381206 16001 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.399667 16225 raft_consensus.cc:493] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:28.407085 16225 raft_consensus.cc:515] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:28.409003 16235 log.cc:927] Time spent T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:28.410553 16179 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:28.351215 16058 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.414350 16058 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:28.420110 16209 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.421885 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.427223 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:28.427935 10998 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.427549 10288 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:28.392938 16163 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.444576 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:28.437367 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:28.447562 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:28.385836 15971 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:17:28.425503 15960 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.427999 16059 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.466125 10391 raft_consensus.cc:1240] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.463227 10288 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:28.365667 16242 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.462102 16232 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17.
I20260709 13:17:28.409979 16225 leader_election.cc:290] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:28.466127 16121 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.459889 16175 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:28.489706 10213 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.495090 10998 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:28.462638 16082 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:28.508065 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.508770 10249 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:28.510996 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.511498 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.352092 10141 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 13, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 13 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:28.484524 15975 raft_consensus.cc:493] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.504127 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.458439 16163 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.475914 15963 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.517210 10399 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.521252 10321 raft_consensus.cc:2368] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17.
I20260709 13:17:28.514397 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:28.522312 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.525183 10322 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:17:28.486793 16242 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.506687 15974 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:28.469121 15960 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.503024 10395 raft_consensus.cc:2468] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:28.496356 16175 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:28.525884 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64940.3us
I20260709 13:17:28.528892 10396 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:28.513307 16083 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.476922 16059 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.544308 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.488224 16192 consensus_queue.cc:1048] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:17:28.544965 10396 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:28.526401 15998 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.545907 10213 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:28.514997 16225 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:28.548221 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:28.548643 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.552368 10322 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:28.539407 16117 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:28.545439 16175 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:28.558185 16249 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:17:28.565073 15960 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.531215 15975 raft_consensus.cc:515] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.571130 10141 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 15, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:28.573093 10141 catalog_manager.cc:5697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 12, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:28.575423 16059 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.577971 16163 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.547116 16083 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.586925 15503 raft_consensus.cc:3055] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:28.587612 15503 raft_consensus.cc:740] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:28.588143 16083 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.590183 15975 leader_election.cc:290] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.555915 15974 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:28.591264 15974 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:28.592162 15974 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:28.594699 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 82756.9us
I20260709 13:17:28.595840 10364 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:28.596437 15503 consensus_queue.cc:260] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.598470 15980 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.602356 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.602696 15980 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.603288 15980 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.603380 16058 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.604051 16058 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.606122 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.606367 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:28.607461 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:28.607637 10394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44068 (request call id 2634) took 1003 ms. Trace:
I20260709 13:17:28.608225 10394 rpcz_store.cc:276] 0709 13:17:27.604456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.604588 (+   132us) service_pool.cc:224] Handling call
0709 13:17:28.607372 (+1002784us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400430654. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3aec2fa 00007f58c8aadb17 00007f58c20286d4 00007f58c2028662 00007f58c2028591 00007f58c202850c 00007f58c20277c2 00007f58c1e2348c 00007f58c1e228c6 00007f58c1e2226f
0709 13:17:28.607556 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892366592}
I20260709 13:17:28.608757 16058 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.609035 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.609647 10399 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:28.611614 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.614773 16232 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:28.615998 10394 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:28.616741 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.617408 10249 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:28.617871 16078 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:28.619374 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.621660 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:28.601470 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a75ec4911bc4e9188e70ee560a67a72" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:28.623805 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.624861 10319 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:28.625751 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.626047 10318 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:28.626418 10316 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:28.626533 10318 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:28.626833 16257 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:17:28.627614 10325 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.629051 10322 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:17:28.629089 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 158545us
I20260709 13:17:28.631305 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.631283 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.634840 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:28.634859 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.636521 10325 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:28.622613 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:28.627408 10318 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.637312 10399 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:28.687143 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.692929 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.655128 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.733705 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:28.640761 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.718343 10995 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:17:28.758373 10392 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:28.729444 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.666829 10288 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
W20260709 13:17:28.759076 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 118425us
I20260709 13:17:28.735522 10997 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:28.668851 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:28.726176 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 77762us
I20260709 13:17:28.669895 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.644563 10364 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:28.760090 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 93391.9us
W20260709 13:17:28.765690 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 121234us
I20260709 13:17:28.806345 10318 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.697697 15980 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.658655 10141 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.809602 15980 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.809562 10141 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 16, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:28.811167 16229 raft_consensus.cc:3055] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.811652 16229 raft_consensus.cc:740] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:28.812520 16229 consensus_queue.cc:260] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.813711 16229 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.638777 16242 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.814985 16242 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.817016 16242 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.700883 16067 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:28.658953 15503 raft_consensus.cc:3060] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:28.818017 15958 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:17:28.819167 15958 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.819536 15958 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:28.820335 15958 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.822526 10398 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:28.824117 16199 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.824551 16199 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.824954 16199 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:28.825333 16244 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:17:28.825605 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:28.557469 16225 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:28.829407 16225 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.830016 10324 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:28.834091 10249 raft_consensus.cc:1275] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:17:28.834532 10249 pending_rounds.cc:85] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 11
I20260709 13:17:28.834757 10249 pending_rounds.cc:107] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:17:28.835005 10249 raft_consensus.cc:2889] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:28.769321 10248 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.759996 10965 leader_election.cc:400] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 13. Current term is 14.
W20260709 13:17:28.838550 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 78689.4us
I20260709 13:17:28.807709 10323 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:28.854908 10250 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.856528 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5315e843bcf14730b0299b712eab40d0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.858316 10246 raft_consensus.cc:1240] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:28.876430 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.878438 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.879539 10241 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:28.886405 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.887660 10241 raft_consensus.cc:2393] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:28.821790 15958 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.899435 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:28.903112 10323 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:17:28.899677 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64811.7us
I20260709 13:17:28.653967 16083 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.907872 10288 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:28.914767 10288 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:28.915820 10318 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:28.916725 10318 pending_rounds.cc:85] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 8
I20260709 13:17:28.917150 10318 pending_rounds.cc:107] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:28.917541 10318 raft_consensus.cc:2889] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:28.917024 10288 leader_election.cc:304] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:28.643242 16147 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.919910 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:28.922219 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:28.695848 16051 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:28.763870 15971 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:28.927603 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:28.936273 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 104359us
W20260709 13:17:28.936337 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 100264us
I20260709 13:17:28.931525 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.931289 10323 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:28.938402 10394 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:28.666323 15606 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:28.719574 16078 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.200s
I20260709 13:17:28.768241 16255 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:28.950304 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:28.950577 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.947746 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:28.954579 10248 raft_consensus.cc:3060] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.706907 16175 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:28.955972 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.909723 16127 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.922768 15927 raft_consensus.cc:2804] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:28.964768 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:28.936805 16176 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:28.928568 16082 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:28.933897 16147 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.973084 10394 raft_consensus.cc:2393] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 19: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:28.901015 16225 consensus_queue.cc:1059] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:17:28.976215 15913 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:28.947352 16121 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:17:28.984825 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 45615.2us
I20260709 13:17:28.985699 16044 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:28.972949 15679 raft_consensus.cc:2749] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.999143 15908 consensus_queue.cc:1059] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:28.972657 16233 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:29.029633 16233 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:29.030114 16233 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.974690 10362 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.966125 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:28.928161 15979 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:17:28.934508 16214 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:17:28.974697 16127 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.048972 16254 consensus_queue.cc:1048] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:29.049522 16127 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:29.035077 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 69569us
I20260709 13:17:29.050908 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:29.052145 16254 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:29.056430 16199 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.058862 16044 consensus_queue.cc:1243] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer ab33f0a79ddf4f5a8ba81b3b0e120529 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:29.059440 16044 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:29.059783 16044 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:29.060746 16044 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.061945 16044 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.042431 15710 raft_consensus.cc:3055] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:29.062935 16067 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:29.063015 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 88412.6us
I20260709 13:17:29.082074 10362 leader_election.cc:400] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17.
I20260709 13:17:29.065495 16176 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:29.001952 16082 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.019220 16255 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:29.002146 16077 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.958058 15606 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.020280 15927 raft_consensus.cc:697] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:29.021106 16147 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:29.073246 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51868.9us
I20260709 13:17:29.059702 16194 raft_consensus.cc:2749] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:29.037307 10248 raft_consensus.cc:2468] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:29.125908 10362 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:29.080878 15710 raft_consensus.cc:740] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:29.145668 10248 raft_consensus.cc:1275] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:29.091650 16082 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.086582 16176 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:29.162474 16225 raft_consensus.cc:3055] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:29.162952 16225 raft_consensus.cc:740] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:29.163821 16225 consensus_queue.cc:260] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.165077 16225 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:29.167243 15964 consensus_queue.cc:1175] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" responder_term: 15 status { last_received { term: 15 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 15 index: 9 } }
I20260709 13:17:29.170209 16209 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:29.171088 16209 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.176980 16175 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:29.178917 15710 consensus_queue.cc:260] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.180795 15710 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.139299 15703 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:17:29.128343 16119 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:17:29.154888 16222 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.189330 16223 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:29.190128 16223 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.190579 15927 consensus_queue.cc:237] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.193166 16223 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.198653 16255 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.199740 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:29.117954 16199 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.204095 15606 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.205227 16176 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.212724 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:29.256059 16209 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:29.277031 16176 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:29.277140 16233 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.344362 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:29.338111 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 387398us
I20260709 13:17:29.352102 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:29.360287 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:29.367832 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0293dc4ca94845b6d1f8991514db3e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.370424 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:29.371296 10324 consensus_meta.cc:287] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:17:29.372417 10319 raft_consensus.cc:2393] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:29.372519 10324 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:17:29.388460 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 267181us
W20260709 13:17:29.395586 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 43777.3us
W20260709 13:17:29.396294 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 270324us
I20260709 13:17:29.401376 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:29.405615 15679 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.406946 15679 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.407825 15971 consensus_queue.cc:1048] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:29.397780 10362 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:29.407996 15679 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.418746 15978 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:29.421402 15978 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:29.423121 15899 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.424386 15899 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.426885 16067 raft_consensus.cc:2804] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:29.427781 16067 raft_consensus.cc:697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:29.428308 15979 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.429682 16067 consensus_queue.cc:237] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.397768 10213 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:29.432793 15978 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.413735 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:17:29.448975 16229 consensus_meta.cc:287] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.617s	user 0.003s	sys 0.008s
I20260709 13:17:29.463562 16233 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:29.464987 16272 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:29.472450 16265 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:29.475245 15679 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:29.477648 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 64093.6us
I20260709 13:17:29.486016 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:29.491528 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:29.497468 16229 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:29.506181 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 43581.3us
I20260709 13:17:29.508610 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:29.510490 15908 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:29.486990 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 89440us
I20260709 13:17:29.534025 10390 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:29.541194 16082 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.543973 15978 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:29.545539 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 61724.9us
I20260709 13:17:29.568539 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:29.569324 10249 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 21.
I20260709 13:17:29.573817 16272 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.574760 16272 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.603760 10995 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:17:29.613420 10394 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:29.596325 15899 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:29.609604 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:29.600050 16272 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.624221 15971 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.631276 15710 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.634569 15971 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.636873 15710 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.638347 10396 raft_consensus.cc:606] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:29.639456 15710 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:29.639976 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 131889us
W20260709 13:17:29.643477 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 48702.3us
I20260709 13:17:29.644436 15971 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.661535 15973 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.662322 15973 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.668823 15973 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.670279 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:29.676401 10213 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:29.676426 10323 raft_consensus.cc:3060] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.683962 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:29.701486 15710 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.701831 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.702160 15710 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.704792 15710 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:29.705219 15958 consensus_meta.cc:287] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.014s
I20260709 13:17:29.708071 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.710289 16266 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:29.712365 16003 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:29.716650 16077 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:29.719202 15998 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:29.719064 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.698928 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:29.685019 16265 raft_consensus.cc:2764] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:29.728551 10321 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:29.726519 10323 raft_consensus.cc:2468] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:29.732308 15998 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:29.735548 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:29.736356 15998 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.657107 15978 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:29.740010 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:29.740983 15710 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:29.741420 15710 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.741813 15710 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:29.741966 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8898babdb91e46acafbe4314671b54fa" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:29.750921 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:29.751663 10241 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:29.753388 16147 consensus_meta.cc:287] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
I20260709 13:17:29.753970 16147 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.755337 10246 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 14: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:29.756350 16147 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:29.763099 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:29.788772 10319 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:29.790021 10398 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:29.803411 10995 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:29.808199 10316 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:29.810822 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.811841 10325 raft_consensus.cc:2393] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:29.830547 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:29.831751 10244 raft_consensus.cc:2410] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:17:29.832470 15980 raft_consensus.cc:993] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:29.832983 15980 raft_consensus.cc:1081] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:29.775934 16082 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:29.839262 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:29.840132 10393 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:29.839313 10241 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:29.890821 16194 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:29.865617 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:29.891621 16194 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.915889 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:29.923056 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 59141.9us
I20260709 13:17:29.927328 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.939110 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:29.939894 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:29.946249 10316 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:29.952343 15964 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:29.952992 16271 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.953321 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:29.953552 16271 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.954183 10399 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:29.956004 16271 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:29.960067 15964 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:29.966593 16233 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:29.961416 15964 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:29.967410 16233 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:29.968838 16233 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:29.966655 10392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:29.972863 10392 raft_consensus.cc:606] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:29.977169 10392 raft_consensus.cc:614] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:30.003518 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:30.010043 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:30.010871 10999 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 21.
I20260709 13:17:30.013190 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.014314 15908 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.015264 16270 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:30.015113 15908 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.015894 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:30.015233 10362 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.017066 10998 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:30.018623 10243 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:30.019625 10965 leader_election.cc:304] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.020695 16051 raft_consensus.cc:2749] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:29.947721 16147 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:17:29.985543 16044 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.779s	user 0.017s	sys 0.005s
I20260709 13:17:30.022365 15927 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:30.023741 10397 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:30.024115 10397 pending_rounds.cc:85] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 8
I20260709 13:17:30.024376 10397 pending_rounds.cc:107] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:29.993237 16067 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:29.991510 10248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39884
I20260709 13:17:30.037351 10248 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:30.037792 10248 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.033058 10397 raft_consensus.cc:2889] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:30.031101 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:30.044272 10995 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 21.
I20260709 13:17:30.043231 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.034619 16147 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:30.054534 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:30.049924 16082 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.057638 16082 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.066622 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:30.063648 10362 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:30.067354 16082 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.078801 16225 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.079627 16225 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.086334 16223 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.048858 16067 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.096659 16067 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:30.104785 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.104866 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.105593 10319 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:30.105823 10323 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 15.
I20260709 13:17:30.071533 15913 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:30.107669 15913 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:30.108088 15913 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.113713 10396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:30.114496 10396 raft_consensus.cc:606] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.115022 16272 raft_consensus.cc:2804] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:30.115585 16272 raft_consensus.cc:697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:30.116726 16272 consensus_queue.cc:237] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:30.114385 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 139136us
I20260709 13:17:30.123536 15899 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:30.124013 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:30.125751 15899 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:30.126252 15899 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.126641 15899 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:30.130682 16229 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:30.130954 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.131410 16229 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.133098 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.134616 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.137415 15899 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.138664 15908 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:30.140559 16194 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:30.148398 16285 log.cc:927] Time spent T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
I20260709 13:17:30.173190 10248 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.181761 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.182871 10244 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:30.082170 16225 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:30.198599 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:30.191336 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:30.207257 10318 raft_consensus.cc:2393] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 14: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:30.207427 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:30.208380 10248 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:30.203544 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:30.214986 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:30.234486 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 171979us
I20260709 13:17:30.238008 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.241865 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:30.242676 10318 raft_consensus.cc:2393] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:30.243830 10318 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:30.249496 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.176430 16266 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:17:30.250674 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.211210 16229 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.184612 15710 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.225205 16077 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:30.225425 16271 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:30.265265 10243 raft_consensus.cc:1275] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:30.255937 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:30.195103 16265 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:17:30.276729 10325 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 22: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:30.271489 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 45599.8us
I20260709 13:17:30.262950 16077 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.263595 16003 raft_consensus.cc:2764] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:30.264989 16271 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.287261 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.289945 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.288352 16077 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:30.294440 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 195543us
I20260709 13:17:30.298128 16044 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:30.291497 10392 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
W20260709 13:17:30.332914 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 45726.4us
I20260709 13:17:30.335726 10397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:30.339440 10397 raft_consensus.cc:606] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.339952 10397 raft_consensus.cc:614] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:30.292631 16271 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.342545 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:30.348914 10321 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:30.349195 10398 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:30.343334 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:30.351410 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:30.353366 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:30.316911 16265 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:30.360746 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.360875 10965 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.302384 16176 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.370060 10399 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:30.374078 10392 raft_consensus.cc:1275] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:30.374557 16199 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.375419 16199 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.375727 16176 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.347662 15899 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 22 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.377943 16199 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:30.400146 10993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:30.401130 16295 log.cc:927] Time spent T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:17:30.405807 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:30.409837 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 118157us
I20260709 13:17:30.397307 16223 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.395080 16296 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:17:30.418573 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:30.411931 16067 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:30.411057 16176 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:30.426513 15710 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 22 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:30.432878 16290 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:30.439191 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:30.440533 16265 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.441277 16265 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.442863 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:30.443552 10392 raft_consensus.cc:3055] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:30.443832 10392 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:30.444705 10392 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.445648 10392 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.419087 16223 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.449642 16223 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:30.450480 10391 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:30.455778 16265 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:30.460285 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:30.461508 10244 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 22: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:30.464697 15913 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.487406 15913 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:30.494277 16289 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:17:30.496016 16077 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.500038 16077 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.523809 10399 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:30.548883 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.553422 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.554104 10319 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:30.557168 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:30.559371 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:30.565551 10995 raft_consensus.cc:2393] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 15: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:30.566833 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:30.567544 10994 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:17:30.568009 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 206731us
I20260709 13:17:30.560875 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.515643 16067 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:30.573046 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:30.564680 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:30.569079 10317 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
I20260709 13:17:30.554404 16082 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.577020 10391 raft_consensus.cc:606] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Received request to transfer leadership to TS cb71def93f904f619a1527aa48a32294
I20260709 13:17:30.595371 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:30.567212 15913 consensus_queue.cc:1048] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:17:30.597150 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:30.575228 16067 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.575275 16229 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.595854 16194 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:30.610008 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:30.614684 16229 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.663142 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.602401 16223 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.654198 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:30.726948 10246 raft_consensus.cc:1240] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:30.728479 10323 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.662910 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.662655 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:30.663590 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:30.748816 10317 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 22: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:30.753729 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:30.662112 15710 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:30.757805  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:17:30.763640 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 168356us
I20260709 13:17:30.660979 16194 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.770430 10245 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 19: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:30.765451 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:30.661417 16082 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:30.807300 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 201335us
I20260709 13:17:30.726300 16271 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.795760 10288 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:30.764616 15710 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.773586 16194 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:30.835628 10288 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:30.737828 16223 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.777963 16225 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:30.738471 16311 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.397s
I20260709 13:17:30.815356 15710 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.843407 16308 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:30.843586 15963 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:30.844089 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:30.844100 10363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.870890 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 51917.1us
W20260709 13:17:30.816298 16309 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:17:30.869068 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 92912.8us
I20260709 13:17:30.841404 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:30.806998 15958 consensus_queue.cc:1048] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:17:30.879688 16308 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:30.886790 16279 log.cc:927] Time spent T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:17:30.887820 16315 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:30.885248 15908 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:30.918694 15908 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.888206 16317 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:30.889036 16304 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 13:17:30.866716 16225 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.923940 16225 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:30.924804 15908 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.926137 15710 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:30.928777 16316 log.cc:927] Time spent T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:17:30.934406 15710 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.932830 16225 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:30.905812 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 64496.6us
I20260709 13:17:30.939263 16225 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.906488 10317 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:30.913275 10395 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:30.916791  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:30.923033 16317 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:30.959221 10994 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 22.
I20260709 13:17:30.905716 16077 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.966553 10245 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:30.967600 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 157010us
I20260709 13:17:30.973517 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:30.969594 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 97979.9us
I20260709 13:17:30.970978 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:30.977686 16307 log.cc:927] Time spent T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:30.977778 16297 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:17:30.981026 16082 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:30.908634 16322 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:30.988336 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:30.989473 10392 consensus_meta.cc:287] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:17:31.021883 10392 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:30.994319 16077 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:30.996858 16308 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:31.000146 10324 raft_consensus.cc:1275] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:31.019697 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 48840.9us
I20260709 13:17:31.029214 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:31.032563 10998 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 22: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:31.025821 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:31.033439 10316 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
W20260709 13:17:31.018863 16266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.025s	sys 0.064s
I20260709 13:17:31.046882 10244 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 15: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:31.049402 10993 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:31.051805 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:31.045408 16266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.025s	sys 0.064s
I20260709 13:17:31.062608 10996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:31.063172 10241 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:31.063104 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:31.050985 16223 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:31.051215 15964 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:31.068393 16067 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.075471 16077 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:31.076679 16229 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:31.057233 16255 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:31.080488 16334 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:31.085927 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:31.087105 16320 log.cc:927] Time spent T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.425s	user 0.002s	sys 0.011s
I20260709 13:17:31.087386 16255 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:31.087996 16255 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.090117 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.096091 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:31.096961 10398 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.098729 16067 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.090137 16255 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:31.100368 16317 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.102699 10391 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:17:31.103166 10391 pending_rounds.cc:85] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Aborting all ops after (but not including) 12
I20260709 13:17:31.103433 10391 pending_rounds.cc:107] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:17:31.103696 10391 raft_consensus.cc:2889] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.104861 16327 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:31.098770 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:31.100371 10323 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 14.
I20260709 13:17:31.115583 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:31.112499 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:31.136153 10319 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:31.145298 16301 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.126777 16317 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:17:31.154290 10398 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:31.164489 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:31.164593 10396 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:17:31.165131 10391 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.166610 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.169955 10393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:31.168460 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:31.175232 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:31.174660 10390 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:31.181196 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:31.195854 10288 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:31.174655 16326 log.cc:927] Time spent T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.260s	user 0.004s	sys 0.000s
I20260709 13:17:31.214046 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:31.233104 16294 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:17:31.233673 15964 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:31.240837 15983 consensus_queue.cc:1059] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:31.198153 16194 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.252092 10399 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:31.255841 10995 raft_consensus.cc:1240] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:31.263622 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.266777 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.267620 10250 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:31.271425 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:31.212299 15958 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:31.199836 16229 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:17:31.231603 15963 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:17:31.285228 10391 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:31.287420 10395 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:31.288108 16137 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:17:31.289022 15998 raft_consensus.cc:3055] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:31.289484 15998 raft_consensus.cc:740] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:31.290213 16194 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:31.290401 15998 consensus_queue.cc:260] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.291602 16223 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:31.292091 16223 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.292526 16223 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.238543 15964 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:31.297307 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 57684.5us
I20260709 13:17:31.302451 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.306967 10362 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:31.309401 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 80060us
I20260709 13:17:31.312117 10399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:31.308951 10288 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:31.314371 10362 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.317198 16176 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:31.319331 15606 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:31.296154 15958 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:31.344213 15963 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:31.333839 10288 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:31.333742 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:31.373385 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 59178.2us
I20260709 13:17:31.311611 16327 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.373359 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.300213 16225 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:17:31.375916 10288 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:31.348840 15606 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:31.375356 16322 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.386883 16199 consensus_queue.cc:1048] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:31.400089 10288 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:31.407508 10213 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:31.422575 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:31.416774 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 146309us
I20260709 13:17:31.424881 10213 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:31.425670 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.394079 16137 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:31.392007 16332 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.400362 15606 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:31.411258 16335 log.cc:927] Time spent T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.390s	user 0.003s	sys 0.000s
I20260709 13:17:31.436221 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:31.443585 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53618.2us
I20260709 13:17:31.431838 16137 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.433251 16308 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:31.459800 10393 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:31.467684 10213 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.440060 16324 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:17:31.437361 16233 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:31.505903 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:17:31.511667 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 85968.6us
I20260709 13:17:31.511695 10999 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
I20260709 13:17:31.513284 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:31.456235 16330 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.457569 16137 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:31.521252 16305 raft_consensus.cc:993] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:17:31.521725 16314 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.522358 16314 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:31.524122 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.461202 16308 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:31.525370 15899 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:31.527804 16313 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:31.527643 15899 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.528349 16313 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.529868 15899 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:31.455747 16297 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:31.530296 16298 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:31.544267 16271 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.530669 16338 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:31.531853 16344 log.cc:927] Time spent T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:17:31.534358 16330 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
W20260709 13:17:31.515741 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 48443.5us
I20260709 13:17:31.558369 10394 raft_consensus.cc:2393] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:31.527288 16308 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.526882 16332 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:31.453569 15958 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.564105 16338 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:31.586990 16355 raft_consensus.cc:1081] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:17:31.624625 16317 consensus_queue.cc:1059] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:31.615852 16305 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.616016 16313 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:31.633813 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 84615us
I20260709 13:17:31.655683 16363 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.656422 16363 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.667299 16363 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:31.627471 16199 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:31.689175 16352 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:31.689839 16352 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.692206 16352 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.692334 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.636893 16330 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.697170 15606 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:31.707885 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 63602.3us
W20260709 13:17:31.723168 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 184543us
I20260709 13:17:31.705945 15973 raft_consensus.cc:3055] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:31.706622 16314 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.767376 15973 raft_consensus.cc:740] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:31.700224 16199 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.773036 15973 consensus_queue.cc:260] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.774993 16199 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.687301 16363 consensus_queue.cc:1059] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:17:31.684029 16305 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.708858 16077 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:31.722858 16298 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:31.761336 16332 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:31.779708 16229 raft_consensus.cc:3055] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:31.828647 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 154799us
I20260709 13:17:31.841135 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.772938 15606 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.848588 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:31.849189 10391 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:31.850958 16351 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:31.851578 16351 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:31.847397 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 169304us
I20260709 13:17:31.855079 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:31.859896 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:31.832871 16229 raft_consensus.cc:740] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:31.825155 16137 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.877683 10323 raft_consensus.cc:1240] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:17:31.881855 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 173058us
I20260709 13:17:31.883570 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:31.885735 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:31.888407 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.885775 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:31.903716 10247 raft_consensus.cc:2393] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 19: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:31.879505 15927 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.862473 16077 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.881024 16364 raft_consensus.cc:493] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:31.784900 16338 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:31.915330 15964 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:17:31.885741 16361 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:31.958194 16223 consensus_meta.cc:287] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.001s
I20260709 13:17:31.920920 15927 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.968837 16223 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.985498 16371 consensus_queue.cc:1059] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:31.987432 16077 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:31.987571 15998 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.955232 15964 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:31.994762 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:31.973105 16355 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:31.948019 16364 raft_consensus.cc:515] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.037356  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:31.961645 16229 consensus_queue.cc:260] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.043031 16223 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:31.940924 16332 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:31.944514 16298 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.024915 16266 raft_consensus.cc:3055] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:17:32.046872 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 165041us
W20260709 13:17:32.044510 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 152701us
I20260709 13:17:32.043927 16305 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:32.060248 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:32.063798 15964 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.065407 16308 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.071024 15710 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:32.071806 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.085019 10246 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:32.072225 16137 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.072985 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.088459 10250 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:32.080098 15964 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:32.080798 16270 raft_consensus.cc:993] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: : Instructing follower cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:17:32.081174 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.052939 16266 raft_consensus.cc:740] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:32.102052 10322 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:32.052282 16351 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:32.119823 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.122725 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.123320 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.124670 16266 consensus_queue.cc:260] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.126013 16266 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.127857 16385 raft_consensus.cc:493] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.128572 16385 raft_consensus.cc:515] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.131398 16364 leader_election.cc:290] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.086920 16367 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:32.136479 16367 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.101342 15964 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.138495 15964 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.138967 16367 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.141130 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:32.120585 10245 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:32.145121 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:32.146149 16351 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:32.102995 15710 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.146656 16351 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.147069 16351 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.146443 16385 leader_election.cc:290] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.148949 16308 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.157905 16351 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.158831 15927 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.161239 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.161849 10244 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.208124 10246 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 20.
I20260709 13:17:32.120795 16327 raft_consensus.cc:1081] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Signalling peer cb71def93f904f619a1527aa48a32294 to start an election
I20260709 13:17:32.231527 15710 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.244252 16351 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:32.217783 16346 raft_consensus.cc:493] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.257014 10395 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:17:32.257146 10391 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:32.285717 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.288828 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:32.293650 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 206175us
I20260709 13:17:32.292603 10397 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:32.296425 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.279987 15983 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.298264 15983 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.300349 15983 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.304535 10321 raft_consensus.cc:1240] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:32.310426 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:32.312566 10395 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:32.313868 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.314733 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.313776 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:32.316538 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.314415 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:32.317544 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.321164 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:32.321990 10397 raft_consensus.cc:3060] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:32.332247 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.336287 16377 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:32.336776 16377 raft_consensus.cc:493] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.337153 16377 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.339421 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:32.340235 10398 raft_consensus.cc:2368] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17.
I20260709 13:17:32.340677 10244 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:32.347038 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.347790 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.350548 10394 raft_consensus.cc:1240] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:32.350783 10390 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:32.352279 10318 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:32.284046 16346 raft_consensus.cc:515] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.346706 15964 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.390936 10322 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:32.396593 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.397044 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.397876 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.398468 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.398991 10318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:17:32.399565 10318 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.404079 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.405090 10321 raft_consensus.cc:2368] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 19. Current term is 20.
I20260709 13:17:32.410138 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:32.409576 16338 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:17:32.414697 16367 consensus_queue.cc:1059] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:32.415663 16367 raft_consensus.cc:3055] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:32.416038 16367 raft_consensus.cc:740] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:32.417001 16367 consensus_queue.cc:260] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.419382 10213 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:32.421296 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.427232 10316 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:32.450263 10397 raft_consensus.cc:2468] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 20.
I20260709 13:17:32.418220 16367 raft_consensus.cc:3060] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.421509 16349 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.458990 16349 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.461374 16349 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.463848 16346 leader_election.cc:290] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.429499 16266 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:32.465677 16266 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.466106 16266 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.446363 16332 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:32.447840 16308 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.478992 16332 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:32.504632 15973 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.495395 15964 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.504714 16332 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.515820 16332 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.519371 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.520221 10321 raft_consensus.cc:2393] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 17: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:32.521014 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.521575 10321 raft_consensus.cc:3060] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.521817 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfd747d82d6d447e9c04851a4163a863" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
W20260709 13:17:32.522912 16403 log.cc:927] Time spent T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:32.523092 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.524122 10213 leader_election.cc:400] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17.
I20260709 13:17:32.524482 10213 leader_election.cc:403] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:17:32.524971 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 46163us
I20260709 13:17:32.526578 16308 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 16. Current term is 17.
I20260709 13:17:32.526984 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02c8de49bce9468ca25de2106e6f0a37" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.528119 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.529209 10321 raft_consensus.cc:2468] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:32.529421 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.530027 10321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
 from {username='slave'} at 127.0.0.1:34170
I20260709 13:17:32.538247 10321 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.539505 10362 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.540262 10321 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.546005 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.546372 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:17:32.548398 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 59841.8us
I20260709 13:17:32.549695 10248 raft_consensus.cc:2468] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:32.550504 10362 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.552352 10362 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.581331 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.586606 10362 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.583606 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.592402 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.573148 16367 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:32.605042 16324 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:32.575265 16380 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.611639 10998 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:17:32.612118 10998 pending_rounds.cc:85] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 13
I20260709 13:17:32.612354 10998 pending_rounds.cc:107] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:17:32.612629 10998 raft_consensus.cc:2889] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.612890 16082 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.614449 15964 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.615255 15964 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.589538 10322 raft_consensus.cc:2376] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17. Re-sending same reply.
I20260709 13:17:32.623834 16397 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:32.624593 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:32.601338 16377 raft_consensus.cc:515] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.573555 16044 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.605957 16324 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.625643 16266 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.576512 15978 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.633673 10362 leader_election.cc:400] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 19. Current term is 20.
I20260709 13:17:32.592353 16270 raft_consensus.cc:2749] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.643330 10362 leader_election.cc:403] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.613725 16082 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.644989 10362 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.635672 16380 raft_consensus.cc:2749] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:32.629407 15964 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.652042 10290 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:32.655983 10247 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 16: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:32.652853 16044 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.647265 16176 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) with higher term. Message: Invalid argument: T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for earlier term 19. Current term is 20.
I20260709 13:17:32.677554 15978 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:32.678287 15978 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.680629 15978 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.668164 16389 raft_consensus.cc:2804] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:17:32.691555 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 116742us
I20260709 13:17:32.696702 15978 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:17:32.708357 16266 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.696323 16380 raft_consensus.cc:493] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:32.715888 10997 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:32.720818 10397 raft_consensus.cc:1275] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:32.722455 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.728540 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:32.729178 10390 raft_consensus.cc:3060] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.736383 16377 leader_election.cc:290] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:32.736934 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.730916 16082 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.715287 16380 raft_consensus.cc:515] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.720510 16411 raft_consensus.cc:493] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.720853 16352 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:32.724462 16412 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:32.743324 16412 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.743764 16324 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.742012 10321 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.756793 10318 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.746107 16412 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.747742 16355 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:32.765532 16355 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:32.772244 16380 leader_election.cc:290] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.764971 16411 raft_consensus.cc:515] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.765026 10321 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Requested vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.775722 16411 leader_election.cc:290] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:32.782819 16378 log.cc:927] Time spent T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.769s	user 0.002s	sys 0.003s
I20260709 13:17:32.759006 16352 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.794297 16352 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:32.796239 10392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44062 (request call id 2416) took 1247 ms. Trace:
I20260709 13:17:32.796723 10392 rpcz_store.cc:276] 0709 13:17:31.548745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.548940 (+   195us) service_pool.cc:224] Handling call
0709 13:17:31.549243 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.700573 (+151330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.700603 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.700647 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:31.700690 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.795664 (+1094974us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540045c254. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:32.795713 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.796151 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347541376}
I20260709 13:17:32.801178 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:32.805356 16229 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.807832 10390 raft_consensus.cc:2468] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:32.813388 10997 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:32.811769 10318 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.815986 10319 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:32.817061 10318 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:32.822073 16357 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:32.822975 16357 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.825886 16357 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:32.843745 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.847277 16077 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.857043 10364 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
W20260709 13:17:32.858538 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.861230 16357 raft_consensus.cc:2804] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:32.863864 16355 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.861881 16357 raft_consensus.cc:697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:32.870910 16357 consensus_queue.cc:237] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.863132 15899 consensus_queue.cc:1059] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:17:32.875608 16389 raft_consensus.cc:697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:32.875859 15899 raft_consensus.cc:3055] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:32.876295 15899 raft_consensus.cc:740] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:32.876811 16389 consensus_queue.cc:237] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.877261 15899 consensus_queue.cc:260] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:32.882323 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:32.883139 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 212558us
I20260709 13:17:32.883869 10290 leader_election.cc:304] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:32.879842 10215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.885092 15710 raft_consensus.cc:2749] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.885850 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:32.887687 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:32.888512 10391 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:32.890741 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed60181ed2d4e3782c0247f5c8a145f" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.891350 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:32.891958 10994 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.892376 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:32.895628 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.896826 10290 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:32.899219 16255 raft_consensus.cc:2804] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:32.899843 16255 raft_consensus.cc:697] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:32.900876 16255 consensus_queue.cc:237] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:32.905092 10317 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:17:32.907892 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.908360 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:32.909076 10321 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.917407 10288 leader_election.cc:304] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:32.917544 10321 raft_consensus.cc:2468] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:32.918090 10994 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:32.961138 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.961501 10317 raft_consensus.cc:1240] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:32.919502 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54badd91404d4f7894752c8769345dca" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.920214 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20e8be888d84cbf954ad2041699a03d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:32.922058 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 58298.7us
I20260709 13:17:32.928313 10362 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.965435 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:32.965791 10213 leader_election.cc:304] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:32.932502 10323 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:17:32.933178 16360 raft_consensus.cc:2749] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:32.935758 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:32.936390 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.936654 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.937348 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.925954 16332 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:17:32.946143 10288 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:32.978432 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.980619 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:32.968791 10318 raft_consensus.cc:2393] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in current term 16: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:32.944029 15899 raft_consensus.cc:3060] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.969941 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.972812 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.971086 10322 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:32.967983 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:32.984303 10250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1667c24c31044f708dc4fcc524ea924d" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:32.988732 10243 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.998129 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:33.000020 10288 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:32.990816 16360 consensus_queue.cc:1048] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:17:32.998389 15960 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.970126 16199 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.003497 10965 leader_election.cc:304] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:33.012174 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235584cc4374dbcbe419cad1b3b9226" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:32.981510 16412 raft_consensus.cc:2749] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.981940 16370 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:33.020222 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.000837 16137 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:33.025928 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.022987 10288 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:33.011673 16324 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.005939 16067 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:33.033090 10995 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:33.035244 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.002076 15998 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
W20260709 13:17:33.043161 16418 log.cc:927] Time spent T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:17:33.027838 16345 raft_consensus.cc:2804] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:33.067545 16345 raft_consensus.cc:697] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:33.044432 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.022027 15963 raft_consensus.cc:2804] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:33.069780 15963 raft_consensus.cc:697] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:33.070940 15963 consensus_queue.cc:237] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.002003 16411 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:17:33.050137 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:33.073436 10390 raft_consensus.cc:3055] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:33.073776 10390 raft_consensus.cc:740] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:33.050624 10250 raft_consensus.cc:2410] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:17:33.051136 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d7bac4863c4b958392d525cba4f98b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.080708 16296 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.081358 16296 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.053115 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:33.082638 10394 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:33.082960 10394 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:33.083910 16296 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.083700 10394 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.084833 10394 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.023756 16199 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.068645 16345 consensus_queue.cc:237] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.081589 10390 consensus_queue.cc:260] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.090989 10288 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.102280 10288 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.103588 10994 pending_rounds.cc:85] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting all ops after (but not including) 14
I20260709 13:17:33.103962 10994 pending_rounds.cc:107] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 13:17:33.104202 10994 raft_consensus.cc:2889] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.034919 16389 raft_consensus.cc:2804] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:33.106619 10391 raft_consensus.cc:1240] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:17:33.107365 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.108273 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.110496 10997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:33.111665 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:33.110275 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 84638.4us
I20260709 13:17:33.113139 10317 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:33.113063 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.122108 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.123188 10364 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:33.105257 16375 raft_consensus.cc:2749] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.104728 16199 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:33.131596 10214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.108335 16355 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:33.108976 16324 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.084545 15998 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.112788 16361 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:33.115898 16389 raft_consensus.cc:697] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:33.143119 10364 leader_election.cc:304] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:33.150790 10365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.113283 16176 consensus_queue.cc:1059] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:17:33.153175 16408 log.cc:927] Time spent T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.442s	user 0.004s	sys 0.000s
W20260709 13:17:33.150425 10364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.172591 10394 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:33.140988 16199 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:33.175681 10288 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:33.146571 16194 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:33.178725 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 56706.8us
I20260709 13:17:33.154939 16355 raft_consensus.cc:2749] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.195499 10965 leader_election.cc:304] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:33.202145 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.186741 16324 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:33.224340 16317 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:33.224876 16317 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.225284 16317 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.214174 16296 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:33.231209 16296 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.209924 16429 raft_consensus.cc:2749] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.233661 16296 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:33.235677 10394 raft_consensus.cc:1240] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:33.204944 16176 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.254362 16176 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.257704 16176 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:33.258114 16387 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.262516 10243 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 12.
I20260709 13:17:33.262427 16387 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.261010 10250 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:33.265094 16387 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:33.265697 16387 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:33.270614 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:33.271708 10243 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:33.243768 16354 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.284934 15998 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.285053 16354 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.243902 16389 consensus_queue.cc:237] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.287621 16354 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:33.239601 16324 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:33.292603 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.294152 10998 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 22.
I20260709 13:17:33.297605 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:33.298780 16313 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:33.299212 16313 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.299562 16313 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:33.305193 16317 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.307744 16317 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.310840 16324 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.312028 16313 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.293565 16298 consensus_queue.cc:1059] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:17:33.317435 10288 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:33.327217 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 125155us
I20260709 13:17:33.343462 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.346379 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:33.346894 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.324132 15927 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:33.351847 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:33.353530 10318 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.361961 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.363813 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.364832 10323 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:17:33.377053 10392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:33.377732 10392 raft_consensus.cc:3060] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.353116 15927 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.393164 16354 raft_consensus.cc:3055] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:33.393715 16354 raft_consensus.cc:740] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:33.394714 16354 consensus_queue.cc:260] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.395992 10392 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:33.396130 16354 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:33.386837 10318 raft_consensus.cc:2468] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:33.374648 16199 raft_consensus.cc:493] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:33.407398 10965 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:33.414018 16313 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:33.405804 15927 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:33.432049 10319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34170 (request call id 3045) took 1034 ms. Trace:
I20260709 13:17:33.432516 10319 rpcz_store.cc:276] 0709 13:17:32.397198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.401144 (+  3946us) service_pool.cc:224] Handling call
0709 13:17:32.401446 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.816416 (+414970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.431822 (+615406us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002dee54. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a51571 00007f58c3ae8e01 00007f58c3ae783e 00007f58c8aac419 00007f58c2023bd4 00007f58c2023b62 00007f58c2023a91 00007f58c2023a0c 00007f58c2022cc2 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:33.431994 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952866048}
I20260709 13:17:33.439594 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:33.444276 10325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.445870 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:33.423118 16317 raft_consensus.cc:2804] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:33.451378 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.452685 10324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.453915 10323 raft_consensus.cc:1240] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:33.453059 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.460260 10317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:33.466625 10323 raft_consensus.cc:1275] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:33.421207 16199 raft_consensus.cc:515] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.480764 16317 raft_consensus.cc:697] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:33.488643 16317 consensus_queue.cc:237] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.492183 16199 leader_election.cc:290] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:33.504264 10213 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.511543 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.523737 10391 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:33.524256 10394 raft_consensus.cc:1275] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:33.527554 10392 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:33.530026 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:33.530658 10249 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:33.534857 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 53495.9us
I20260709 13:17:33.535473 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.536396 10213 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.550714 10390 raft_consensus.cc:3060] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:33.552664 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 92469.5us
I20260709 13:17:33.568820 10390 raft_consensus.cc:2468] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:33.547935 16411 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.576011 10249 raft_consensus.cc:2468] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:33.546440 16332 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.540607 16367 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.567754 15963 consensus_queue.cc:1048] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:17:33.594754 16298 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:33.588485 10364 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:33.567502 16255 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:33.596757 16370 raft_consensus.cc:2804] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:33.597309 16370 raft_consensus.cc:697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:33.598212 16370 consensus_queue.cc:237] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.599459 15927 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.601063 16366 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:33.601649 15927 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 23 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:33.601990 10316 raft_consensus.cc:1240] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Rejecting Update request from peer ab33f0a79ddf4f5a8ba81b3b0e120529 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:17:33.586750 16411 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:33.602753 16411 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.601665 16366 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.612298 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:17:33.618593 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 66098.4us
I20260709 13:17:33.633312 16354 raft_consensus.cc:493] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:33.615563 16366 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:33.633984 16354 raft_consensus.cc:515] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.636870 16354 leader_election.cc:290] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:33.640869 16434 log.cc:927] Time spent T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:17:33.644495 10247 raft_consensus.cc:1275] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:17:33.651677 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.651691 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.651244 10322 raft_consensus.cc:2468] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 20.
I20260709 13:17:33.674450 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.674975 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.675748 16345 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:33.676218 16345 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:33.676614 16345 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.678108 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:33.679877 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.672358 16411 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.684711 16411 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.685936 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.687951 16388 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.691095 16432 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.684681 16345 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.698508 16345 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.700692 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:33.715837 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.716928 10998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:33.720791 10994 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:33.724891 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae4445ee896464a9b9905cf5ca48e67" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.725860 16388 consensus_queue.cc:1048] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:33.727326 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
W20260709 13:17:33.729272 10141 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 318) took 17239 ms (client timeout 15000 ms). Trace:
I20260709 13:17:33.737528 16389 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:33.743223 10247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:33.744050 10247 raft_consensus.cc:2468] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:33.764645 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:33.781167 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:33.806768 10362 leader_election.cc:304] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.784621 16367 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.812245 16176 raft_consensus.cc:2749] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.816968 10318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ebd7b007a9b4c7eaa47f51eaea905b9" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:33.822117 10248 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:17:33.822556 10248 pending_rounds.cc:85] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting all ops after (but not including) 11
I20260709 13:17:33.822785 10248 pending_rounds.cc:107] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:17:33.823081 10248 raft_consensus.cc:2889] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.806003 16229 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:33.817034 16367 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.843974 16229 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.845418 16367 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.826890 10142 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 8, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 8 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.846911 10142 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 8 to 10, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 10 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.846095 16229 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.807771 16390 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:33.729746 10141 rpcz_store.cc:269] 0709 13:17:16.499599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.528482 (+ 28883us) service_pool.cc:224] Handling call
0709 13:17:33.729082 (+17200600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:29.604277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:29.605178 (+   901us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:29.605243 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:17:29.605293 (+    50us) tablet.cc:662] Decoding operations
0709 13:17:29.939646 (+334353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:29.975487 (+ 35841us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:29.980228 (+  4741us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:17:30.085206 (+104978us) tablet.cc:701] Row locks acquired
0709 13:17:30.085274 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:17:30.085515 (+   241us) write_op.cc:270] Start()
0709 13:17:30.085714 (+   199us) write_op.cc:276] Timestamp: P: 1783603050085418 usec, L: 0
0709 13:17:30.085763 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:17:30.288401 (+202638us) log.cc:844] Serialized 11448 byte log entry
0709 13:17:31.093409 (+805008us) op_driver.cc:464] REPLICATION: finished
0709 13:17:31.241781 (+148372us) write_op.cc:301] APPLY: starting
0709 13:17:31.241890 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:31.853229 (+611339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:31.853339 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:32.531403 (+678064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:32.531892 (+   489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=0,mrs_lookups=0
0709 13:17:32.531954 (+    62us) write_op.cc:312] APPLY: finished
0709 13:17:32.532581 (+   627us) log.cc:844] Serialized 252 byte log entry
0709 13:17:32.747230 (+214649us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:32.765298 (+ 18068us) write_op.cc:454] Released schema lock
0709 13:17:32.767971 (+  2673us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:32.768472 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:32.768516 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3022746,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":148034,"apply.run_cpu_time_us":59168,"apply.run_wall_time_us":1526659,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125405,"num_ops":29,"prepare.queue_time_us":250556,"prepare.run_cpu_time_us":70795,"prepare.run_wall_time_us":1049765,"raft.queue_time_us":163015,"raft.run_cpu_time_us":58543,"raft.run_wall_time_us":117595,"replication_time_us":1007464,"thread_start_us":625300,"threads_started":5,"wal-append.queue_time_us":637781,"wal-append.run_cpu_time_us":20348,"wal-append.run_wall_time_us":2316038}]]}
I20260709 13:17:33.850515 16390 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.834631 15899 consensus_queue.cc:1059] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:17:33.851938 16442 raft_consensus.cc:3055] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:17:33.852339 16442 raft_consensus.cc:740] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:33.852913 16390 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:33.853266 16442 consensus_queue.cc:260] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.858711 16442 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:17:33.861665 10142 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 8 to 9, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 9 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.864213 10142 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.813328 10288 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.873322 16390 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:33.873553 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 60311.8us
I20260709 13:17:33.892795 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
W20260709 13:17:33.894382 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 85480.3us
I20260709 13:17:33.895494 10213 leader_election.cc:304] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:33.897761 16371 raft_consensus.cc:2749] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:33.903321 16390 consensus_queue.cc:1048] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:33.903323 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.920298 10995 raft_consensus.cc:1240] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:33.922338 16370 consensus_queue.cc:1059] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:33.923626 16370 raft_consensus.cc:3055] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:33.924047 16370 raft_consensus.cc:740] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:33.926020 16387 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:33.926589 16370 consensus_queue.cc:260] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:33.930406 16370 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:33.933496 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 58934.1us
I20260709 13:17:33.939496 10248 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Rejecting Update request from peer 73825599c2644b898cebaafbccd86e99 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:33.941068 16355 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:33.952361 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.956180 10390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.957016 10390 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:33.957391 16317 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:33.953974 10391 raft_consensus.cc:1275] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:33.960107 10390 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:33.955462 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:33.951563 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:33.966420 16345 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:33.976481 16355 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.977712 16387 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:33.978137 16387 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:33.979074 16387 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:33.980501 16387 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.988056 10362 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:33.991513 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:33.993115 10243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:33.993884 10243 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:33.994601 10249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:33.995179 10249 raft_consensus.cc:2368] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18.
I20260709 13:17:33.996933 16371 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.998018 16176 raft_consensus.cc:2804] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:34.001148 10245 raft_consensus.cc:1275] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:34.009652 10318 raft_consensus.cc:1275] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:33.985108 16389 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:17:34.017665 16176 raft_consensus.cc:697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 20 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:34.018736 16176 consensus_queue.cc:237] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:34.032253 15958 consensus_queue.cc:1048] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:34.033362 16389 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:34.069743 10397 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:34.071039 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2181b7acaa904976917e2c58bc8856c3" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:34.075903 10213 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:34.078523 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99
I20260709 13:17:34.049024 16345 consensus_queue.cc:1048] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:17:34.106374 16322 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:34.106895 16322 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:34.107299 16322 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:34.115144 10290 leader_election.cc:400] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18.
I20260709 13:17:34.115563 10290 leader_election.cc:403] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:34.117848 16364 raft_consensus.cc:3060] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:34.081622 16451 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:34.192960 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 76220.3us
W20260709 13:17:34.194625 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 105101us
I20260709 13:17:34.245925  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.205648 16390 consensus_queue.cc:1048] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:17:34.249775 16451 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.287467 16451 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:34.303922 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:34.290153 16451 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:34.324193 10391 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
W20260709 13:17:34.328225 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 103911us
I20260709 13:17:34.340373 10246 raft_consensus.cc:1275] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:17:34.348484 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4f8110c14b45cdadf9a53a149c8fdf" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:34.323457 16296 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:17:34.362519 10245 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:34.369894 16468 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:17:34.377425 16463 log.cc:927] Time spent T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:17:34.381229 16322 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:34.396294 10213 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:34.373915 16067 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:17:34.391224 10245 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:34.411695 10322 raft_consensus.cc:1275] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:34.427603 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:34.415665 16364 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671) with higher term. Message: Invalid argument: T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18.
W20260709 13:17:34.438938 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 48955.2us
I20260709 13:17:34.452905 15963 consensus_queue.cc:1048] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:17:34.438966 16082 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:34.462749 16322 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:34.498065 10245 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:34.500391 10290 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:34.536144 16067 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.538514 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 88328.5us
I20260709 13:17:34.541877 16067 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:34.538656 16390 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:34.565284 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:34.566057 10396 raft_consensus.cc:2393] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:34.567510 16390 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:34.568579 16390 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:34.595453 16412 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:34.666272 16480 consensus_queue.cc:1048] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:17:34.669133 16067 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:34.669246 10319 raft_consensus.cc:1275] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:17:34.661531 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 68618.3us
I20260709 13:17:34.695994 16484 raft_consensus.cc:493] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
W20260709 13:17:34.709587 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 46401.2us
I20260709 13:17:34.717320 16484 raft_consensus.cc:515] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:34.779182 16481 log.cc:927] Time spent T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:34.780898 16484 leader_election.cc:290] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:34.783027 16482 log.cc:927] Time spent T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:34.788592 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:34.791919 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 79626.6us
I20260709 13:17:34.799284 10394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:34.800014 10394 raft_consensus.cc:606] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:34.800333 10394 raft_consensus.cc:614] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:34.745739 16486 consensus_queue.cc:1048] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:17:34.816987 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bab3992733148c582649aac71356232" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:34.817797 10322 raft_consensus.cc:2393] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 20: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:34.822609 10397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:34.823357 10397 raft_consensus.cc:606] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:34.828547 10965 leader_election.cc:304] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:34.836408 10322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:34.837085 10322 raft_consensus.cc:606] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Received request to transfer leadership to TS 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:34.832597 16484 raft_consensus.cc:3060] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:34.874083 10391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdf450e3110e486088b3d5c7e2c7cef7"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:34.874853 10391 raft_consensus.cc:606] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:34.875355 10391 raft_consensus.cc:614] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:34.890877 16067 raft_consensus.cc:993] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:17:34.891709 16067 raft_consensus.cc:1081] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:17:34.927225 10398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:34.927981 10398 raft_consensus.cc:606] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:34.928339 10398 raft_consensus.cc:614] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:34.935623 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 68261.7us
I20260709 13:17:34.985014 16484 raft_consensus.cc:2749] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:34.987142 10993 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:17:35.001488 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:35.002175 10248 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:35.007927 10364 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:35.030052 10316 raft_consensus.cc:1275] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:17:35.005560 16432 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:35.031278 16432 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.033442 16432 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:35.023828 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:35.042160 16355 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:35.042812 16355 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.043215 16355 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.064847 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:35.066020 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:35.074198 10319 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 23: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:35.065901 10245 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 23.
I20260709 13:17:35.087438 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:35.109004 16477 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:17:35.119311 16477 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:35.119745 16477 raft_consensus.cc:3060] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:17:35.148258 16493 log.cc:927] Time spent T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.276s	user 0.000s	sys 0.002s
I20260709 13:17:35.178351 10245 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:35.183275 16355 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:35.186872 10993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37924
I20260709 13:17:35.203564 10993 raft_consensus.cc:493] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.203994 10993 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.185576 16477 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.205765 16067 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:17:35.234926 16492 consensus_queue.cc:1048] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:35.212399 10398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:40532
I20260709 13:17:35.238129 10398 raft_consensus.cc:606] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:35.238548 10398 raft_consensus.cc:614] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:35.216794 16467 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:35.218758 10395 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:35.230710 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:35.241448 10248 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.241761 16355 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:35.248988  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:35.256095 16354 consensus_queue.cc:1059] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:35.257045 15958 raft_consensus.cc:3055] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:35.257606 15958 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:35.259586 15958 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:35.261304 15958 raft_consensus.cc:3060] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.262492 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:35.266608  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:35.245704 10993 raft_consensus.cc:515] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.271252 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:35.271823 10319 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.272040 16477 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 23 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:35.272243 10993 leader_election.cc:290] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:35.275542 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:35.276571 10322 raft_consensus.cc:2393] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 23: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:35.277318 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976ea23dd44047a6adc91ad78f34fa79" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:35.278548 10395 raft_consensus.cc:3055] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:35.278932 10395 raft_consensus.cc:740] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:35.279234 10248 raft_consensus.cc:2468] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:35.280160 10241 raft_consensus.cc:1240] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:17:35.279978 10395 consensus_queue.cc:260] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.280925 10395 raft_consensus.cc:3060] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.284287 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:35.285614 10364 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:35.286566 16067 raft_consensus.cc:2804] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:35.287091 16067 raft_consensus.cc:697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:35.287981 16067 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:35.299104 10319 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:35.300726 10965 leader_election.cc:304] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:35.301729 16194 raft_consensus.cc:2804] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:35.302335 16194 raft_consensus.cc:697] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:35.303339 16194 consensus_queue.cc:237] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.299304 10241 raft_consensus.cc:2468] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 23.
I20260709 13:17:35.318478 10967 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:17:35.319787 16194 raft_consensus.cc:2804] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:17:35.320573 16194 raft_consensus.cc:697] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 23 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:35.321589 16194 consensus_queue.cc:237] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.348827 10316 raft_consensus.cc:2410] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:35.349879 10395 raft_consensus.cc:2468] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:35.362097 16467 raft_consensus.cc:993] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: : Instructing follower 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:17:35.362690 16467 raft_consensus.cc:1081] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Signalling peer 72a1fe75b2bc4fb698d13f9d0b2dda04 to start an election
I20260709 13:17:35.370769 11001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00"
dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
 from {username='slave'} at 127.0.0.1:37922
I20260709 13:17:35.371562 11001 raft_consensus.cc:493] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:35.372020 11001 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.429373 10139 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.451014 10139 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 19, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 19 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.439661 11001 raft_consensus.cc:515] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.453325 10139 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.456501 11001 leader_election.cc:290] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:35.456264 10139 catalog_manager.cc:5697] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:35.461082 10142 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 285) took 35830 ms (client timeout 15000 ms). Trace:
I20260709 13:17:35.473925 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:35.474164 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb19b1ef417a439c833c0b7627cf7c00" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:35.475296 10398 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.475736 10323 raft_consensus.cc:3055] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:35.476121 10323 raft_consensus.cc:740] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:35.461760 10142 rpcz_store.cc:269] 0709 13:16:59.630300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.745383 (+115083us) service_pool.cc:224] Handling call
0709 13:17:00.826967 (+1081584us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5400260110. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c0883db1 00007f58c09c3b71 00007f58c09c40b2 00007f58c993da89 00007f58c98d5da6 00007f58c98a7088 00007f58c99a537e 00007f58c7e662a4 00007f58c7e66232 00007f58c7e66161 00007f58c7e660dc
0709 13:17:35.460934 (+34633967us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:33.897022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:33.897565 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:33.897600 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:17:33.897617 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:33.898204 (+   587us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:33.898302 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:33.898328 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:33.905376 (+  7048us) tablet.cc:701] Row locks acquired
0709 13:17:33.905395 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:17:33.905545 (+   150us) write_op.cc:270] Start()
0709 13:17:33.905659 (+   114us) write_op.cc:276] Timestamp: P: 1783603053905488 usec, L: 0
0709 13:17:33.905696 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:17:33.906566 (+   870us) log.cc:844] Serialized 1682 byte log entry
0709 13:17:33.979680 (+ 73114us) op_driver.cc:464] REPLICATION: finished
0709 13:17:34.067479 (+ 87799us) write_op.cc:301] APPLY: starting
0709 13:17:34.067575 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:34.295888 (+228313us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:34.296014 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:34.324901 (+ 28887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:34.325131 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:17:34.325181 (+    50us) write_op.cc:312] APPLY: finished
0709 13:17:34.343079 (+ 17898us) log.cc:844] Serialized 49 byte log entry
0709 13:17:34.343254 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:34.343352 (+    98us) write_op.cc:454] Released schema lock
0709 13:17:34.343399 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:34.343829 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:34.343859 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5071,"reported_tablets":49,"spinlock_wait_cycles":49921408,"child_traces":[["op",{"apply.queue_time_us":87532,"apply.run_cpu_time_us":9038,"apply.run_wall_time_us":276315,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20855,"num_ops":4,"prepare.queue_time_us":8652,"prepare.run_cpu_time_us":3868,"prepare.run_wall_time_us":15169,"raft.queue_time_us":39553,"raft.run_cpu_time_us":12829,"raft.run_wall_time_us":84748,"replication_time_us":73818,"thread_start_us":127875,"threads_started":4,"wal-append.queue_time_us":30458,"wal-append.run_cpu_time_us":6760,"wal-append.run_wall_time_us":1407102}]]}
I20260709 13:17:35.481161 10323 consensus_queue.cc:260] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.488726 10323 raft_consensus.cc:3060] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.499162 10323 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:35.501590 10398 raft_consensus.cc:2468] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:17:35.500267 10965 leader_election.cc:304] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:35.458773 10139 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 15 to 16, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 16 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.505406 16429 raft_consensus.cc:2804] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:35.508807 16429 raft_consensus.cc:697] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:35.510077 16429 consensus_queue.cc:237] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.520375 10139 catalog_manager.cc:5697] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 16, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.544451 10139 catalog_manager.cc:5697] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 14, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 14 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.551036 10139 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 15 to 18, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 18 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.558341 16492 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.558940 16492 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.561748 16390 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:35.562158 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:35.562371 16390 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.562916 10994 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:35.564327 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:35.564653 16390 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:35.561157 16492 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:35.565109 16067 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:35.565514 16067 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.565820 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:35.566488 10323 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 16.
I20260709 13:17:35.566864 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:35.567780 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:35.565869 16067 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.568328 16229 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:35.568910 16229 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:35.553160 10139 catalog_manager.cc:5697] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.568529 10994 raft_consensus.cc:2393] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 17: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:35.573251 16229 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:35.573863 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:35.574658 10241 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 16: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:35.575989 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:35.576665 10395 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:35.578209 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:35.586043 16229 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:35.595667 16229 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:35.596102 16229 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.605480 16229 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:35.618974 16067 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.620007 10139 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.653007 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:35.653509 10398 raft_consensus.cc:2368] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18.
I20260709 13:17:35.653692 10316 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.654585 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f26aceb684204af4b9a75341f4d72c53" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:35.655207 10994 raft_consensus.cc:3060] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.662372 10288 leader_election.cc:400] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18.
I20260709 13:17:35.662768 10288 leader_election.cc:403] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.653035 16067 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:35.660989 10139 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 18, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 18 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.667369 10316 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:35.666060 10139 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.668951 16390 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329) with higher term. Message: Invalid argument: T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for earlier term 17. Current term is 18.
I20260709 13:17:35.672204 10994 raft_consensus.cc:2468] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:35.673445 10362 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:17:35.693208 16229 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:35.696254 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:35.675894 16199 raft_consensus.cc:2804] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:35.709654 16199 raft_consensus.cc:697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:35.713001 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:35.713902 10248 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 16: Already voted for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in this term.
I20260709 13:17:35.669718 10139 catalog_manager.cc:5697] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.716095 10391 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:35.717419 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:35.713932 16199 consensus_queue.cc:237] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.721983 10323 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:35.722357 10323 pending_rounds.cc:85] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 9
I20260709 13:17:35.722564 10323 pending_rounds.cc:107] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:17:35.722769 10323 raft_consensus.cc:2889] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.719452 16467 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:35.727022 16067 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:35.729620 16467 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:35.733354 16467 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:35.737495 16229 raft_consensus.cc:493] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.738095 16229 raft_consensus.cc:515] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:35.740363 16229 leader_election.cc:290] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:35.740742 10241 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:35.730593 10139 catalog_manager.cc:5697] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.742601 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:35.744065 16492 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:35.746212 10241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab10f00e071642849d7b7c7d29ee29ee" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" is_pre_election: true
I20260709 13:17:35.747169 10241 raft_consensus.cc:2410] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:17:35.748827 10290 leader_election.cc:304] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:35.751215 16375 raft_consensus.cc:2749] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:17:35.749542 10139 catalog_manager.cc:5697] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 17, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 17 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.757863 10139 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 19, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 19 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.771451 10139 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.773626 10139 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 14, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 14 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.786943 10139 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 20, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 20 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.826705 10398 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:35.828074 10323 raft_consensus.cc:1275] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:35.834483 10139 catalog_manager.cc:5697] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 7 to 10, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 10 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.834825 16233 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:35.840042 16477 consensus_queue.cc:1048] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:35.871074 10139 catalog_manager.cc:5697] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 12, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 12 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.882328 10139 catalog_manager.cc:5697] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 15, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:35.887013 10316 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:17:35.890151 16233 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:17:35.884792 10139 catalog_manager.cc:5697] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 14, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 14 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.912256 10139 catalog_manager.cc:5697] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.922065 10139 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 10 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:35.927011 10139 catalog_manager.cc:5697] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.928836 10139 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 14 to 18, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:35.933074 10398 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:17:35.936072 10319 raft_consensus.cc:1275] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:17:35.937356 16429 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:35.947678 16194 consensus_queue.cc:1048] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:17:35.950125 10248 raft_consensus.cc:1275] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 23 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:17:35.958065 16233 consensus_queue.cc:1048] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:17:35.933914 10139 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 17, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 17 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.125416 10139 catalog_manager.cc:5697] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 15, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 15 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.147109 16371 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.153215 16371 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:36.157032 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:36.157752 10391 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 16.
I20260709 13:17:36.158716 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:36.159046 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:36.160194 16443 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.160629 16443 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.161034 16443 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.143028 10139 catalog_manager.cc:5697] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 17, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 17 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.167611 10139 catalog_manager.cc:5697] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.169317 16371 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:36.191859 16443 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:36.215440 10248 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:36.218307 10139 catalog_manager.cc:5697] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 14, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.226459 16443 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:36.223455 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:36.233709 10395 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.227535 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:36.219961 16229 consensus_queue.cc:1059] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:36.244765 10395 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:36.246778 10213 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:36.249008 10994 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:36.250918 16479 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:36.251580 16479 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:36.250737 16199 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:36.252565 16479 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:36.267699  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.261220 10139 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
W20260709 13:17:36.304881 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 46270.6us
I20260709 13:17:36.336772 16467 raft_consensus.cc:3055] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:36.337329 16467 raft_consensus.cc:740] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:36.335173 10139 catalog_manager.cc:5697] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:36.344707 16467 consensus_queue.cc:260] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:36.354557 16467 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.355561 10397 raft_consensus.cc:1240] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:36.375597 10316 raft_consensus.cc:1275] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:36.383458 16486 consensus_queue.cc:1048] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:36.414616 16529 log.cc:927] Time spent T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:17:36.715122 10139 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38876 (request call id 319) took 3130 ms. Trace:
I20260709 13:17:36.718331 10143 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 10 to 14, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.720943 10143 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 13 to 18, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 18 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.730213 10143 catalog_manager.cc:5697] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 7 to 14, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.735332 10143 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.738749 10143 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.715528 10139 rpcz_store.cc:276] 0709 13:17:33.584237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.584496 (+   259us) service_pool.cc:224] Handling call
0709 13:17:36.715026 (+3130530us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:36.481761 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:36.482389 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:36.482424 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:17:36.482443 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:36.490070 (+  7627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:36.490131 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:36.490163 (+    32us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:17:36.492704 (+  2541us) tablet.cc:701] Row locks acquired
0709 13:17:36.492730 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:17:36.492910 (+   180us) write_op.cc:270] Start()
0709 13:17:36.493064 (+   154us) write_op.cc:276] Timestamp: P: 1783603056492858 usec, L: 0
0709 13:17:36.493090 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:17:36.493791 (+   701us) log.cc:844] Serialized 13440 byte log entry
0709 13:17:36.532731 (+ 38940us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.543434 (+ 10703us) write_op.cc:301] APPLY: starting
0709 13:17:36.548699 (+  5265us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.580070 (+ 31371us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.580193 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:36.630107 (+ 49914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:36.630509 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=0,mrs_lookups=0
0709 13:17:36.630556 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:36.631113 (+   557us) log.cc:844] Serialized 292 byte log entry
0709 13:17:36.631918 (+   805us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.632181 (+   263us) write_op.cc:454] Released schema lock
0709 13:17:36.632251 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:36.666324 (+ 34073us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.666355 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":90145,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":10412,"apply.run_cpu_time_us":40924,"apply.run_wall_time_us":122840,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146315,"num_ops":34,"prepare.queue_time_us":28948,"prepare.run_cpu_time_us":8276,"prepare.run_wall_time_us":41019,"raft.queue_time_us":14517,"raft.run_cpu_time_us":4013,"raft.run_wall_time_us":11474,"replication_time_us":39447,"spinlock_wait_cycles":56576,"thread_start_us":62727,"threads_started":4,"wal-append.queue_time_us":21044}]]}
I20260709 13:17:36.762276 10143 catalog_manager.cc:5697] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 4 to 11, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 11 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.771487 10143 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 16 to 17, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 17 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.778995 10143 catalog_manager.cc:5697] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 10 to 12, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.780978 10143 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.782560 10143 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:36.786103 10397 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:36.784224 10143 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 9 to 14, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 14 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.793263 16479 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:36.835013 10319 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:17:36.835429 10319 pending_rounds.cc:85] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Aborting all ops after (but not including) 8
I20260709 13:17:36.835669 10319 pending_rounds.cc:107] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:17:36.835909 10319 raft_consensus.cc:2889] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:36.840197 16442 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:36.913654 10139 catalog_manager.cc:5697] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 15 to 17, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 17 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:36.924242 10139 catalog_manager.cc:5697] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 17, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 17 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:36.925822 10139 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 11 to 12, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.935326 10143 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38872 (request call id 286) took 9626 ms. Trace:
I20260709 13:17:36.935814 10143 rpcz_store.cc:276] 0709 13:17:27.308902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.332763 (+ 23861us) service_pool.cc:224] Handling call
0709 13:17:28.187533 (+854770us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b540008ded4. stack: 00007f58c09c9343 00007f58c09c9240 00007f58c03581d4 00007f58ca096304 00007f58ca096299 00007f58c3a52090 00007f58c3af0f3a 00007f58c98a71cc 00007f58c99a537e 00007f58c7e662a4 00007f58c7e66232 00007f58c7e66161 00007f58c7e660dc 00007f58c7e65392 00007f58c1e2348c 00007f58c1e228c6
0709 13:17:36.935234 (+8747701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:36.792261 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:36.792784 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:36.792821 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:17:36.792835 (+    14us) tablet.cc:662] Decoding operations
0709 13:17:36.793974 (+  1139us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:36.794074 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:36.794107 (+    33us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:17:36.795192 (+  1085us) tablet.cc:701] Row locks acquired
0709 13:17:36.795212 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:17:36.795381 (+   169us) write_op.cc:270] Start()
0709 13:17:36.795512 (+   131us) write_op.cc:276] Timestamp: P: 1783603056795330 usec, L: 0
0709 13:17:36.795532 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:36.798373 (+  2841us) log.cc:844] Serialized 4377 byte log entry
0709 13:17:36.814621 (+ 16248us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.815131 (+   510us) write_op.cc:301] APPLY: starting
0709 13:17:36.815230 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.833959 (+ 18729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.834062 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:36.858891 (+ 24829us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:36.859112 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:17:36.859159 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:36.859519 (+   360us) log.cc:844] Serialized 105 byte log entry
0709 13:17:36.863996 (+  4477us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.864193 (+   197us) write_op.cc:454] Released schema lock
0709 13:17:36.864266 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:36.864751 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.864793 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":257060,"reported_tablets":49,"spinlock_wait_cycles":75662208,"child_traces":[["op",{"apply.queue_time_us":275,"apply.run_cpu_time_us":15443,"apply.run_wall_time_us":49535,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46002,"num_ops":11,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":4366,"prepare.run_wall_time_us":11587,"replication_time_us":18922}]]}
I20260709 13:17:36.956103 10139 catalog_manager.cc:5697] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.957706 10139 catalog_manager.cc:5697] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 18 to 19, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 19 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:36.959527 10145 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 209) took 61216 ms (client timeout 15000 ms). Trace:
I20260709 13:17:36.959214 10139 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 17, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 17 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:36.959941 10145 rpcz_store.cc:269] 0709 13:16:35.742615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.742786 (+   171us) service_pool.cc:224] Handling call
0709 13:17:36.959344 (+61216558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24874,"reported_tablets":25,"spinlock_wait_cycles":1134336}
I20260709 13:17:36.960649 10139 catalog_manager.cc:5697] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 18, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.963151 10139 catalog_manager.cc:5697] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 17, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 17 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:36.968669 10139 catalog_manager.cc:5697] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 17 to 20, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 20 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.970329 10139 catalog_manager.cc:5697] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 9 to 16, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.973479 10139 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.975085 10139 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 17, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 17 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:36.976563 10139 catalog_manager.cc:5697] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:36.993429 10139 catalog_manager.cc:5697] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:37.065004 10144 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:37.086422 10139 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 15 to 17, leader changed from 73825599c2644b898cebaafbccd86e99 (127.8.238.195) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 17 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } }
I20260709 13:17:37.091959 10144 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:37.215484 10144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 211) took 21082 ms (client timeout 15000 ms). Trace:
W20260709 13:17:37.218621 10144 rpcz_store.cc:269] 0709 13:17:16.132987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.133225 (+   238us) service_pool.cc:224] Handling call
0709 13:17:37.123753 (+20990528us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.123784 (+    31us) write_op.cc:454] Released schema lock
0709 13:17:37.215408 (+ 91624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:37.098195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:37.098852 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:37.098893 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:17:37.098909 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:37.099290 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:37.099333 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:37.099365 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:37.105914 (+  6549us) tablet.cc:701] Row locks acquired
0709 13:17:37.105940 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:17:37.106105 (+   165us) write_op.cc:270] Start()
0709 13:17:37.106254 (+   149us) write_op.cc:276] Timestamp: P: 1783603057106061 usec, L: 0
0709 13:17:37.106278 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:37.107174 (+   896us) log.cc:844] Serialized 915 byte log entry
0709 13:17:37.109200 (+  2026us) op_driver.cc:464] REPLICATION: finished
0709 13:17:37.109635 (+   435us) write_op.cc:301] APPLY: starting
0709 13:17:37.109714 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:37.110923 (+  1209us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:37.111035 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:37.112244 (+  1209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:37.112409 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:17:37.112453 (+    44us) write_op.cc:312] APPLY: finished
0709 13:17:37.112657 (+   204us) log.cc:844] Serialized 33 byte log entry
0709 13:17:37.112825 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.112926 (+   101us) write_op.cc:454] Released schema lock
0709 13:17:37.112964 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":124545,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":228,"apply.run_cpu_time_us":3596,"apply.run_wall_time_us":3595,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":2827,"prepare.run_wall_time_us":18696,"replication_time_us":2804}]]}
W20260709 13:17:37.358901 10146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 313) took 22031 ms (client timeout 15000 ms). Trace:
W20260709 13:17:37.386466 10146 rpcz_store.cc:269] 0709 13:17:15.327282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.327497 (+   215us) service_pool.cc:224] Handling call
0709 13:17:37.358673 (+22031176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":855268,"reported_tablets":48}
I20260709 13:17:37.391240 10147 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 15 to 18, leader changed from 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 18 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:37.393203 10147 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 12 to 15, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 15 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:37.396667 10147 catalog_manager.cc:5697] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 6 to 7, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 7 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.403139 10147 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:37.435230  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:37.434791 10147 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 12 to 14, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 14 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:37.442014 10148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 312) took 42337 ms (client timeout 15000 ms). Trace:
W20260709 13:17:37.442440 10148 rpcz_store.cc:269] 0709 13:16:55.104623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.196899 (+ 92276us) service_pool.cc:224] Handling call
0709 13:17:37.441804 (+42244905us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207403,"reported_tablets":48}
I20260709 13:17:37.519779 10143 catalog_manager.cc:5697] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 20 to 23, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 23 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:37.529515 10143 catalog_manager.cc:5697] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 14 to 16, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:37.533085 10147 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36216 (request call id 212) took 4497 ms. Trace:
I20260709 13:17:37.540642 10147 rpcz_store.cc:276] 0709 13:17:33.036242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.037503 (+  1261us) service_pool.cc:224] Handling call
0709 13:17:37.532976 (+4495473us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:37.440195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:37.440776 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:37.440817 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:17:37.440835 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:37.441558 (+   723us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:37.441615 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:37.441640 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:17:37.442150 (+   510us) tablet.cc:701] Row locks acquired
0709 13:17:37.442167 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:17:37.442392 (+   225us) write_op.cc:270] Start()
0709 13:17:37.442496 (+   104us) write_op.cc:276] Timestamp: P: 1783603057442351 usec, L: 0
0709 13:17:37.442518 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:37.443186 (+   668us) log.cc:844] Serialized 2065 byte log entry
0709 13:17:37.447868 (+  4682us) op_driver.cc:464] REPLICATION: finished
0709 13:17:37.450256 (+  2388us) write_op.cc:301] APPLY: starting
0709 13:17:37.450349 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:37.452945 (+  2596us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:37.453045 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:37.461075 (+  8030us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:37.461251 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:17:37.461298 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:37.461747 (+   449us) log.cc:844] Serialized 57 byte log entry
0709 13:17:37.461916 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.462023 (+   107us) write_op.cc:454] Released schema lock
0709 13:17:37.462068 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:37.464494 (+  2426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.464533 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":112778,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":2145,"apply.run_cpu_time_us":6945,"apply.run_wall_time_us":14207,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20910,"num_ops":5,"prepare.queue_time_us":389,"prepare.run_cpu_time_us":3237,"prepare.run_wall_time_us":5649,"replication_time_us":5213}]]}
I20260709 13:17:37.777395 10140 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38856 (request call id 314) took 4232 ms. Trace:
I20260709 13:17:37.777920 10140 rpcz_store.cc:276] 0709 13:17:33.545486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.545732 (+   246us) service_pool.cc:224] Handling call
0709 13:17:37.777304 (+4231572us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122711,"reported_tablets":48}
I20260709 13:17:38.014312 10316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:38.015025 10316 raft_consensus.cc:606] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:38.018349 16229 raft_consensus.cc:993] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.018846 16229 raft_consensus.cc:1081] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.024163 10248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:17:38.024817 10248 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.025197 10248 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.062023 10316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:38.062774 10316 raft_consensus.cc:606] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:38.083941 10248 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.103489 10316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67d43312af804527af89708edfbd9177"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:38.104259 10316 raft_consensus.cc:606] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:38.110801 10248 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:38.122176 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 52891.9us
W20260709 13:17:38.136526 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 83827.6us
I20260709 13:17:38.147769 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:38.151721 10397 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.170807 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:38.171559 10319 raft_consensus.cc:3055] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:38.171893 10319 raft_consensus.cc:740] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:38.172802 10319 consensus_queue.cc:260] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.174618 10319 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.204964 10319 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:38.214073 16467 raft_consensus.cc:993] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.214674 16229 raft_consensus.cc:1081] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.223228 10316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:38.223850 10316 raft_consensus.cc:606] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:38.227396 10248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67d43312af804527af89708edfbd9177"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:17:38.228052 10248 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.228440 10248 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.199419 10397 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:38.236176 10248 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.214023 10213 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:38.256906 16442 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:38.257462 16442 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:38.258351 16442 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.282163 10248 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:38.284384 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:38.285061 11001 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.300460 10140 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 14 to 15, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 15 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.306097 11001 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:38.307796 10213 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:38.308748 16442 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:38.309309 16442 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:38.314256 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:38.310346 16442 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.319166 10323 raft_consensus.cc:3055] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:38.319557 10323 raft_consensus.cc:740] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:38.320652 10323 consensus_queue.cc:260] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.338383 10323 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.348397 10316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:38.349324 10316 raft_consensus.cc:606] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:17:38.358963  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:38.360834  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:38.381060 16467 raft_consensus.cc:993] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.381667 16467 raft_consensus.cc:1081] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.385737 10248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:17:38.386363 10248 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.386734 10248 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:38.401479 10323 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 15.
I20260709 13:17:38.417986 10248 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.421288 10248 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:38.427593 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:38.428227 10398 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:38.438514 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:38.439208 10323 raft_consensus.cc:3055] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:38.439518 10323 raft_consensus.cc:740] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:38.440183 10323 consensus_queue.cc:260] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.441293 16375 raft_consensus.cc:993] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.441350 10323 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:38.441809 16543 raft_consensus.cc:1081] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:38.460453 10248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:17:38.461110 10248 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.462611 10248 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.472049 10140 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 14 to 15, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 15 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.479557 10398 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:38.489207 10213 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:38.453898 10323 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 17.
I20260709 13:17:38.490458 16442 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:38.504177 16442 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:38.505146 16442 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.505957 10248 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.508983 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:38.509640 10323 raft_consensus.cc:3055] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:38.509902 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:38.510766 10994 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.509948 10323 raft_consensus.cc:740] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:38.518846 10323 consensus_queue.cc:260] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.520257 10323 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.530233 10248 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:38.533216 10994 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:38.534876 10323 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:38.533974 10140 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 16 to 17, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 17 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.535161 10213 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:38.539616 16442 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:38.540259 16442 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:38.541241 16442 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.611683 11001 consensus_queue.cc:237] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:38.625792 16542 raft_consensus.cc:993] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:17:38.626325 16542 raft_consensus.cc:1081] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:17:38.628173 10398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:17:38.628811 10398 raft_consensus.cc:493] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.629191 10398 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.629949 10140 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 12 to 13, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 13 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:38.653960 10398 raft_consensus.cc:515] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.662055 10248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:38.662770 10248 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.677866 10248 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:38.680275 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5a9192e938463ea07352f70853ef2e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:38.685714 10323 raft_consensus.cc:3055] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:38.686064 10323 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:38.686369 10364 leader_election.cc:304] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:38.686818 10323 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.688004 10323 raft_consensus.cc:3060] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.703824 10323 raft_consensus.cc:2468] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
I20260709 13:17:38.687924 16199 raft_consensus.cc:2804] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:38.706176 16199 raft_consensus.cc:697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:38.707094 16199 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:38.730633 10323 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:38.731660 10395 raft_consensus.cc:1275] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:38.681381 10398 leader_election.cc:290] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:38.742682 16233 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.765935 16233 consensus_queue.cc:1048] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:38.769336 10143 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 17 to 18, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.787226 10319 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:38.789234 10316 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:38.799389 16442 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:38.800926 16538 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:38.804293 11001 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:38.813090 16442 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:38.835350 16429 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 4 to 11, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:38.836514 10319 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 4 to 11, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:38.836512 10398 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:38.851352 16442 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:38.860018 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5315e843bcf14730b0299b712eab40d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:17:38.867594 10140 catalog_manager.cc:5697] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 4 to 11, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 13 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.924786 10395 raft_consensus.cc:2955] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 4 to 11, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:38.952636 10395 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:38.953107 11001 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:38.988023 16442 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:38.988806 16538 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:39.065706 10321 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:39.150684 10248 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:39.154300 16199 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:39.213824 10234 tablet_service.cc:1558] Processing DeleteTablet for tablet 5315e843bcf14730b0299b712eab40d0 with delete_type TABLET_DATA_TOMBSTONED (TS ab33f0a79ddf4f5a8ba81b3b0e120529 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:49896
I20260709 13:17:39.238734 16582 tablet_replica.cc:333] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:39.251690 10321 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:39.259862 16443 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:39.278157 16538 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:39.300732 10323 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:39.302866 16582 raft_consensus.cc:2243] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:39.346058 16582 raft_consensus.cc:2272] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:39.361840  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:39.313311 16578 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:17:39.443418 16582 ts_tablet_manager.cc:1916] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:17:39.497834 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 116275us
I20260709 13:17:39.607460 16582 ts_tablet_manager.cc:1929] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:17:39.608105 16582 log.cc:1199] T 5315e843bcf14730b0299b712eab40d0 P ab33f0a79ddf4f5a8ba81b3b0e120529: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/wals/5315e843bcf14730b0299b712eab40d0
I20260709 13:17:39.610519 10134 catalog_manager.cc:5028] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): tablet 5315e843bcf14730b0299b712eab40d0 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
I20260709 13:17:40.916517  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:41.112512 10322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:41.113507 10322 raft_consensus.cc:606] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Received request to transfer leadership to TS ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:41.117137 10322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e"
dest_uuid: "cb71def93f904f619a1527aa48a32294"
mode: GRACEFUL
new_leader_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:48564
I20260709 13:17:41.117755 10322 raft_consensus.cc:606] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Received request to transfer leadership to TS 73825599c2644b898cebaafbccd86e99
I20260709 13:17:41.119840  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:41.121762  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:41.398191 16542 raft_consensus.cc:993] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: : Instructing follower ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:41.398938 16542 raft_consensus.cc:1081] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Signalling peer ab33f0a79ddf4f5a8ba81b3b0e120529 to start an election
I20260709 13:17:41.433584 10245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94"
dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
 from {username='slave'} at 127.0.0.1:39872
I20260709 13:17:41.434309 10245 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.434793 10245 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.484647 10245 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:41.504382 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:41.505342 10395 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.503113 10245 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:41.521876 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:41.522593 10319 raft_consensus.cc:3055] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:41.522882 10319 raft_consensus.cc:740] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:41.543807 10319 consensus_queue.cc:260] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:41.545113 10319 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.553557 10395 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:41.554493 10398 raft_consensus.cc:1240] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Rejecting Update request from peer cb71def93f904f619a1527aa48a32294 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:41.569820 10213 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:41.571135 16589 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:41.571712 16589 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Becoming Leader. State: Replica: ab33f0a79ddf4f5a8ba81b3b0e120529, State: Running, Role: LEADER
I20260709 13:17:41.573498 16589 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:41.637471 10319 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab33f0a79ddf4f5a8ba81b3b0e120529 in term 13.
I20260709 13:17:41.667680 16542 raft_consensus.cc:993] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: : Instructing follower 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:17:41.668219 16542 raft_consensus.cc:1081] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Signalling peer 73825599c2644b898cebaafbccd86e99 to start an election
I20260709 13:17:41.689280 10147 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 reported cstate change: term changed from 12 to 13, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193). New cstate: current_term: 13 leader_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.703001 10398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e"
dest_uuid: "73825599c2644b898cebaafbccd86e99"
 from {username='slave'} at 127.0.0.1:44062
I20260709 13:17:41.703655 10398 raft_consensus.cc:493] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:41.703999 10398 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.725360 10398 raft_consensus.cc:515] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:41.747525 10398 leader_election.cc:290] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:41.748437 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529"
I20260709 13:17:41.749014 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecab1d1cb33f4578870d0cf2888cf76e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:41.749215 10245 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.749697 10323 raft_consensus.cc:3055] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:41.750064 10323 raft_consensus.cc:740] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:41.751329 10323 consensus_queue.cc:260] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:41.752800 10323 raft_consensus.cc:3060] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.763880 10245 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:41.766325 10364 leader_election.cc:304] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 
I20260709 13:17:41.769218 16539 raft_consensus.cc:2804] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:41.769758 16539 raft_consensus.cc:697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:41.770773 16539 consensus_queue.cc:237] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:41.780534 10323 raft_consensus.cc:2468] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:41.872121 10140 catalog_manager.cc:5697] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 16 to 17, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 17 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.087131 10316 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:42.110841 16589 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:42.122879  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.149255 10395 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Refusing update from remote peer ab33f0a79ddf4f5a8ba81b3b0e120529: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:42.163138 16598 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:42.175793 10316 raft_consensus.cc:1275] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:42.194839 16539 consensus_queue.cc:1048] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:42.209461  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
W20260709 13:17:42.233661 10364 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:17:42.217041 10213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 57837.4us
W20260709 13:17:42.280823 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 47205.1us
W20260709 13:17:42.358574 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.431679 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.457588 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35437, user_credentials={real_user=slave}} blocked reactor thread for 82990.1us
W20260709 13:17:42.517647 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.522120 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.522915 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.523584 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.545982 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.546737 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.547395 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.553478 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.554493 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.555138 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.569764 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.572175 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.573155 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.573858 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.574669 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.589422 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.602593 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.601832 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.606992 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.608412 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.605213 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.610743 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.611361 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.621269 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.611580 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.625265 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.638680 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.651095 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.666623 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.733892 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 99915.1us
W20260709 13:17:42.761289 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:42.762142 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:42.786137  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:42.835382  9147 tablet_replica.cc:333] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:42.836647  9147 raft_consensus.cc:2243] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.861533  9147 raft_consensus.cc:2272] T 8b11f92960bc4c35a7a06623da846cc3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.864913  9147 tablet_replica.cc:333] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:42.865962  9147 raft_consensus.cc:2243] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.884320  9147 raft_consensus.cc:2272] T 02c8de49bce9468ca25de2106e6f0a37 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.902773  9147 tablet_replica.cc:333] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:42.903911  9147 raft_consensus.cc:2243] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.924233  9147 raft_consensus.cc:2272] T dfa0864627e04e0284664cff47040bf9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.927654  9147 tablet_replica.cc:333] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:42.928645  9147 raft_consensus.cc:2243] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.929692  9147 raft_consensus.cc:2272] T 5db7cef2154f4a63901d966c49530263 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.975139  9147 tablet_replica.cc:333] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:42.976346  9147 raft_consensus.cc:2243] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:42.977437  9147 raft_consensus.cc:2272] T fc16ee0241da48fa9ae8e1e3705b673b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.980544  9147 tablet_replica.cc:333] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:42.981356  9147 raft_consensus.cc:2243] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:42.994864  9147 raft_consensus.cc:2272] T 58bcaf2ee2cb4badb447e0a27855aaf6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:42.997924  9147 tablet_replica.cc:333] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.019795  9147 raft_consensus.cc:2243] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.020738  9147 raft_consensus.cc:2272] T 8898babdb91e46acafbe4314671b54fa P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.031128  9147 tablet_replica.cc:333] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.042793  9147 raft_consensus.cc:2243] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.043824  9147 raft_consensus.cc:2272] T 6a75ec4911bc4e9188e70ee560a67a72 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.046875  9147 tablet_replica.cc:333] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.060578  9147 raft_consensus.cc:2243] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.061901  9147 raft_consensus.cc:2272] T 7df30c54c90e4fcfaeb14736ccbcec7c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.078073  9147 tablet_replica.cc:333] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.079084  9147 raft_consensus.cc:2243] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.079905  9147 raft_consensus.cc:2272] T cfd747d82d6d447e9c04851a4163a863 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.121012  9147 tablet_replica.cc:333] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.121840  9147 raft_consensus.cc:2243] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.131592  9147 raft_consensus.cc:2272] T 0f1231f6d6fa45119f3f855900d3113b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.136315  9147 tablet_replica.cc:333] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.137115  9147 raft_consensus.cc:2243] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.138060  9147 raft_consensus.cc:2272] T fc4f8110c14b45cdadf9a53a149c8fdf P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.140815  9147 tablet_replica.cc:333] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.141880  9147 raft_consensus.cc:2243] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.143471  9147 raft_consensus.cc:2272] T ecab1d1cb33f4578870d0cf2888cf76e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.172142  9147 tablet_replica.cc:333] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.173098  9147 raft_consensus.cc:2243] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.174337  9147 raft_consensus.cc:2272] T b37304bb0f7f411e935e8784db513f5a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.187305  9147 tablet_replica.cc:333] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.188356  9147 raft_consensus.cc:2243] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.189216  9147 raft_consensus.cc:2272] T a07acf0009094d989235d04de13c6c2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.192762  9147 tablet_replica.cc:333] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.193675  9147 raft_consensus.cc:2243] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.194550  9147 raft_consensus.cc:2272] T 0de4147226834030b0fd22d4a0948990 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.208262 16633 raft_consensus.cc:493] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:43.209072 16633 raft_consensus.cc:515] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:43.209666  9147 tablet_replica.cc:333] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.210814  9147 raft_consensus.cc:2243] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.211691  9147 raft_consensus.cc:2272] T a6d7bac4863c4b958392d525cba4f98b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.212762 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:43.214988  9147 tablet_replica.cc:333] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.215997  9147 raft_consensus.cc:2243] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.216812  9147 raft_consensus.cc:2272] T ee5a9192e938463ea07352f70853ef2e P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.220178  9147 tablet_replica.cc:333] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.221063  9147 raft_consensus.cc:2243] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.221552 16635 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:43.222131  9147 raft_consensus.cc:2272] T 1667c24c31044f708dc4fcc524ea924d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.223325 16622 raft_consensus.cc:493] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:43.223855 16622 raft_consensus.cc:515] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:43.222182 16635 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:43.225803  9147 tablet_replica.cc:333] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.226496 16635 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:43.226692  9147 raft_consensus.cc:2243] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.227409  9147 raft_consensus.cc:2272] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.228084 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.228832 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.230140  9147 tablet_replica.cc:333] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.230542 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62fd7f6040dd4ff1b75922910732a441" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:43.230990  9147 raft_consensus.cc:2243] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.230000 16622 leader_election.cc:290] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:43.231863 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75f247057a16492c8757cbf337e8b240" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:43.232355  9147 raft_consensus.cc:2272] T 07abdf4bb17f4efd8947745de6c71c1d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.235383 16633 leader_election.cc:290] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:43.237058  9147 tablet_replica.cc:333] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.238076  9147 raft_consensus.cc:2243] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.238782  9147 raft_consensus.cc:2272] T 54badd91404d4f7894752c8769345dca P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.238822 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.241257 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3955117b87304f9c9123136a32ea1aa8" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:43.241372 10213 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:43.241904  9147 tablet_replica.cc:333] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.242774  9147 raft_consensus.cc:2243] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.243147 10213 leader_election.cc:304] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:43.243607 16633 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:43.243762  9147 raft_consensus.cc:2272] T 477291c1a9554fecabe56380eefe7c94 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.246428 10213 leader_election.cc:304] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:17:43.247786 16635 raft_consensus.cc:2749] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:43.246737 16633 raft_consensus.cc:2749] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:43.263177  9147 tablet_replica.cc:333] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.264129  9147 raft_consensus.cc:2243] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.273989  9147 raft_consensus.cc:2272] T 67d43312af804527af89708edfbd9177 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.276985  9147 tablet_replica.cc:333] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.277765  9147 raft_consensus.cc:2243] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.278554  9147 raft_consensus.cc:2272] T c20e8be888d84cbf954ad2041699a03d P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.281289  9147 tablet_replica.cc:333] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.283141 16633 raft_consensus.cc:493] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:43.283782 16633 raft_consensus.cc:515] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:43.282092  9147 raft_consensus.cc:2243] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.286617  9147 raft_consensus.cc:2272] T 5235584cc4374dbcbe419cad1b3b9226 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.290203  9147 tablet_replica.cc:333] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.291859 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:43.291884 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4810a67dfa984af6aa1dfcfc1ad2cc29" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.286154 16633 leader_election.cc:290] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:43.294848 10213 leader_election.cc:304] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:43.296034 16633 raft_consensus.cc:2749] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:43.298471 16633 raft_consensus.cc:493] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:17:43.299588  9147 raft_consensus.cc:2243] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.299475 16633 raft_consensus.cc:515] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:43.300578  9147 raft_consensus.cc:2272] T 16f38b8c79f844dc83f9505884422f2a P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.304649  9147 tablet_replica.cc:333] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.305462 16633 leader_election.cc:290] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:43.304446 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.306602 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c1a2214d54cff9377d68a3d00054b" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:43.312183 10213 leader_election.cc:304] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:43.313086 16633 raft_consensus.cc:2749] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.305647  9147 raft_consensus.cc:2243] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.323143  9147 raft_consensus.cc:2272] T 3955117b87304f9c9123136a32ea1aa8 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.326459  9147 tablet_replica.cc:333] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.327244  9147 raft_consensus.cc:2243] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.328445  9147 raft_consensus.cc:2272] T 0ed60181ed2d4e3782c0247f5c8a145f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.383038  9147 tablet_replica.cc:333] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.383857  9147 raft_consensus.cc:2243] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.384644  9147 raft_consensus.cc:2272] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.387084 16635 raft_consensus.cc:493] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:43.387713 16635 raft_consensus.cc:515] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:43.398432 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.404575 16635 leader_election.cc:290] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:43.406538 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1d9c88bdd4df9942232a578267aa6" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:43.408607 10213 leader_election.cc:304] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99
I20260709 13:17:43.410061 16635 raft_consensus.cc:2749] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.411546  9147 tablet_replica.cc:333] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.412410  9147 raft_consensus.cc:2243] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.413169  9147 raft_consensus.cc:2272] T 38076f481679473aac7854c07b22e381 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.415994  9147 tablet_replica.cc:333] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.416754  9147 raft_consensus.cc:2243] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.417704  9147 raft_consensus.cc:2272] T ab10f00e071642849d7b7c7d29ee29ee P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.444880  9147 tablet_replica.cc:333] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.445742  9147 raft_consensus.cc:2243] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.446442  9147 raft_consensus.cc:2272] T ebb1d9c88bdd4df9942232a578267aa6 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.449383  9147 tablet_replica.cc:333] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.450174  9147 raft_consensus.cc:2243] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.479218  9147 raft_consensus.cc:2272] T 2181b7acaa904976917e2c58bc8856c3 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.482209  9147 tablet_replica.cc:333] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.490556  9147 raft_consensus.cc:2243] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.492136  9147 raft_consensus.cc:2272] T dc2db78b356a4f57af63adec3766d44b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.495285  9147 tablet_replica.cc:333] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.496204  9147 raft_consensus.cc:2243] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.496942  9147 raft_consensus.cc:2272] T 75f247057a16492c8757cbf337e8b240 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.508041  9147 tablet_replica.cc:333] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.513751  9147 raft_consensus.cc:2243] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.515244  9147 raft_consensus.cc:2272] T 15565c698f45442aa353abbe927bfc68 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.509418 16635 raft_consensus.cc:493] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:43.521143 16635 raft_consensus.cc:515] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:43.523507 16635 leader_election.cc:290] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:43.525586 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:43.526299 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4768f1c2494e8e91598dcb7cfa3556" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.529407 10213 leader_election.cc:304] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:43.532773 16635 raft_consensus.cc:2749] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:43.535461  9147 tablet_replica.cc:333] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.538725  9147 raft_consensus.cc:2243] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.567519  9147 raft_consensus.cc:2272] T 002cc8ee6e9043929d5cd5532317aab7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.585119 16633 raft_consensus.cc:493] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:17:43.585685 16633 raft_consensus.cc:515] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:43.587895 16633 leader_election.cc:290] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:43.590195 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.590124 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525196bf91b04b748ae03b3fac9f4364" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:43.596493  9147 tablet_replica.cc:333] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.596285 10213 leader_election.cc:304] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:43.597316 16635 raft_consensus.cc:2749] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.597426  9147 raft_consensus.cc:2243] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.611527 16635 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:17:43.612615 16635 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:43.615031 16635 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:43.623832 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:43.624046 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4262070044b6403dbc7cebd32cfebe0c" candidate_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:43.615113  9147 raft_consensus.cc:2272] T d97c1a2214d54cff9377d68a3d00054b P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.631496 10213 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab33f0a79ddf4f5a8ba81b3b0e120529; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:17:43.632396 16635 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:43.633920  9147 tablet_replica.cc:333] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.634753  9147 raft_consensus.cc:2243] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.636224  9147 raft_consensus.cc:2272] T 23ce7c1f0ea74a808f62e7870ca8579f P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.640365  9147 tablet_replica.cc:333] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.641191  9147 raft_consensus.cc:2243] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.641999  9147 raft_consensus.cc:2272] T 525196bf91b04b748ae03b3fac9f4364 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.645076  9147 tablet_replica.cc:333] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.649044  9147 raft_consensus.cc:2243] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.650653  9147 raft_consensus.cc:2272] T 4262070044b6403dbc7cebd32cfebe0c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.653635  9147 tablet_replica.cc:333] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.654414  9147 raft_consensus.cc:2243] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.655673  9147 raft_consensus.cc:2272] T 19b05041c6f947c3bf56f4fc003bfabb P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.671816  9147 tablet_replica.cc:333] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.672602  9147 raft_consensus.cc:2243] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.674471  9147 raft_consensus.cc:2272] T 8b4768f1c2494e8e91598dcb7cfa3556 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.683041  9147 tablet_replica.cc:333] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.683827  9147 raft_consensus.cc:2243] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:43.685016  9147 raft_consensus.cc:2272] T e6fa99a4824140528f1f002c969d567c P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.687906  9147 tablet_replica.cc:333] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.688625  9147 raft_consensus.cc:2243] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.689565  9147 raft_consensus.cc:2272] T bdf450e3110e486088b3d5c7e2c7cef7 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.740779  9147 tablet_replica.cc:333] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529: stopping tablet replica
I20260709 13:17:43.741499  9147 raft_consensus.cc:2243] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:43.742167  9147 raft_consensus.cc:2272] T 62fd7f6040dd4ff1b75922910732a441 P ab33f0a79ddf4f5a8ba81b3b0e120529 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:44.052996 16639 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.053606 16639 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.055928 16639 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:44.061241 10364 leader_election.cc:336] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:17:44.062729 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.068768 10362 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:44.070710 16626 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:44.132472 16641 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.133080 16641 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.135558 16641 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.136705 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:44.181594 16639 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.184943 16639 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.187711 16639 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:44.200143 10364 leader_election.cc:336] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.256254 16429 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.256811 16429 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.259259 16429 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.262322 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.278752 16640 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.278937 16603 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.279458 16603 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.280229 16641 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.280841 16641 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.283025 16641 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.287407 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.288115 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.288148 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 20.
I20260709 13:17:44.279412 16640 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.292109 16640 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:44.293728 10290 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.294275 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.295073 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.301332 10322 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 13.
I20260709 13:17:44.302445 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.303483 16640 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:44.303951 16640 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.297020 16607 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.304397 16640 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.304792 16607 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.299872 16603 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.311349 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.312060 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.307194 16603 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:44.317401 16603 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.317972 16603 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:44.321318 16607 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.323423 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.326526 10362 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:44.327798 16626 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:44.329111 16641 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.331317 16626 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.331955 16626 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.334767 16626 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:44.350869 10364 leader_election.cc:336] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.351815 10967 leader_election.cc:336] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.354841 10967 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.356998 16429 raft_consensus.cc:2749] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:44.361582 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.362360 10319 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:44.366560 16640 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.369262 16640 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.371973 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:44.372712 10322 raft_consensus.cc:3060] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.381233 16639 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.381914 16639 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.381502 10322 raft_consensus.cc:2468] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
I20260709 13:17:44.383860 10965 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.384316 16639 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.384716 16429 raft_consensus.cc:2804] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:44.385257 16429 raft_consensus.cc:697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
W20260709 13:17:44.385285 10967 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.386134 16429 consensus_queue.cc:237] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:44.389163 10364 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.391093 16603 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.394678 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:44.402982 10290 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.405323 10290 leader_election.cc:336] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.405704 10290 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:44.467308 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 61992.6us
W20260709 13:17:44.476125 10290 leader_election.cc:336] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.477288 10290 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.482766 16645 raft_consensus.cc:2749] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.406378 16639 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:44.485800 16639 raft_consensus.cc:493] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.486406 16639 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:44.470791 16607 raft_consensus.cc:2749] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:44.471308 16603 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.478514 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
W20260709 13:17:44.478806 10967 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.480355 16641 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.491179 10398 raft_consensus.cc:3060] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:44.491305 16641 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.493417 16641 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.495313 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.495957 10395 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:44.499787 10140 catalog_manager.cc:5697] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 13 to 14, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 14 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.503301 10398 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 21.
I20260709 13:17:44.504271 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.505168 16603 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:44.505589 16603 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.505975 16603 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.510851 10288 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.515051 16650 raft_consensus.cc:2804] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:44.515919 16650 raft_consensus.cc:697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:44.525746 16603 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.527984 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.534149 16607 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.542913 16607 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.543274 16650 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.544328 16603 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.545081 16607 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.547773 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.548475 10395 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:44.549199 16626 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.549923 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.535162 16641 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.551016 16641 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.551532 16603 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:44.552007 10319 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
I20260709 13:17:44.554371 16596 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.555284 16641 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.554947 16596 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.558665 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1231f6d6fa45119f3f855900d3113b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:44.559587 10398 raft_consensus.cc:3060] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.556761 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.549755 16626 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.558862 16596 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.560690 10395 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 17.
I20260709 13:17:44.566053 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.566540 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.566092 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.568745 16655 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:44.569233 16655 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.569607 16655 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:44.552031 16603 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.573041 16649 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:44.573817 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.574996 10967 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.575650 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:44.577989 16596 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:44.578784 10290 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.574535 16603 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:44.581674 10290 leader_election.cc:336] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.574805 16649 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.582636 16649 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:44.594750 10398 raft_consensus.cc:2468] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:44.611863 10288 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.626924 16646 raft_consensus.cc:2804] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:44.627530 16646 raft_consensus.cc:697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:44.628523 16646 consensus_queue.cc:237] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.628448 16626 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.635414 16639 raft_consensus.cc:515] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.639227 16603 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.652943 16649 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.666558 16639 leader_election.cc:290] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.667379 16603 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.669955 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa0864627e04e0284664cff47040bf9" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:44.670758 10398 raft_consensus.cc:3060] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:44.680018 10398 raft_consensus.cc:2468] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 20.
I20260709 13:17:44.685192 10288 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.691870 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37304bb0f7f411e935e8784db513f5a" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:44.692541 10319 raft_consensus.cc:3060] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:44.692842 16626 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.693732 16649 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.693447 16626 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.695936 16626 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:44.704141 10290 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.705003 10290 leader_election.cc:336] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.705664 10290 leader_election.cc:336] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.707043 10290 leader_election.cc:336] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.708757 10290 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.705961 10319 raft_consensus.cc:2468] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
W20260709 13:17:44.713550 10364 leader_election.cc:336] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.714164 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.714614 10364 leader_election.cc:336] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.715662 10362 leader_election.cc:304] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.717681 16654 raft_consensus.cc:2804] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:44.718254 16654 raft_consensus.cc:697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:44.719132 16654 consensus_queue.cc:237] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:44.724771 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.724682 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.725898 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:44.681277 16655 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:44.725476 10364 leader_election.cc:336] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.728371 16655 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.726827 16646 raft_consensus.cc:2804] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:44.727227 10398 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 18: Already voted for candidate 73825599c2644b898cebaafbccd86e99 in this term.
I20260709 13:17:44.730561 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:44.730815 16646 raft_consensus.cc:697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:44.731338 10322 raft_consensus.cc:2393] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 73825599c2644b898cebaafbccd86e99 in current term 18: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:44.731858 16646 consensus_queue.cc:237] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.726033 10319 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 13.
I20260709 13:17:44.738103 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.738981 16655 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:44.739375 16655 raft_consensus.cc:493] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.739758 16655 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:44.739789 10364 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.746881 10143 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 20 to 21, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 21 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:44.748189 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.748739 16655 raft_consensus.cc:515] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.742517 10364 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:44.750968 16655 leader_election.cc:290] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.752427 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477291c1a9554fecabe56380eefe7c94" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:44.753120 10322 raft_consensus.cc:3060] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.755927 16639 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:44.758410 16658 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:44.758879 10364 leader_election.cc:336] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.759589 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.742174 10288 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.761875 10322 raft_consensus.cc:2468] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 14.
I20260709 13:17:44.764147 10362 leader_election.cc:304] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.765571 16607 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.766338 16607 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.768697 16607 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.770599 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:44.771289 10994 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
I20260709 13:17:44.772054 16649 raft_consensus.cc:2749] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:44.774338 16626 raft_consensus.cc:2804] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:44.774489 10290 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.774945 16626 raft_consensus.cc:697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:44.775866 16626 consensus_queue.cc:237] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.781733 10140 catalog_manager.cc:5697] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 17 to 18, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.758960 16658 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:44.786540 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.788647 16658 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.793648 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:44.795722 11001 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
I20260709 13:17:44.790827 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
W20260709 13:17:44.811643 10364 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.812119 10364 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:44.816013 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.816635 10322 raft_consensus.cc:1275] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:44.818538 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.822517 16648 consensus_queue.cc:1048] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:44.823608 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:44.825811 16655 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:44.826300 16655 raft_consensus.cc:493] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.826685 16655 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:44.832008 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.834645 16607 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:44.835150 16607 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.835484 16626 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:44.835546 16607 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.835929 10140 catalog_manager.cc:5697] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 13 to 14, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 14 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.842635 16655 raft_consensus.cc:515] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.847169 16648 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.848011 16648 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.851846 16648 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:44.854749 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:44.855443 10391 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
W20260709 13:17:44.857276 10364 leader_election.cc:336] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.860106 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.866741 16607 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.864261 16655 leader_election.cc:290] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:17:44.869335 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.872434 16607 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.873586 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df30c54c90e4fcfaeb14736ccbcec7c" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:44.874298 11001 raft_consensus.cc:3060] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:44.878453 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.887933 16648 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.888551 16648 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.892271 16648 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.896944 11001 raft_consensus.cc:2468] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 20.
I20260709 13:17:44.899115 16607 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.899296 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:44.905550 16607 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:44.906885 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:44.907670 10323 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:17:44.907807 16607 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.902618 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d43312af804527af89708edfbd9177" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:44.908903 10994 raft_consensus.cc:3060] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:44.909415 10967 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.909869 10967 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:44.911460 10362 leader_election.cc:304] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.912518 16626 raft_consensus.cc:2804] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:44.913025 16626 raft_consensus.cc:697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 20 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:44.913892 16626 consensus_queue.cc:237] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.914722 16662 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:44.904800 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.917338 10290 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.918818 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:44.919445 11001 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:44.921356 10994 raft_consensus.cc:2468] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 16.
I20260709 13:17:44.923573 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.925354 16648 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:44.925771 16648 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.926092 16648 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:44.936550 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.937765 10967 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.939751 16658 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.940320 16658 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:44.942159 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:44.944859 16658 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.947191 10140 catalog_manager.cc:5697] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 15 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.948483 16648 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.949091 10140 catalog_manager.cc:5697] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 19 to 20, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 20 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.950944 16648 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:44.952172 10290 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:44.951300 10288 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:44.953734 16607 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:44.954222 16607 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.955987 16607 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:44.965193 10364 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.965909 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.965193 16646 raft_consensus.cc:2804] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:44.967026 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.969732 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:44.971192 10967 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:44.983515 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:44.986654 16659 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.987289 16659 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.989497 16659 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:44.990756 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:44.992475 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:44.993927 10395 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:17:44.994946 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 51916.7us
I20260709 13:17:44.995801 16640 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:44.996344 16640 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:44.992369 16646 raft_consensus.cc:697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:45.001497 16646 consensus_queue.cc:237] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.007019 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:45.009490 16650 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.010149 16650 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.012346 16650 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:45.014896 16640 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:44.986047 16607 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.049049 10323 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 19: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
I20260709 13:17:45.051420 16640 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:45.051770 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.051641 16649 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:45.052284 10290 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:45.052085 16640 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.052783 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.053570 16641 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:45.053814 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.057219 16640 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:45.058182 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:45.058873 11001 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
I20260709 13:17:45.058995 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:45.060025 16626 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:45.063728 10290 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:45.071067 10967 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:45.071712 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.074108 16607 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:45.068620 10140 catalog_manager.cc:5697] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 19 to 20, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 20 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:45.084560  9147 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:45.085407 10967 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:45.091024 10290 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:45.091878 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.092969 16649 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.093672 16649 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:45.096894 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:45.097702 16649 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:45.100414 16596 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:45.107965 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:45.108688 10323 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 14.
W20260709 13:17:45.110121 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.123842 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.124408 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.132445 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:45.133180 10319 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:45.136327 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:45.137347 10994 raft_consensus.cc:2393] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 19: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:45.136412 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.139555 10391 raft_consensus.cc:1275] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:45.141505 10290 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:45.142172 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.142704 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:17:45.142719 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.143565 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.145536 16640 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.146015 16640 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.146401 16640 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:45.149232 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.143519 10397 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 14.
W20260709 13:17:45.153339 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.154575 16640 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.163710 16649 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.164359 16649 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:45.166958 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.175774 10967 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:45.179584 16649 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:45.179848 16603 consensus_queue.cc:1048] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:45.188289 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.190358 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.194787 16645 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.195232 16645 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
W20260709 13:17:45.195497 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.187340 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.195624 16645 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.196162 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.203934 16646 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.205185 16640 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:45.204413 16646 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.206408 16646 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.219118 10288 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.220130 16641 raft_consensus.cc:2749] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:45.237666 10140 catalog_manager.cc:5697] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 15 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 16 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.262189 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.263762 16673 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:45.264247 16673 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.264653 16673 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.267331 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:17:45.268090 10994 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:45.271291 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:17:45.272030 10395 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 18.
I20260709 13:17:45.290804 16645 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:45.293627 16645 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:17:45.303028 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:45.303668 10290 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:45.313024 16646 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:45.323017 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.331104 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 60594.7us
I20260709 13:17:45.341706 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:45.342384 10391 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.351080 10391 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 15.
W20260709 13:17:45.359879 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.384330 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:45.385624 10323 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in current term 15: Already voted for candidate cb71def93f904f619a1527aa48a32294 in this term.
W20260709 13:17:45.383385 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.383356 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:45.388862 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.400089 16673 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.402637 16646 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:45.404717 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:17:45.410945 10967 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:45.416339 16659 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:45.416999 16659 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ab33f0a79ddf4f5a8ba81b3b0e120529)
I20260709 13:17:45.417716 16659 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:45.420377 10323 raft_consensus.cc:1275] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:45.422115 10323 raft_consensus.cc:1275] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:45.427816 16673 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:45.428596 16626 consensus_queue.cc:1048] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:45.431447 16654 consensus_queue.cc:1048] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:45.434311 10994 raft_consensus.cc:1275] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:17:45.434616 10290 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:45.437674 16654 consensus_queue.cc:1048] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:45.452466 10288 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.462067 16645 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:45.465065 16645 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
W20260709 13:17:45.465864 10290 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:45.466584 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:45.466835 16645 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:45.456089 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:45.498121 10364 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58927.5us
I20260709 13:17:45.458546 16659 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.507855 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:17:45.519878 16662 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.534022 10391 raft_consensus.cc:1275] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:17:45.540771 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:45.540653 10143 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 14 to 15, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.542279 10994 raft_consensus.cc:2393] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate cb71def93f904f619a1527aa48a32294 in current term 15: Already voted for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in this term.
I20260709 13:17:45.543984 16659 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:17:45.559446 11001 raft_consensus.cc:1275] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:45.576365 10319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:45.577093 10319 raft_consensus.cc:3060] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:45.578527 10290 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:45.604497 10319 raft_consensus.cc:2468] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
W20260709 13:17:45.650720 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.656360 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:17:45.657310 10391 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:45.684883 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:17:45.685642 11001 raft_consensus.cc:3060] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:45.695760 11001 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:45.712601 10965 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.714032 16673 raft_consensus.cc:2804] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:45.714762 16673 raft_consensus.cc:697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:45.715970 16673 consensus_queue.cc:237] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.665333 10391 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb71def93f904f619a1527aa48a32294 in term 19.
I20260709 13:17:45.812348 16607 consensus_queue.cc:1048] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:45.826470 10288 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.827383 16641 raft_consensus.cc:2749] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.826289 10143 catalog_manager.cc:5697] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 15 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.844364 16607 consensus_queue.cc:1048] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:45.845498 10288 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:45.846601 16607 raft_consensus.cc:2804] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:45.847203 16607 raft_consensus.cc:697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Becoming Leader. State: Replica: cb71def93f904f619a1527aa48a32294, State: Running, Role: LEADER
I20260709 13:17:45.848205 16607 consensus_queue.cc:237] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:45.891191 10143 catalog_manager.cc:5697] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 reported cstate change: term changed from 18 to 19, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to cb71def93f904f619a1527aa48a32294 (127.8.238.194). New cstate: current_term: 19 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:45.988663 10290 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:45.994195 10395 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:45.998440 16659 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:46.085096  9147 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10271)
I20260709 13:17:46.176908 10323 raft_consensus.cc:1275] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:17:46.179955 16662 consensus_queue.cc:1048] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:46.314471 10395 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:46.317958 16659 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:46.390612 10994 raft_consensus.cc:1275] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:46.397578 16659 consensus_queue.cc:1048] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:46.439301 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:46.629734 16626 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.630344 16626 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:46.632510 16626 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:46.734458 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:46.735152 10323 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
W20260709 13:17:46.737365 10364 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:46.770438 16673 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.771085 16673 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:46.777134 16673 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:46.783798 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:46.787483 16701 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:46.787930 16701 raft_consensus.cc:493] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.788280 16701 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:46.791973 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:46.792821 10323 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 19.
I20260709 13:17:46.794128 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:46.795332 16673 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:46.795742 16673 raft_consensus.cc:493] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.796135 16673 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:46.817094 16701 raft_consensus.cc:515] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:17:46.839780 16701 leader_election.cc:290] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:46.897049 10322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07abdf4bb17f4efd8947745de6c71c1d" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:46.897966 10322 raft_consensus.cc:3060] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:46.899204 10364 leader_election.cc:336] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:46.906823 10322 raft_consensus.cc:2468] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
I20260709 13:17:46.910317 10362 leader_election.cc:304] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:46.882033 16673 raft_consensus.cc:515] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:46.913091 16697 raft_consensus.cc:2804] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:46.913702 16697 raft_consensus.cc:697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 19 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:17:46.914598 16697 consensus_queue.cc:237] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:17:46.921767 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:46.922645 10967 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:46.928252 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002cc8ee6e9043929d5cd5532317aab7" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:46.928920 10323 raft_consensus.cc:3060] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:46.931444 16673 leader_election.cc:290] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:17:46.948575 10967 leader_election.cc:336] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:46.950307 10323 raft_consensus.cc:2468] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 20.
I20260709 13:17:46.951761 10965 leader_election.cc:304] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:17:46.955667 16673 raft_consensus.cc:2804] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:46.956226 16673 raft_consensus.cc:697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:46.957129 16673 consensus_queue.cc:237] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:46.980712 10143 catalog_manager.cc:5697] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 17 to 19, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 19 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.036500 10140 catalog_manager.cc:5697] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 18 to 20, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 20 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:47.085640  9147 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 10271)
I20260709 13:17:47.090814 16681 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.091625 16681 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:47.112797 16681 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:47.115062 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:17:47.117509 10323 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:17:47.119580 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
I20260709 13:17:47.123117 16673 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.123714 16673 raft_consensus.cc:493] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.124193 16673 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:47.159304 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.147300 10967 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:17:47.186005 16673 raft_consensus.cc:515] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:47.188414 16673 leader_election.cc:290] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:47.195398 10323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2db78b356a4f57af63adec3766d44b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294"
I20260709 13:17:47.200328 10323 raft_consensus.cc:3060] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:47.236514 10290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111) [suppressed 399 similar messages]
W20260709 13:17:47.245211 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:47.287854 10323 raft_consensus.cc:2468] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
W20260709 13:17:47.294315 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:47.300809 10322 raft_consensus.cc:1275] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:47.306705 16701 consensus_queue.cc:1048] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:47.342456 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.347031 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:47.360749 10965 leader_election.cc:304] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294; no voters: 
W20260709 13:17:47.361651 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:47.363662 16662 raft_consensus.cc:2804] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:47.364379 16662 raft_consensus.cc:697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:17:47.365350 16662 consensus_queue.cc:237] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:47.378894 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.388868 10967 leader_election.cc:336] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:47.417834 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.428658 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:47.429145 10322 raft_consensus.cc:1275] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:47.433601 16681 consensus_queue.cc:1048] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:47.447064 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:47.448218 10143 catalog_manager.cc:5697] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 14 to 16, leader changed from ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:47.464533 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.508931 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.527758 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.571965 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:47.584745 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:47.600487 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.616496 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.633526 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:47.674453 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.694875 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:47.715195 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.720305 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.763916 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:47.820783 10323 raft_consensus.cc:1275] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:17:47.823448 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:47.824640 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:47.824998 16673 consensus_queue.cc:1048] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:17:47.847087 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:47.849320 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.849923 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.855420 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.897025 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:47.899034 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:47.988049 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:47.994724 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.034955 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.047600 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.086277  9147 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:48.100730 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.136155 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:48.150377 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.203330 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.267460 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.477847 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.480026 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.536278 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.548714 10290 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:48.649923 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:48.847568 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:49.086781  9147 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 10271)
I20260709 13:17:49.187752 10994 consensus_queue.cc:237] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:49.280651 10391 raft_consensus.cc:1275] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:17:49.282827 16681 consensus_queue.cc:1048] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:17:49.306509 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:49.311425 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:49.330629 16717 log.cc:927] Time spent T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:49.335078 16681 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 3 to 13, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:49.446571 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:17:49.455371 10391 raft_consensus.cc:2955] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 3 to 13, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:49.497282 10140 catalog_manager.cc:5697] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 13, VOTER cb71def93f904f619a1527aa48a32294 (127.8.238.194) evicted. New cstate: current_term: 18 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.580102 10306 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 with delete_type TABLET_DATA_TOMBSTONED (TS cb71def93f904f619a1527aa48a32294 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:34158
I20260709 13:17:49.602195 16725 tablet_replica.cc:333] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:17:49.603969 16725 raft_consensus.cc:2243] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:49.605002 16725 raft_consensus.cc:2272] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:49.631071 16725 ts_tablet_manager.cc:1916] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:17:49.705566 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:49.719657 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:49.726670 16725 ts_tablet_manager.cc:1929] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:17:49.730960 16725 log.cc:1199] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P cb71def93f904f619a1527aa48a32294: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/wals/0ebd7b007a9b4c7eaa47f51eaea905b9
I20260709 13:17:49.747056 10132 catalog_manager.cc:5028] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): tablet 0ebd7b007a9b4c7eaa47f51eaea905b9 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
W20260709 13:17:49.858932 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:49.887022 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:49.887921 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:49.996089 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:50.018174 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.020498 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.041131 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:50.087522  9147 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:50.108976 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:50.145330 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.158567 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.159340 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.159888 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.161310 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.207664 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.214892 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:50.224671 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.255774 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.268064 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.268783 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:50.296588 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.376736 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.392397 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:50.392763 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:50.419472 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.427934 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:50.451383 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:50.458627 10995 consensus_queue.cc:237] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:50.475338 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.487376 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.490828 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.491703 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:50.501287 10316 raft_consensus.cc:1275] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Refusing update from remote peer 72a1fe75b2bc4fb698d13f9d0b2dda04: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:17:50.505985 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:50.507874 16673 consensus_queue.cc:1048] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:50.531323 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:50.546345 16719 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 3 to 11, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:50.554731 10323 raft_consensus.cc:2955] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 3 to 11, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:50.579384 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3955117b87304f9c9123136a32ea1aa8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
W20260709 13:17:50.598814 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:50.604763 10140 catalog_manager.cc:5697] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 3 to 11, VOTER 73825599c2644b898cebaafbccd86e99 (127.8.238.195) evicted. New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:50.613281 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:50.711163 10380 tablet_service.cc:1558] Processing DeleteTablet for tablet 3955117b87304f9c9123136a32ea1aa8 with delete_type TABLET_DATA_TOMBSTONED (TS 73825599c2644b898cebaafbccd86e99 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:44050
I20260709 13:17:50.743690 16738 tablet_replica.cc:333] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:17:50.748615 16738 raft_consensus.cc:2243] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:50.759537 16738 raft_consensus.cc:2272] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:50.767057 16738 ts_tablet_manager.cc:1916] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:17:50.776492 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:50.794749 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:50.816365 16738 ts_tablet_manager.cc:1929] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:17:50.829685 16738 log.cc:1199] T 3955117b87304f9c9123136a32ea1aa8 P 73825599c2644b898cebaafbccd86e99: Deleting WAL directory at /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/wals/3955117b87304f9c9123136a32ea1aa8
I20260709 13:17:50.832275 10132 catalog_manager.cc:5028] TS 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): tablet 3955117b87304f9c9123136a32ea1aa8 (table test-workload [id=1eeb2be2551a4c8e80b9bba7a23cc32c]) successfully deleted
W20260709 13:17:50.888231 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:50.919801 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:51.023424 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:51.038648 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:51.088267  9147 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:51.261232 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:51.290095 10290 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:51.310524 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:51.927902 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:51.947372 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:51.980249 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:17:52.026084 10397 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:52.052838 10323 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:52.055739 16744 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:52.076892 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:52.081082 16745 raft_consensus.cc:2955] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.087725 10316 raft_consensus.cc:2955] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:17:52.089309  9147 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:52.092186 10362 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc16ee0241da48fa9ae8e1e3705b673b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:52.123035 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.131134 10143 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 11, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.204276 10316 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:52.225710 10397 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:17:52.231686 10288 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b11f92960bc4c35a7a06623da846cc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:52.232587 16743 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:52.240221 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:52.245770 10290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111) [suppressed 464 similar messages]
I20260709 13:17:52.255695 16748 raft_consensus.cc:2955] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.269013 10398 raft_consensus.cc:2955] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index -1 to 12, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:17:52.290400 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.341635 10140 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 12, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 21 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
W20260709 13:17:52.369835 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:52.386037 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:52.398502 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 66519.9us
I20260709 13:17:52.401350 10391 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:17:52.416829 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:52.434022 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:52.438723 10362 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee5a9192e938463ea07352f70853ef2e. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:52.441140 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.472338 10323 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:17:52.497154 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.514298 16745 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:52.529965 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:52.530764 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.624687 16763 ts_tablet_manager.cc:933] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:52.645907 16763 tablet_copy_client.cc:323] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
I20260709 13:17:52.648411 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet fc16ee0241da48fa9ae8e1e3705b673b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:17:52.649127 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet fc16ee0241da48fa9ae8e1e3705b673b from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-fc16ee0241da48fa9ae8e1e3705b673b
I20260709 13:17:52.651444 16744 raft_consensus.cc:2955] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.665988 10409 tablet_copy_source_session.cc:215] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:52.671936 16766 ts_tablet_manager.cc:933] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:52.673142 10323 raft_consensus.cc:2955] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.684603 16763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc16ee0241da48fa9ae8e1e3705b673b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:52.703404 10323 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:52.712059 16766 tablet_copy_client.cc:323] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:17:52.714636 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 8b11f92960bc4c35a7a06623da846cc3 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:17:52.715327 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 8b11f92960bc4c35a7a06623da846cc3 from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-8b11f92960bc4c35a7a06623da846cc3
I20260709 13:17:52.709615 10140 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index -1 to 13, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:52.725466 10334 tablet_copy_source_session.cc:215] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:17:52.751302 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:52.676004 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.744915 10398 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:17:52.754539 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 78597.1us
W20260709 13:17:52.755128 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:52.782027 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.783501 16743 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:17:52.785074 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.793248 16766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b11f92960bc4c35a7a06623da846cc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:52.802459 10288 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 -> Peer 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437): Couldn't send request to peer 72a1fe75b2bc4fb698d13f9d0b2dda04. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19b05041c6f947c3bf56f4fc003bfabb. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:52.807410 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.797693 16763 tablet_copy_client.cc:806] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:52.822662 16763 tablet_copy_client.cc:670] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:52.815148 10290 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:52.827968 11024 debug-util.cc:398] Leaking SignalData structure 0x7b0800339fc0 after lost signal to thread 9150
I20260709 13:17:52.828703 16766 tablet_copy_client.cc:806] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
W20260709 13:17:52.829152 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080033d740 after lost signal to thread 10182
W20260709 13:17:52.830924 11024 debug-util.cc:398] Leaking SignalData structure 0x7b08002d32a0 after lost signal to thread 10349
W20260709 13:17:52.832839 11024 debug-util.cc:398] Leaking SignalData structure 0x7b0800030120 after lost signal to thread 10423
W20260709 13:17:52.834136 11024 debug-util.cc:398] Leaking SignalData structure 0x7b080038ae00 after lost signal to thread 11027
I20260709 13:17:52.829378 16766 tablet_copy_client.cc:670] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:52.840212 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:52.828922 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.846568 16763 tablet_copy_client.cc:538] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:52.866505 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.873622 16763 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
W20260709 13:17:52.876401 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:52.887833 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 125140us
I20260709 13:17:52.893385 16748 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.948215 16771 ts_tablet_manager.cc:933] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:17:52.951884 16766 tablet_copy_client.cc:538] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:52.952848 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.964884 16766 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:17:52.972512 10398 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } } }
I20260709 13:17:52.976959 16771 tablet_copy_client.cc:323] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.195:40329
W20260709 13:17:52.981233 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:52.981904 10140 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index -1 to 11, NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) added. New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:52.981905 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:53.000953 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.002805 10409 tablet_copy_service.cc:140] P 73825599c2644b898cebaafbccd86e99: Received BeginTabletCopySession request for tablet ee5a9192e938463ea07352f70853ef2e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:38154)
I20260709 13:17:53.004709 10409 tablet_copy_service.cc:161] P 73825599c2644b898cebaafbccd86e99: Beginning new tablet copy session on tablet ee5a9192e938463ea07352f70853ef2e from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:38154: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-ee5a9192e938463ea07352f70853ef2e
W20260709 13:17:53.010977 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.012856 10409 tablet_copy_source_session.cc:215] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.031949 16771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5a9192e938463ea07352f70853ef2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:53.042053 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:53.042754 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:53.077827 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:53.089823  9147 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 10271)
I20260709 13:17:53.103859 16771 tablet_copy_client.cc:806] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.104583 16771 tablet_copy_client.cc:670] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:53.112345 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:53.112893 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:53.113799 16771 tablet_copy_client.cc:538] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:53.119238 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:53.124967 16771 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:17:53.128427 16766 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.129626 16766 tablet_bootstrap.cc:492] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:17:53.130462 16766 ts_tablet_manager.cc:1403] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.166s	user 0.042s	sys 0.020s
I20260709 13:17:53.139458 16766 raft_consensus.cc:359] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.140348 16766 raft_consensus.cc:740] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:17:53.141045 16766 consensus_queue.cc:260] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.157846 16766 ts_tablet_manager.cc:1434] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 13:17:53.160017 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-8b11f92960bc4c35a7a06623da846cc3 received from {username='slave'} at 127.0.0.1:52922
I20260709 13:17:53.160548 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-8b11f92960bc4c35a7a06623da846cc3 on tablet 8b11f92960bc4c35a7a06623da846cc3 with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:53.179562 16766 ts_tablet_manager.cc:933] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Initiating tablet copy from peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:17:53.199244 16766 tablet_copy_client.cc:323] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Beginning tablet copy session from remote peer at address 127.8.238.194:44995
I20260709 13:17:53.201175 10334 tablet_copy_service.cc:140] P cb71def93f904f619a1527aa48a32294: Received BeginTabletCopySession request for tablet 19b05041c6f947c3bf56f4fc003bfabb from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 ({username='slave'} at 127.0.0.1:52922)
I20260709 13:17:53.201767 10334 tablet_copy_service.cc:161] P cb71def93f904f619a1527aa48a32294: Beginning new tablet copy session on tablet 19b05041c6f947c3bf56f4fc003bfabb from peer 72a1fe75b2bc4fb698d13f9d0b2dda04 at {username='slave'} at 127.0.0.1:52922: session id = 72a1fe75b2bc4fb698d13f9d0b2dda04-19b05041c6f947c3bf56f4fc003bfabb
I20260709 13:17:53.211230 10334 tablet_copy_source_session.cc:215] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:53.214912 16766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b05041c6f947c3bf56f4fc003bfabb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:53.220798 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.221632 16763 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.231976 16763 tablet_bootstrap.cc:492] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:17:53.248664 16766 tablet_copy_client.cc:806] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:53.254902 16763 ts_tablet_manager.cc:1403] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.382s	user 0.045s	sys 0.008s
I20260709 13:17:53.256321 16766 tablet_copy_client.cc:670] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:53.258347 16763 raft_consensus.cc:359] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.267861 16763 raft_consensus.cc:740] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:17:53.268643 16763 consensus_queue.cc:260] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.271414 16763 ts_tablet_manager.cc:1434] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 13:17:53.263927 16766 tablet_copy_client.cc:538] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:53.287196 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-fc16ee0241da48fa9ae8e1e3705b673b received from {username='slave'} at 127.0.0.1:38154
I20260709 13:17:53.287705 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-fc16ee0241da48fa9ae8e1e3705b673b on tablet fc16ee0241da48fa9ae8e1e3705b673b with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:53.329633 16766 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap starting.
I20260709 13:17:53.337276 16771 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.355111 16771 tablet_bootstrap.cc:492] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:17:53.355973 16771 ts_tablet_manager.cc:1403] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.231s	user 0.049s	sys 0.004s
W20260709 13:17:53.358270 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.359476 16771 raft_consensus.cc:359] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.360405 16771 raft_consensus.cc:740] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:17:53.362006 16771 consensus_queue.cc:260] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.372082 16771 ts_tablet_manager.cc:1434] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:17:53.384380 10409 tablet_copy_service.cc:342] P 73825599c2644b898cebaafbccd86e99: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-ee5a9192e938463ea07352f70853ef2e received from {username='slave'} at 127.0.0.1:38154
I20260709 13:17:53.384858 10409 tablet_copy_service.cc:434] P 73825599c2644b898cebaafbccd86e99: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-ee5a9192e938463ea07352f70853ef2e on tablet ee5a9192e938463ea07352f70853ef2e with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
I20260709 13:17:53.395628 10995 raft_consensus.cc:1217] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
W20260709 13:17:53.429067 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.472893 16766 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:53.473905 16766 tablet_bootstrap.cc:492] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Bootstrap complete.
I20260709 13:17:53.474658 16766 ts_tablet_manager.cc:1403] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent bootstrapping tablet: real 0.145s	user 0.048s	sys 0.003s
I20260709 13:17:53.477491 16766 raft_consensus.cc:359] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
I20260709 13:17:53.478416 16766 raft_consensus.cc:740] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Initialized, Role: LEARNER
I20260709 13:17:53.479676 16766 consensus_queue.cc:260] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: NON_VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: true } }
W20260709 13:17:53.486186 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.493392 16766 ts_tablet_manager.cc:1434] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:17:53.499428 10334 tablet_copy_service.cc:342] P cb71def93f904f619a1527aa48a32294: Request end of tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-19b05041c6f947c3bf56f4fc003bfabb received from {username='slave'} at 127.0.0.1:52922
I20260709 13:17:53.501252 10334 tablet_copy_service.cc:434] P cb71def93f904f619a1527aa48a32294: ending tablet copy session 72a1fe75b2bc4fb698d13f9d0b2dda04-19b05041c6f947c3bf56f4fc003bfabb on tablet 19b05041c6f947c3bf56f4fc003bfabb with peer 72a1fe75b2bc4fb698d13f9d0b2dda04
W20260709 13:17:53.509371 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:53.627157 10995 raft_consensus.cc:1217] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 13:17:53.654556 10995 raft_consensus.cc:1217] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:17:53.691123 10995 raft_consensus.cc:1217] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:17:53.901242 16779 raft_consensus.cc:1064] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:17:53.904170 16779 consensus_queue.cc:237] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:53.941023 10323 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:53.946445 16740 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:17:53.966027 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.970578 10995 raft_consensus.cc:1275] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:17:53.989588 16740 consensus_queue.cc:1048] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:54.032855 16740 raft_consensus.cc:2955] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.066661 10995 raft_consensus.cc:2955] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:54.073763 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:17:54.076174 16744 raft_consensus.cc:1064] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:17:54.079655 16744 consensus_queue.cc:237] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:54.081113 16778 raft_consensus.cc:1064] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:17:54.083784 16778 consensus_queue.cc:237] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:17:54.090323  9147 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 10271)
I20260709 13:17:54.101420 10323 raft_consensus.cc:2955] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.112509 10143 catalog_manager.cc:5697] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 reported cstate change: config changed from index 13 to 14, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.127609 10391 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:54.129208 11001 raft_consensus.cc:1275] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:17:54.136224 16778 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:54.138163 16778 consensus_queue.cc:1048] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:17:54.162681 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.173668 11001 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEARNER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:17:54.204233 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 65291.1us
I20260709 13:17:54.207343 16740 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:54.250984 10322 raft_consensus.cc:1275] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Refusing update from remote peer 73825599c2644b898cebaafbccd86e99: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:17:54.262835 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.264153 16778 raft_consensus.cc:1064] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: attempting to promote NON_VOTER 72a1fe75b2bc4fb698d13f9d0b2dda04 to VOTER
I20260709 13:17:54.268574 16778 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:54.275610 16742 raft_consensus.cc:2955] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.287365 16699 consensus_queue.cc:1048] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:54.297708 10994 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 LEARNER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:54.289379 10995 raft_consensus.cc:2955] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.299898 16748 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:17:54.305356 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:54.309883 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:54.310420 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:54.325052 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:17:54.335619 10391 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:17:54.445284 10288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 107593us
I20260709 13:17:54.445856 16794 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:54.460172 10140 catalog_manager.cc:5697] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: config changed from index 12 to 13, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:54.514739 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:54.522135 10397 raft_consensus.cc:2955] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.532670 16699 raft_consensus.cc:2955] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:54.548730 10290 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.551054 10323 raft_consensus.cc:2955] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.551285 16795 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.563225 11001 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.600823 10391 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:54.641076 10362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:44995, user_credentials={real_user=slave}} blocked reactor thread for 95090.7us
W20260709 13:17:54.658471 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:17:54.641423 10140 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.699930 10994 raft_consensus.cc:2955] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.702605 10316 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:17:54.710834 11001 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:54.713733 16797 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:54.718940 10397 raft_consensus.cc:1275] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Refusing update from remote peer cb71def93f904f619a1527aa48a32294: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:54.720971 16801 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.724895 11001 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.730249 10147 catalog_manager.cc:5697] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 11 to 12, 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
I20260709 13:17:54.742767 10132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19b05041c6f947c3bf56f4fc003bfabb with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:54.752548 16801 consensus_queue.cc:1048] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:54.763494 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:54.765043 10132 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 19b05041c6f947c3bf56f4fc003bfabb with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 12 but the committed config has opid_index of 13
I20260709 13:17:54.778822 10147 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 reported cstate change: config changed from index 12 to 13, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New cstate: current_term: 15 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.795823 10397 raft_consensus.cc:2955] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:54.853019 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:54.883061 10134 catalog_manager.cc:4755] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 19b05041c6f947c3bf56f4fc003bfabb: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:54.905455 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:55.065004 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:55.086371 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.090822  9147 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:55.139904 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.146850 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.288844 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:55.312079 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:55.340975 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.370985 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.374593 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:55.402673 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.416410 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.424350 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:55.441315 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.443259 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.470264 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.497011 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:55.502458 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.508015 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.534619 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.642524 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:55.720474 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.727221 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.728462 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.914831 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:55.947355 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:55.944320 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:55.969761 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.025375 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.085170 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.091441  9147 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:56.128224 10134 catalog_manager.cc:4755] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 19b05041c6f947c3bf56f4fc003bfabb: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:56.137945 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.229869 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.274076 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.351266 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:56.355581 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:56.439738 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.472832 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.523407 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:56.589741 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:56.590576 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:56.605033 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:56.822755 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:56.998782 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.091951  9147 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:57.130950 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.216377 10134 catalog_manager.cc:4755] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 19b05041c6f947c3bf56f4fc003bfabb: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:57.250767 10967 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260709 13:17:57.281358 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:57.487721 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.547601 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:57.562547 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:57.612453 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.644719 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.666826 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:57.711493 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.784041 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.786101 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:57.827497 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.854847 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.879590 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:57.893316 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.899091 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.904069 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.926628 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.956199 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:57.979071 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:58.035125 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.092582  9147 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:58.170276 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.171245 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:58.175623 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:58.179055 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.248692 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.309553 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.375713 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:58.452055 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.523095 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.533922 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:58.575309 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.594849 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.634080 10132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23ce7c1f0ea74a808f62e7870ca8579f with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer cb71def93f904f619a1527aa48a32294 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 19 leader_uuid: "cb71def93f904f619a1527aa48a32294" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } } }
W20260709 13:17:58.670245 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.686206 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.727790 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:58.752235 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:58.829526 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:58.902987 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:59.033584 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:59.058609 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:59.088474 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:59.094146  9147 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 10271)
W20260709 13:17:59.262872 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:59.387815 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:59.435447 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:59.453794 10134 catalog_manager.cc:4755] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 19b05041c6f947c3bf56f4fc003bfabb: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:17:59.504321 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:59.658630 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:59.813720 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:59.927268 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:59.930742 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:00.032639 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:00.095472  9147 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 10271)
W20260709 13:18:00.182978 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:00.206138 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.207526 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.269876 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.327611 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.330035 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.378022 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.401710 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.441612 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:00.442420 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:00.476434 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.519634 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.544044 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.583508 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.614531 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.615469 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:00.719429 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.735255 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:00.748147 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:00.753541 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.798748 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.804080 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:00.841925 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:01.096736  9147 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 10271)
W20260709 13:18:01.786170 10290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.002s	sys 0.023s
W20260709 13:18:01.786648 10290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.002s	sys 0.023s
W20260709 13:18:01.831300 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:01.861536 16817 raft_consensus.cc:493] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:18:01.862555 16817 raft_consensus.cc:515] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:01.871282 16817 leader_election.cc:290] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:18:01.876617 16820 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:01.877242 16820 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:01.877728 16836 raft_consensus.cc:493] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:18:01.878391 16836 raft_consensus.cc:515] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:01.880003 16820 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:01.881675 16836 leader_election.cc:290] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:01.897485 16824 raft_consensus.cc:493] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:18:01.898221 16824 raft_consensus.cc:515] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:01.900925 16824 leader_election.cc:290] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:18:01.913501 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fa99a4824140528f1f002c969d567c" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:01.914762 16838 raft_consensus.cc:493] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 72a1fe75b2bc4fb698d13f9d0b2dda04)
I20260709 13:18:01.915549 16838 raft_consensus.cc:515] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:01.917900 16838 leader_election.cc:290] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:18:01.894332 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 89952us
I20260709 13:18:01.936034 16854 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:18:01.936398 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:18:01.936923 16854 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:01.944204 16854 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:01.961371 10397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07acf0009094d989235d04de13c6c2e" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:18:01.963541 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db7cef2154f4a63901d966c49530263" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:18:01.967224 10316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc16ee0241da48fa9ae8e1e3705b673b" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:18:01.967499 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58bcaf2ee2cb4badb447e0a27855aaf6" candidate_uuid: "cb71def93f904f619a1527aa48a32294" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:01.980535 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cb71def93f904f619a1527aa48a32294" is_pre_election: true
I20260709 13:18:01.985827 10965 leader_election.cc:304] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:18:01.992735 16836 raft_consensus.cc:2749] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:01.994328 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:01.999648 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ce991d35f4413e82e03d5416c73bf2" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:18:02.023270 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.024118 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.025098 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.025830 10967 leader_election.cc:336] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:02.026183 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:02.039036 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.028107 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800174340 after lost signal to thread 9150
W20260709 13:18:02.046614 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.047092 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.047190 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8c80 after lost signal to thread 10182
W20260709 13:18:02.047655 10290 leader_election.cc:336] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:02.048074 10290 leader_election.cc:304] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:18:02.048728 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08004230e0 after lost signal to thread 10349
W20260709 13:18:02.048983 10290 leader_election.cc:336] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:02.049383 10290 leader_election.cc:304] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb71def93f904f619a1527aa48a32294; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:18:02.049901 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8b80 after lost signal to thread 10423
I20260709 13:18:02.050206 16858 raft_consensus.cc:2749] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:02.050526 16826 raft_consensus.cc:2749] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:02.052452 10179 debug-util.cc:398] Leaking SignalData structure 0x7b08000e45e0 after lost signal to thread 11027
I20260709 13:18:02.055977 10362 leader_election.cc:304] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:18:02.057247 16841 raft_consensus.cc:2749] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.026327 10967 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:02.059876 16836 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:02.061264 10967 leader_election.cc:336] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:02.067668 10967 leader_election.cc:336] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:02.068254 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
I20260709 13:18:02.069144 16836 raft_consensus.cc:2749] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:02.097415  9147 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 10271)
W20260709 13:18:02.263083 10364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111) [suppressed 400 similar messages]
W20260709 13:18:02.266690 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:02.313853 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:02.326792 10290 consensus_peers.cc:597] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.327428 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.377460 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:02.397706 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:02.564181 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:02.628921 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:02.756560 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:02.861433 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:02.910460 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:02.940047 10290 consensus_peers.cc:597] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:03.098006  9147 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 10271)
W20260709 13:18:03.125545 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:03.149036 10290 consensus_peers.cc:597] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.314010 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.360539 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.363734 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.392062 10965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:40329, user_credentials={real_user=slave}} blocked reactor thread for 43551.7us
W20260709 13:18:03.427748 10290 consensus_peers.cc:597] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.442525 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:03.445932 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.454608 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.512812 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.552731 10290 consensus_peers.cc:597] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.589732 10134 catalog_manager.cc:4755] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 19b05041c6f947c3bf56f4fc003bfabb: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:03.599567 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:03.616092 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.698869 10290 consensus_peers.cc:597] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.714918 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.717635 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:03.719123 10290 consensus_peers.cc:597] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.816022 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.832604 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.857188 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 92004.6us
W20260709 13:18:03.890575 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:03.983300 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 58406.9us
W20260709 13:18:03.997956 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:04.047681 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:04.082916 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:04.098500  9147 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 10271)
W20260709 13:18:04.106047 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:04.122148 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:04.137696 10290 consensus_peers.cc:597] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.140945 10290 consensus_peers.cc:597] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.203868 10290 consensus_peers.cc:597] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.209228 10290 consensus_peers.cc:597] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:04.391069 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.464385 10967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 54551.6us
W20260709 13:18:04.611508 10290 consensus_peers.cc:597] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.638074 10290 consensus_peers.cc:597] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:04.644913  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
W20260709 13:18:04.697959 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.753688 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.770417 10290 consensus_peers.cc:597] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:04.778439 10967 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:04.819059  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
W20260709 13:18:04.820147 10290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:40671, user_credentials={real_user=slave}} blocked reactor thread for 45666.9us
W20260709 13:18:04.832261 10364 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:04.872835 10290 consensus_peers.cc:597] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:04.886477 10362 consensus_peers.cc:597] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.887614 10362 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.889047 10362 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.912274 10290 consensus_peers.cc:597] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:04.913235 10362 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.918385 10965 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.923803 10965 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.973001  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:04.973730 10965 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:04.977779 10965 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.982970  9147 tablet_replica.cc:333] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:04.984194  9147 raft_consensus.cc:2243] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.985586  9147 raft_consensus.cc:2272] T dfa0864627e04e0284664cff47040bf9 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.992293  9147 tablet_replica.cc:333] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:04.993394  9147 raft_consensus.cc:2243] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.994750  9147 raft_consensus.cc:2272] T 6a75ec4911bc4e9188e70ee560a67a72 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.997648  9147 tablet_replica.cc:333] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:04.998512  9147 raft_consensus.cc:2243] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.999660  9147 raft_consensus.cc:2272] T 5db7cef2154f4a63901d966c49530263 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.002920  9147 tablet_replica.cc:333] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.003851  9147 raft_consensus.cc:2243] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.005995  9147 raft_consensus.cc:2272] T 8b11f92960bc4c35a7a06623da846cc3 P cb71def93f904f619a1527aa48a32294 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:05.006422 10362 consensus_peers.cc:597] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.007194 10362 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.007880 10362 consensus_peers.cc:597] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.010672 10290 consensus_peers.cc:597] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:05.018054 10965 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.018631  9147 tablet_replica.cc:333] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.020319  9147 raft_consensus.cc:2243] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.021121  9147 raft_consensus.cc:2272] T 58bcaf2ee2cb4badb447e0a27855aaf6 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:05.023027 10965 consensus_peers.cc:597] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.024286  9147 tablet_replica.cc:333] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.025391  9147 raft_consensus.cc:2243] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.026692  9147 raft_consensus.cc:2272] T fc16ee0241da48fa9ae8e1e3705b673b P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.029875  9147 tablet_replica.cc:333] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.030977  9147 raft_consensus.cc:2243] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.031960  9147 raft_consensus.cc:2272] T 02c8de49bce9468ca25de2106e6f0a37 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.035456  9147 tablet_replica.cc:333] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.036448  9147 raft_consensus.cc:2243] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.037801  9147 raft_consensus.cc:2272] T fc4f8110c14b45cdadf9a53a149c8fdf P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.041013  9147 tablet_replica.cc:333] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.041986  9147 raft_consensus.cc:2243] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:05.042083 10965 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.042860  9147 raft_consensus.cc:2272] T 6bab3992733148c582649aac71356232 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.046083  9147 tablet_replica.cc:333] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.047226  9147 raft_consensus.cc:2243] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.048646  9147 raft_consensus.cc:2272] T 9187284d595443aab84a71601d6fe9ea P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.051985  9147 tablet_replica.cc:333] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.053119  9147 raft_consensus.cc:2243] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.053894  9147 raft_consensus.cc:2272] T cfd747d82d6d447e9c04851a4163a863 P cb71def93f904f619a1527aa48a32294 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.056988  9147 tablet_replica.cc:333] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.057999  9147 raft_consensus.cc:2243] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.059360  9147 raft_consensus.cc:2272] T 0f1231f6d6fa45119f3f855900d3113b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.063814  9147 tablet_replica.cc:333] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.064841  9147 raft_consensus.cc:2243] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.065955  9147 raft_consensus.cc:2272] T ee5a9192e938463ea07352f70853ef2e P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.068984  9147 tablet_replica.cc:333] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.069911  9147 raft_consensus.cc:2243] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.070658  9147 raft_consensus.cc:2272] T 1667c24c31044f708dc4fcc524ea924d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.073774  9147 tablet_replica.cc:333] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.074775  9147 raft_consensus.cc:2243] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.075799  9147 raft_consensus.cc:2272] T 07abdf4bb17f4efd8947745de6c71c1d P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.078933  9147 tablet_replica.cc:333] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.079952  9147 raft_consensus.cc:2243] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.080669  9147 raft_consensus.cc:2272] T b37304bb0f7f411e935e8784db513f5a P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.086129  9147 tablet_replica.cc:333] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.087147  9147 raft_consensus.cc:2243] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.087903  9147 raft_consensus.cc:2272] T ecab1d1cb33f4578870d0cf2888cf76e P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.090942  9147 tablet_replica.cc:333] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.091953  9147 raft_consensus.cc:2243] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.092861  9147 raft_consensus.cc:2272] T 5315e843bcf14730b0299b712eab40d0 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.095713  9147 tablet_replica.cc:333] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.096693  9147 raft_consensus.cc:2243] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.097445  9147 raft_consensus.cc:2272] T 525196bf91b04b748ae03b3fac9f4364 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.100373  9147 tablet_replica.cc:333] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294: stopping tablet replica
W20260709 13:18:05.100623 10362 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.101310  9147 raft_consensus.cc:2243] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:18:05.101823 10362 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.102938  9147 raft_consensus.cc:2272] T 23ce7c1f0ea74a808f62e7870ca8579f P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.106081  9147 tablet_replica.cc:333] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.106994  9147 raft_consensus.cc:2243] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.108315  9147 raft_consensus.cc:2272] T 8898babdb91e46acafbe4314671b54fa P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.111253  9147 tablet_replica.cc:333] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.122761  9147 raft_consensus.cc:2243] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.125519  9147 raft_consensus.cc:2272] T 69ce991d35f4413e82e03d5416c73bf2 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.135893  9147 tablet_replica.cc:333] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.136894  9147 raft_consensus.cc:2243] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.138151  9147 raft_consensus.cc:2272] T 67d43312af804527af89708edfbd9177 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.141220  9147 tablet_replica.cc:333] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.142163  9147 raft_consensus.cc:2243] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.143356  9147 raft_consensus.cc:2272] T 0de4147226834030b0fd22d4a0948990 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.146603  9147 tablet_replica.cc:333] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.147524  9147 raft_consensus.cc:2243] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.148288  9147 raft_consensus.cc:2272] T f26aceb684204af4b9a75341f4d72c53 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.151463  9147 tablet_replica.cc:333] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.152390  9147 raft_consensus.cc:2243] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.153718  9147 raft_consensus.cc:2272] T 54badd91404d4f7894752c8769345dca P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.156569  9147 tablet_replica.cc:333] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
W20260709 13:18:05.156787 10965 consensus_peers.cc:597] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.157613  9147 raft_consensus.cc:2243] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.158381  9147 raft_consensus.cc:2272] T 477291c1a9554fecabe56380eefe7c94 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.162601  9147 tablet_replica.cc:333] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.163618  9147 raft_consensus.cc:2243] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.164896  9147 raft_consensus.cc:2272] T c20e8be888d84cbf954ad2041699a03d P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.167851  9147 tablet_replica.cc:333] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.168718  9147 raft_consensus.cc:2243] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.170729  9147 raft_consensus.cc:2272] T 4ae4445ee896464a9b9905cf5ca48e67 P cb71def93f904f619a1527aa48a32294 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.175830  9147 tablet_replica.cc:333] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.176853  9147 raft_consensus.cc:2243] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.177793  9147 raft_consensus.cc:2272] T 3955117b87304f9c9123136a32ea1aa8 P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.181071  9147 tablet_replica.cc:333] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.182109  9147 raft_consensus.cc:2243] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.183696  9147 raft_consensus.cc:2272] T 16f38b8c79f844dc83f9505884422f2a P cb71def93f904f619a1527aa48a32294 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:05.185078 10364 consensus_peers.cc:597] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:05.186791  9147 tablet_replica.cc:333] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.188947  9147 raft_consensus.cc:2243] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.189805  9147 raft_consensus.cc:2272] T ab10f00e071642849d7b7c7d29ee29ee P cb71def93f904f619a1527aa48a32294 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.192864  9147 tablet_replica.cc:333] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.193823  9147 raft_consensus.cc:2243] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.194626  9147 raft_consensus.cc:2272] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P cb71def93f904f619a1527aa48a32294 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.197499  9147 tablet_replica.cc:333] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.198426  9147 raft_consensus.cc:2243] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.199549  9147 raft_consensus.cc:2272] T 38076f481679473aac7854c07b22e381 P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.202486  9147 tablet_replica.cc:333] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.203742  9147 raft_consensus.cc:2243] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:18:05.202500 10965 consensus_peers.cc:597] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.207049  9147 raft_consensus.cc:2272] T 2181b7acaa904976917e2c58bc8856c3 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.209992  9147 tablet_replica.cc:333] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.210880  9147 raft_consensus.cc:2243] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.211831  9147 raft_consensus.cc:2272] T 976ea23dd44047a6adc91ad78f34fa79 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.214694  9147 tablet_replica.cc:333] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.217366  9147 raft_consensus.cc:2243] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.218161  9147 raft_consensus.cc:2272] T 7b0293dc4ca94845b6d1f8991514db3e P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.221087  9147 tablet_replica.cc:333] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.221939  9147 raft_consensus.cc:2243] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.223220  9147 raft_consensus.cc:2272] T f892a371a6e2431ab5718daa82f2b02e P cb71def93f904f619a1527aa48a32294 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.226085  9147 tablet_replica.cc:333] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.227006  9147 raft_consensus.cc:2243] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.227764  9147 raft_consensus.cc:2272] T 8b4768f1c2494e8e91598dcb7cfa3556 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:05.229833 10965 consensus_peers.cc:597] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:05.230963  9147 tablet_replica.cc:333] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.231971  9147 raft_consensus.cc:2243] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.232714  9147 raft_consensus.cc:2272] T 1f4dd97a92804cc6927c6fff64d16f39 P cb71def93f904f619a1527aa48a32294 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.239282  9147 tablet_replica.cc:333] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.240720  9147 raft_consensus.cc:2243] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.241679  9147 raft_consensus.cc:2272] T bb19b1ef417a439c833c0b7627cf7c00 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:05.243672 10965 consensus_peers.cc:597] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.244781 10364 consensus_peers.cc:597] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:05.244949  9147 tablet_replica.cc:333] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.245875  9147 raft_consensus.cc:2243] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.246742  9147 raft_consensus.cc:2272] T 002cc8ee6e9043929d5cd5532317aab7 P cb71def93f904f619a1527aa48a32294 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.249827  9147 tablet_replica.cc:333] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.250869  9147 raft_consensus.cc:2243] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.253823  9147 raft_consensus.cc:2272] T 4262070044b6403dbc7cebd32cfebe0c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.258174  9147 tablet_replica.cc:333] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.260476  9147 raft_consensus.cc:2243] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.261860  9147 raft_consensus.cc:2272] T 07947046eb9e42ae8ccb9083210f95f0 P cb71def93f904f619a1527aa48a32294 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.265112  9147 tablet_replica.cc:333] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.266137  9147 raft_consensus.cc:2243] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.266837  9147 raft_consensus.cc:2272] T e6fa99a4824140528f1f002c969d567c P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.273185  9147 tablet_replica.cc:333] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.275972  9147 raft_consensus.cc:2243] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.277340  9147 raft_consensus.cc:2272] T 19b05041c6f947c3bf56f4fc003bfabb P cb71def93f904f619a1527aa48a32294 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.280841  9147 tablet_replica.cc:333] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.281687  9147 raft_consensus.cc:2243] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:05.282773  9147 raft_consensus.cc:2272] T 62fd7f6040dd4ff1b75922910732a441 P cb71def93f904f619a1527aa48a32294 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:05.285903  9147 tablet_replica.cc:333] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294: stopping tablet replica
I20260709 13:18:05.286722  9147 raft_consensus.cc:2243] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:05.287505  9147 raft_consensus.cc:2272] T dc2db78b356a4f57af63adec3766d44b P cb71def93f904f619a1527aa48a32294 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:05.268550 10362 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.304786 10364 consensus_peers.cc:597] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:05.318192 10965 consensus_peers.cc:597] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.408998 10967 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:05.430588 10965 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.450320 10362 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.451424 10362 consensus_peers.cc:597] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.472565 10362 consensus_peers.cc:597] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.489809 10362 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:05.602470 10364 consensus_peers.cc:597] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:05.631639 10364 consensus_peers.cc:597] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:05.702421 10364 consensus_peers.cc:597] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:05.713613 10364 consensus_peers.cc:597] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:05.999140 10967 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:06.030320 10967 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:06.092948 16881 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.093554 16881 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.096306 16881 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:06.099264 16862 raft_consensus.cc:493] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.100077 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:18:06.100057 16862 raft_consensus.cc:515] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:18:06.102519 16862 leader_election.cc:290] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:18:06.108547 10965 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.109555 10965 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
W20260709 13:18:06.110164 10362 leader_election.cc:336] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.110406 16881 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:06.108888 16862 raft_consensus.cc:493] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.111204 16862 raft_consensus.cc:515] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:18:06.113263 16862 leader_election.cc:290] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:18:06.122140 10364 leader_election.cc:336] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.124269 10364 leader_election.cc:304] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.125463 16862 raft_consensus.cc:2749] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:06.125854 10967 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:06.127733 10362 leader_election.cc:336] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.129122 10364 leader_election.cc:336] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.129554 10364 leader_election.cc:304] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.130270 16862 raft_consensus.cc:2749] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:06.131990 10967 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:06.133163 10364 consensus_peers.cc:597] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:06.144464 10364 consensus_peers.cc:597] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:06.150481 10967 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:06.151892 16881 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.152500 16881 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:18:06.155797 10967 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:06.157969 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:18:06.159148 10965 leader_election.cc:336] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.156174 16881 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:06.160076 10965 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.160979 16881 raft_consensus.cc:2749] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:06.182391 16862 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.183143 16862 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.185998 16881 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.185448 16862 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:18:06.186638 16881 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.189458 16881 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:06.192309 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
W20260709 13:18:06.197785 10362 leader_election.cc:336] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.202188 10965 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.203853 10965 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.204943 16874 raft_consensus.cc:493] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.205967 16881 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:06.206002 16874 raft_consensus.cc:515] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } attrs { replace: true } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.207188 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:06.209379 16874 leader_election.cc:290] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:18:06.212138 10967 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:06.213380 10362 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
W20260709 13:18:06.213724 10967 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.216732 16874 raft_consensus.cc:2749] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:06.217676 10364 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.220002 16879 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.220574 16879 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.223285 16879 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:06.227032 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:18:06.227836 10398 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 17.
I20260709 13:18:06.229543 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:18:06.230814 16879 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:06.231184 16879 raft_consensus.cc:493] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.231523 16879 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:06.231703 10362 leader_election.cc:336] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.232424 10362 leader_election.cc:304] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.233253 16862 raft_consensus.cc:2749] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:06.234597 10364 consensus_peers.cc:597] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:06.240798 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ce7c1f0ea74a808f62e7870ca8579f" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:06.241514 10994 raft_consensus.cc:2468] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 19.
W20260709 13:18:06.244588 10965 leader_election.cc:336] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.243273 16879 raft_consensus.cc:515] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.247287 16879 leader_election.cc:290] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:18:06.252301 10967 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:06.253785 10398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187284d595443aab84a71601d6fe9ea" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:18:06.254443 10398 raft_consensus.cc:3060] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:06.260812 10965 leader_election.cc:336] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.264245 10398 raft_consensus.cc:2468] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 18.
I20260709 13:18:06.265623 10965 leader_election.cc:304] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.266337 16879 raft_consensus.cc:2804] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:06.267963 16879 raft_consensus.cc:697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:18:06.268996 16879 consensus_queue.cc:237] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.271708 16881 raft_consensus.cc:493] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.272239 16881 raft_consensus.cc:515] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.274099 16881 leader_election.cc:290] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.277505 16862 raft_consensus.cc:493] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.278049 16862 raft_consensus.cc:515] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:18:06.279120 10364 consensus_peers.cc:597] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:06.280297 16862 leader_election.cc:290] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.286048 16881 raft_consensus.cc:493] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.286733 16881 raft_consensus.cc:515] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:18:06.288800 10362 leader_election.cc:336] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.288964 16862 raft_consensus.cc:493] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.289537 16862 raft_consensus.cc:515] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } attrs { replace: true } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
W20260709 13:18:06.291774 10364 leader_election.cc:336] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.292685 16862 leader_election.cc:290] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:18:06.288821 16881 leader_election.cc:290] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:18:06.294292 10965 leader_election.cc:336] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.302850 10967 leader_election.cc:336] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:06.300477 10362 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.303393 10967 leader_election.cc:304] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.305961 16881 raft_consensus.cc:2749] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:06.307745 10965 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.308388 10364 leader_election.cc:304] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.309168 16862 raft_consensus.cc:2749] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.313894 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b11f92960bc4c35a7a06623da846cc3" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:06.314190 16862 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.314622 10994 raft_consensus.cc:2468] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 21.
I20260709 13:18:06.314728 16862 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.316847 16862 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:18:06.319792 16874 raft_consensus.cc:493] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.320304 16874 raft_consensus.cc:515] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:18:06.312188 10147 catalog_manager.cc:5697] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 17 to 18, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 18 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.322312 16874 leader_election.cc:290] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:18:06.325891 10362 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.329634 10362 leader_election.cc:336] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.334566 10967 leader_election.cc:336] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.334471 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:06.335163 10967 leader_election.cc:304] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:18:06.338312 10364 leader_election.cc:336] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.338953 10364 leader_election.cc:304] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.339943 16874 raft_consensus.cc:2749] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:06.342499 16881 raft_consensus.cc:2749] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:06.348145 10364 leader_election.cc:336] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.349401 10362 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.350262 16874 raft_consensus.cc:493] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.350374 16862 raft_consensus.cc:2749] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.350801 16874 raft_consensus.cc:515] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:18:06.353628 16874 leader_election.cc:290] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.360373 16874 raft_consensus.cc:493] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.361084 16874 raft_consensus.cc:515] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:18:06.360503 10362 leader_election.cc:336] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.363783 16874 leader_election.cc:290] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.366300 10364 leader_election.cc:304] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.367718 16881 raft_consensus.cc:493] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.368297 16881 raft_consensus.cc:515] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.369189 16862 raft_consensus.cc:2749] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:06.369940 16862 raft_consensus.cc:493] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.370529 16881 leader_election.cc:290] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.370420 16862 raft_consensus.cc:515] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
I20260709 13:18:06.372340 16876 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.372495 16862 leader_election.cc:290] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.372952 16876 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.375134 16876 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:18:06.377259 10965 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.378333 16876 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.378871 16876 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.381145 16876 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
W20260709 13:18:06.388974 10364 consensus_peers.cc:597] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:06.393210 10362 leader_election.cc:336] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.398552 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
I20260709 13:18:06.399290 10994 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 17.
W20260709 13:18:06.400035 10967 leader_election.cc:336] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.400517 10967 leader_election.cc:304] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
W20260709 13:18:06.403672 10362 leader_election.cc:336] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.404347 10362 leader_election.cc:336] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.406442 10364 leader_election.cc:336] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.407037 10364 leader_election.cc:304] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.407783 16876 raft_consensus.cc:2749] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.408535 16879 raft_consensus.cc:2749] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:06.410331 10364 leader_election.cc:336] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.410812 10364 leader_election.cc:304] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.411361 16879 raft_consensus.cc:493] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.411501 16876 raft_consensus.cc:2749] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:06.411696 10364 leader_election.cc:336] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:06.411181 10967 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:06.412180 10364 leader_election.cc:304] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.412966 16876 raft_consensus.cc:2749] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.412194 10994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892a371a6e2431ab5718daa82f2b02e" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" is_pre_election: true
W20260709 13:18:06.414765 10362 leader_election.cc:336] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.415956 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.417045 16876 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:06.416936 16879 raft_consensus.cc:515] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.417459 16876 raft_consensus.cc:493] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.417843 16876 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.419241 16879 leader_election.cc:290] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.420282 16874 raft_consensus.cc:493] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.420821 16874 raft_consensus.cc:515] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:18:06.422163 10364 consensus_peers.cc:597] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:06.422900 16874 leader_election.cc:290] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:18:06.430423 10965 leader_election.cc:336] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.434209 16876 raft_consensus.cc:515] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.440335 16876 leader_election.cc:290] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196:35437)
I20260709 13:18:06.444389 10362 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.445290 16876 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:06.445580 10362 leader_election.cc:336] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.447463 10967 leader_election.cc:336] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.447964 10967 leader_election.cc:304] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.448716 16881 raft_consensus.cc:2749] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.452754 11001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07947046eb9e42ae8ccb9083210f95f0" candidate_uuid: "73825599c2644b898cebaafbccd86e99" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04"
I20260709 13:18:06.453341 11001 raft_consensus.cc:3060] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.455309 16876 raft_consensus.cc:493] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.455886 16876 raft_consensus.cc:515] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:18:06.456352 10362 leader_election.cc:336] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.457983 16876 leader_election.cc:290] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.460976 11001 raft_consensus.cc:2468] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73825599c2644b898cebaafbccd86e99 in term 18.
W20260709 13:18:06.462136 10362 leader_election.cc:336] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:06.461647 10364 leader_election.cc:336] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.468502 10364 leader_election.cc:304] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.467909 10362 leader_election.cc:304] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.469570 16874 raft_consensus.cc:2749] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:06.470376  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
I20260709 13:18:06.470851 16874 raft_consensus.cc:2804] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:06.471416 16874 raft_consensus.cc:697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Becoming Leader. State: Replica: 73825599c2644b898cebaafbccd86e99, State: Running, Role: LEADER
I20260709 13:18:06.472414 16874 consensus_queue.cc:237] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.479439 16881 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.480090 16881 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.482309 16881 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:18:06.483258 10364 leader_election.cc:336] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.483716 10364 leader_election.cc:304] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.484428 16876 raft_consensus.cc:2749] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:06.485411 10364 consensus_peers.cc:597] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:06.485853 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99" is_pre_election: true
I20260709 13:18:06.486549 10391 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 15.
I20260709 13:18:06.488336 10965 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: 
I20260709 13:18:06.490510 16881 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:06.490916 16881 raft_consensus.cc:493] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.491336 16881 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.494190 16874 raft_consensus.cc:493] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.494833 16874 raft_consensus.cc:515] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:18:06.494547 10965 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.501062 10147 catalog_manager.cc:5697] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 reported cstate change: term changed from 17 to 18, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 73825599c2644b898cebaafbccd86e99 (127.8.238.195). New cstate: current_term: 18 leader_uuid: "73825599c2644b898cebaafbccd86e99" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:06.504937 10364 leader_election.cc:336] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
I20260709 13:18:06.505694 16881 raft_consensus.cc:515] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.509876 16874 leader_election.cc:290] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
W20260709 13:18:06.512924 10965 leader_election.cc:336] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.513978 16881 leader_election.cc:290] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Requested vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:06.515403 10391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b05041c6f947c3bf56f4fc003bfabb" candidate_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73825599c2644b898cebaafbccd86e99"
I20260709 13:18:06.516022 10391 raft_consensus.cc:3060] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:06.518570 10362 leader_election.cc:336] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.519091 10362 leader_election.cc:304] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.520924 16876 raft_consensus.cc:2749] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.527755 10391 raft_consensus.cc:2468] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72a1fe75b2bc4fb698d13f9d0b2dda04 in term 16.
I20260709 13:18:06.529453 10965 leader_election.cc:304] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04, 73825599c2644b898cebaafbccd86e99; no voters: cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.530426 16879 raft_consensus.cc:2804] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:06.531045 16879 raft_consensus.cc:697] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Becoming Leader. State: Replica: 72a1fe75b2bc4fb698d13f9d0b2dda04, State: Running, Role: LEADER
I20260709 13:18:06.532032 16879 consensus_queue.cc:237] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.563614 10147 catalog_manager.cc:5697] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 reported cstate change: term changed from 15 to 16, leader changed from cb71def93f904f619a1527aa48a32294 (127.8.238.194) to 72a1fe75b2bc4fb698d13f9d0b2dda04 (127.8.238.196). New cstate: current_term: 16 leader_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.584515 16874 raft_consensus.cc:493] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.585223 16874 raft_consensus.cc:515] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } }
W20260709 13:18:06.592331 10364 leader_election.cc:336] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:06.594954 10362 leader_election.cc:336] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.595263 16874 leader_election.cc:290] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995)
I20260709 13:18:06.596369 10362 leader_election.cc:304] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73825599c2644b898cebaafbccd86e99; no voters: ab33f0a79ddf4f5a8ba81b3b0e120529, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.597765 16874 raft_consensus.cc:2749] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.636579  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
W20260709 13:18:06.659480 10965 consensus_peers.cc:597] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.672674 10965 consensus_peers.cc:597] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.676250 16879 raft_consensus.cc:493] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader cb71def93f904f619a1527aa48a32294)
I20260709 13:18:06.676783 16879 raft_consensus.cc:515] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:06.679253 16879 leader_election.cc:290] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
W20260709 13:18:06.689304 10965 leader_election.cc:336] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:06.691856 10965 leader_election.cc:336] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:18:06.692301 10965 leader_election.cc:304] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:18:06.693300 16879 raft_consensus.cc:2749] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:06.698546  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:06.699680  9147 tablet_replica.cc:333] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.700642  9147 raft_consensus.cc:2243] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.701786  9147 raft_consensus.cc:2272] T 02c8de49bce9468ca25de2106e6f0a37 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.704698  9147 tablet_replica.cc:333] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.705506  9147 raft_consensus.cc:2243] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:18:06.705832 10965 consensus_peers.cc:597] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.707069  9147 raft_consensus.cc:2272] T fc16ee0241da48fa9ae8e1e3705b673b P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.709877  9147 tablet_replica.cc:333] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.710732  9147 raft_consensus.cc:2243] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.711351  9147 raft_consensus.cc:2272] T 8898babdb91e46acafbe4314671b54fa P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.714002  9147 tablet_replica.cc:333] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.714847  9147 raft_consensus.cc:2243] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.715711  9147 raft_consensus.cc:2272] T dfa0864627e04e0284664cff47040bf9 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.718699  9147 tablet_replica.cc:333] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.719506  9147 raft_consensus.cc:2243] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.720454  9147 raft_consensus.cc:2272] T 8b11f92960bc4c35a7a06623da846cc3 P 73825599c2644b898cebaafbccd86e99 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.723042  9147 tablet_replica.cc:333] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.723832  9147 raft_consensus.cc:2243] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.724458  9147 raft_consensus.cc:2272] T 6a75ec4911bc4e9188e70ee560a67a72 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.727087  9147 tablet_replica.cc:333] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.727873  9147 raft_consensus.cc:2243] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.728924  9147 raft_consensus.cc:2272] T 6bab3992733148c582649aac71356232 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.731455  9147 tablet_replica.cc:333] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.732260  9147 raft_consensus.cc:2243] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.732831  9147 raft_consensus.cc:2272] T 9187284d595443aab84a71601d6fe9ea P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.735507  9147 tablet_replica.cc:333] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.736277  9147 raft_consensus.cc:2243] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.737321  9147 raft_consensus.cc:2272] T b37304bb0f7f411e935e8784db513f5a P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.740000  9147 tablet_replica.cc:333] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.740772  9147 raft_consensus.cc:2243] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.741904  9147 raft_consensus.cc:2272] T 7df30c54c90e4fcfaeb14736ccbcec7c P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.744560  9147 tablet_replica.cc:333] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.745398  9147 raft_consensus.cc:2243] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.746270  9147 raft_consensus.cc:2272] T 0f1231f6d6fa45119f3f855900d3113b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.749083  9147 tablet_replica.cc:333] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.749863  9147 raft_consensus.cc:2243] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.750882  9147 raft_consensus.cc:2272] T a07acf0009094d989235d04de13c6c2e P 73825599c2644b898cebaafbccd86e99 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.753705  9147 tablet_replica.cc:333] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.754469  9147 raft_consensus.cc:2243] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.755312  9147 raft_consensus.cc:2272] T f26aceb684204af4b9a75341f4d72c53 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.757373  9147 tablet_replica.cc:333] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.757987  9147 raft_consensus.cc:2243] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.760550  9147 raft_consensus.cc:2272] T ee5a9192e938463ea07352f70853ef2e P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.763293  9147 tablet_replica.cc:333] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.764001  9147 raft_consensus.cc:2243] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.764744  9147 raft_consensus.cc:2272] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.767783  9147 tablet_replica.cc:333] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.768638  9147 raft_consensus.cc:2243] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.769728  9147 raft_consensus.cc:2272] T 07abdf4bb17f4efd8947745de6c71c1d P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.769958 10965 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.772445  9147 tablet_replica.cc:333] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.773415  9147 raft_consensus.cc:2243] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.774281  9147 raft_consensus.cc:2272] T 54badd91404d4f7894752c8769345dca P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.776264  9147 tablet_replica.cc:333] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.776878  9147 raft_consensus.cc:2243] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.777740  9147 raft_consensus.cc:2272] T 477291c1a9554fecabe56380eefe7c94 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.780349  9147 tablet_replica.cc:333] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.780937  9147 raft_consensus.cc:2243] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.781950  9147 raft_consensus.cc:2272] T ecab1d1cb33f4578870d0cf2888cf76e P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.784271  9147 tablet_replica.cc:333] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.784829  9147 raft_consensus.cc:2243] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.785564  9147 raft_consensus.cc:2272] T 5315e843bcf14730b0299b712eab40d0 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.787995  9147 tablet_replica.cc:333] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.788806  9147 raft_consensus.cc:2243] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.789848  9147 raft_consensus.cc:2272] T 525196bf91b04b748ae03b3fac9f4364 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.791419 10965 consensus_peers.cc:597] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.792744  9147 tablet_replica.cc:333] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.793533  9147 raft_consensus.cc:2243] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:06.794335 10965 consensus_peers.cc:597] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.794673  9147 raft_consensus.cc:2272] T 23ce7c1f0ea74a808f62e7870ca8579f P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.796694  9147 tablet_replica.cc:333] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.797291  9147 raft_consensus.cc:2243] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.797868  9147 raft_consensus.cc:2272] T fc4f8110c14b45cdadf9a53a149c8fdf P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.799759  9147 tablet_replica.cc:333] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.800316  9147 raft_consensus.cc:2243] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.800798  9147 raft_consensus.cc:2272] T 69ce991d35f4413e82e03d5416c73bf2 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.802884  9147 tablet_replica.cc:333] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.803574  9147 raft_consensus.cc:2243] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.804174  9147 raft_consensus.cc:2272] T c20e8be888d84cbf954ad2041699a03d P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.806756  9147 tablet_replica.cc:333] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.807550  9147 raft_consensus.cc:2243] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.808439  9147 raft_consensus.cc:2272] T 5235584cc4374dbcbe419cad1b3b9226 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.810431  9147 tablet_replica.cc:333] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.810992  9147 raft_consensus.cc:2243] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.811480  9147 raft_consensus.cc:2272] T 4ae4445ee896464a9b9905cf5ca48e67 P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.813407  9147 tablet_replica.cc:333] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.813994  9147 raft_consensus.cc:2243] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.814915  9147 raft_consensus.cc:2272] T 0ed60181ed2d4e3782c0247f5c8a145f P 73825599c2644b898cebaafbccd86e99 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.816907  9147 tablet_replica.cc:333] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.817449  9147 raft_consensus.cc:2243] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.818359  9147 raft_consensus.cc:2272] T 4810a67dfa984af6aa1dfcfc1ad2cc29 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.820267  9147 tablet_replica.cc:333] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.820837  9147 raft_consensus.cc:2243] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.821328  9147 raft_consensus.cc:2272] T 38076f481679473aac7854c07b22e381 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.823244  9147 tablet_replica.cc:333] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.823782  9147 raft_consensus.cc:2243] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.825479  9147 raft_consensus.cc:2272] T ebb1d9c88bdd4df9942232a578267aa6 P 73825599c2644b898cebaafbccd86e99 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.827649  9147 tablet_replica.cc:333] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.828333  9147 raft_consensus.cc:2243] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.828971  9147 raft_consensus.cc:2272] T 2181b7acaa904976917e2c58bc8856c3 P 73825599c2644b898cebaafbccd86e99 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.831410  9147 tablet_replica.cc:333] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.832213  9147 raft_consensus.cc:2243] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.832721  9147 raft_consensus.cc:2272] T 976ea23dd44047a6adc91ad78f34fa79 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.835289  9147 tablet_replica.cc:333] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.836066  9147 raft_consensus.cc:2243] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.836751  9147 raft_consensus.cc:2272] T a6d7bac4863c4b958392d525cba4f98b P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.839171  9147 tablet_replica.cc:333] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.839737  9147 raft_consensus.cc:2243] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.840555  9147 raft_consensus.cc:2272] T 7b0293dc4ca94845b6d1f8991514db3e P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.842962  9147 tablet_replica.cc:333] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.843691  9147 raft_consensus.cc:2243] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.844358  9147 raft_consensus.cc:2272] T 75f247057a16492c8757cbf337e8b240 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.847091  9147 tablet_replica.cc:333] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.847831  9147 raft_consensus.cc:2243] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.848471  9147 raft_consensus.cc:2272] T 15565c698f45442aa353abbe927bfc68 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.851121  9147 tablet_replica.cc:333] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.851857  9147 raft_consensus.cc:2243] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:18:06.852347 10967 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:18:06.852828  9147 raft_consensus.cc:2272] T 1f4dd97a92804cc6927c6fff64d16f39 P 73825599c2644b898cebaafbccd86e99 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.854931  9147 tablet_replica.cc:333] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.855494  9147 raft_consensus.cc:2243] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.856029  9147 raft_consensus.cc:2272] T bb19b1ef417a439c833c0b7627cf7c00 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.858062  9147 tablet_replica.cc:333] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.858671  9147 raft_consensus.cc:2243] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.859212  9147 raft_consensus.cc:2272] T d97c1a2214d54cff9377d68a3d00054b P 73825599c2644b898cebaafbccd86e99 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.861161  9147 tablet_replica.cc:333] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.861738  9147 raft_consensus.cc:2243] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.862192  9147 raft_consensus.cc:2272] T bdf450e3110e486088b3d5c7e2c7cef7 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.864224  9147 tablet_replica.cc:333] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.864765  9147 raft_consensus.cc:2243] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.865294  9147 raft_consensus.cc:2272] T f892a371a6e2431ab5718daa82f2b02e P 73825599c2644b898cebaafbccd86e99 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.867645  9147 tablet_replica.cc:333] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.868280  9147 raft_consensus.cc:2243] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.869328  9147 raft_consensus.cc:2272] T 8b4768f1c2494e8e91598dcb7cfa3556 P 73825599c2644b898cebaafbccd86e99 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.871662 10967 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:06.873675  9147 tablet_replica.cc:333] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.874425  9147 raft_consensus.cc:2243] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.874915  9147 raft_consensus.cc:2272] T 4262070044b6403dbc7cebd32cfebe0c P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.876878  9147 tablet_replica.cc:333] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.877403  9147 raft_consensus.cc:2243] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:06.878067  9147 pending_rounds.cc:70] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Trying to abort 1 pending ops.
I20260709 13:18:06.878357  9147 pending_rounds.cc:77] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99: Aborting op as it isn't in flight: id { term: 18 index: 16 } timestamp: 7305638242203652096 op_type: NO_OP noop_request { }
I20260709 13:18:06.878728  9147 raft_consensus.cc:2889] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:06.879009  9147 raft_consensus.cc:2272] T 07947046eb9e42ae8ccb9083210f95f0 P 73825599c2644b898cebaafbccd86e99 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.881956  9147 tablet_replica.cc:333] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
I20260709 13:18:06.882575  9147 raft_consensus.cc:2243] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.883560  9147 raft_consensus.cc:2272] T 19b05041c6f947c3bf56f4fc003bfabb P 73825599c2644b898cebaafbccd86e99 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:06.886198  9147 tablet_replica.cc:333] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99: stopping tablet replica
W20260709 13:18:06.886127 10965 consensus_peers.cc:597] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:06.887065  9147 raft_consensus.cc:2243] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:06.887646  9147 raft_consensus.cc:2272] T 62fd7f6040dd4ff1b75922910732a441 P 73825599c2644b898cebaafbccd86e99 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:06.960490 10967 consensus_peers.cc:597] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:06.962774 10965 consensus_peers.cc:597] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.963981 10363 connection.cc:466] server connection from 127.0.0.1:38154 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38154 (request call id 1954) could send its response
W20260709 13:18:06.964880 10965 consensus_peers.cc:597] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Network error: recv got EOF from 127.8.238.195:40329 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.974880 10965 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.979678 10965 consensus_peers.cc:597] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:06.984898 10965 consensus_peers.cc:597] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:07.015718 10965 consensus_peers.cc:597] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:07.059185 10965 consensus_peers.cc:597] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:07.147338 10965 consensus_peers.cc:597] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Couldn't send request to peer 73825599c2644b898cebaafbccd86e99. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:07.227289 10967 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Couldn't send request to peer ab33f0a79ddf4f5a8ba81b3b0e120529. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:07.270804 10965 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111) [suppressed 561 similar messages]
W20260709 13:18:07.376503 10965 consensus_peers.cc:597] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.431223 10965 consensus_peers.cc:597] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.443892 10965 consensus_peers.cc:597] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.475164 10965 consensus_peers.cc:597] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.485044 10965 consensus_peers.cc:597] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.573001  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
W20260709 13:18:07.641759 10965 consensus_peers.cc:597] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.651721 10965 consensus_peers.cc:597] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.660578 10965 consensus_peers.cc:597] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.666946 10965 consensus_peers.cc:597] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:07.676671 10965 consensus_peers.cc:597] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.683779  9147 tablet_server.cc:179] TabletServer@127.8.238.196:0 shutting down...
I20260709 13:18:07.734375  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:07.735212  9147 tablet_replica.cc:333] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.735975  9147 raft_consensus.cc:2243] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.737032  9147 pending_rounds.cc:70] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Trying to abort 1 pending ops.
I20260709 13:18:07.737267  9147 pending_rounds.cc:77] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305638242475290624 op_type: NO_OP noop_request { }
I20260709 13:18:07.737608  9147 raft_consensus.cc:2889] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:07.737911  9147 raft_consensus.cc:2272] T 19b05041c6f947c3bf56f4fc003bfabb P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.740260  9147 tablet_replica.cc:333] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.740974  9147 raft_consensus.cc:2243] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.741541  9147 raft_consensus.cc:2272] T 8b11f92960bc4c35a7a06623da846cc3 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.743927  9147 tablet_replica.cc:333] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.744596  9147 raft_consensus.cc:2243] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.745194  9147 raft_consensus.cc:2272] T fc16ee0241da48fa9ae8e1e3705b673b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.747565  9147 tablet_replica.cc:333] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.748270  9147 raft_consensus.cc:2243] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.749373  9147 raft_consensus.cc:2272] T 5315e843bcf14730b0299b712eab40d0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.752184  9147 tablet_replica.cc:333] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.752964  9147 raft_consensus.cc:2243] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.753755  9147 raft_consensus.cc:2272] T dc2db78b356a4f57af63adec3766d44b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.756440  9147 tablet_replica.cc:333] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.757128  9147 raft_consensus.cc:2243] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.757674  9147 raft_consensus.cc:2272] T 7b0293dc4ca94845b6d1f8991514db3e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.760047  9147 tablet_replica.cc:333] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.760753  9147 raft_consensus.cc:2243] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.761272  9147 raft_consensus.cc:2272] T 5db7cef2154f4a63901d966c49530263 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.764034  9147 tablet_replica.cc:333] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.764863  9147 raft_consensus.cc:2243] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.765482  9147 raft_consensus.cc:2272] T 6bab3992733148c582649aac71356232 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.768203  9147 tablet_replica.cc:333] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.768805  9147 raft_consensus.cc:2243] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.769682  9147 raft_consensus.cc:2272] T bdf450e3110e486088b3d5c7e2c7cef7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.772528  9147 tablet_replica.cc:333] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.773200  9147 raft_consensus.cc:2243] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:07.773200 10965 consensus_peers.cc:597] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 -> Peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Couldn't send request to peer cb71def93f904f619a1527aa48a32294. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:07.774029  9147 raft_consensus.cc:2272] T 07947046eb9e42ae8ccb9083210f95f0 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.776408  9147 tablet_replica.cc:333] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.777032  9147 raft_consensus.cc:2243] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.777827  9147 raft_consensus.cc:2272] T cfd747d82d6d447e9c04851a4163a863 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.779933  9147 tablet_replica.cc:333] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.780628  9147 raft_consensus.cc:2243] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.781461  9147 raft_consensus.cc:2272] T 4ae4445ee896464a9b9905cf5ca48e67 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.783601  9147 tablet_replica.cc:333] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.784195  9147 raft_consensus.cc:2243] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.784909  9147 raft_consensus.cc:2272] T 75f247057a16492c8757cbf337e8b240 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.787032  9147 tablet_replica.cc:333] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.787616  9147 raft_consensus.cc:2243] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.788136  9147 raft_consensus.cc:2272] T 23ce7c1f0ea74a808f62e7870ca8579f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.790414  9147 tablet_replica.cc:333] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.791003  9147 raft_consensus.cc:2243] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.793972  9147 raft_consensus.cc:2272] T 69ce991d35f4413e82e03d5416c73bf2 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.796164  9147 tablet_replica.cc:333] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.796763  9147 raft_consensus.cc:2243] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.797302  9147 raft_consensus.cc:2272] T 5235584cc4374dbcbe419cad1b3b9226 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.799558  9147 tablet_replica.cc:333] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.800257  9147 raft_consensus.cc:2243] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.801196  9147 raft_consensus.cc:2272] T 58bcaf2ee2cb4badb447e0a27855aaf6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.803454  9147 tablet_replica.cc:333] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.804039  9147 raft_consensus.cc:2243] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.804785  9147 raft_consensus.cc:2272] T 3955117b87304f9c9123136a32ea1aa8 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.806993  9147 tablet_replica.cc:333] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.807603  9147 raft_consensus.cc:2243] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.808118  9147 raft_consensus.cc:2272] T 0ed60181ed2d4e3782c0247f5c8a145f P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.810338  9147 tablet_replica.cc:333] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.810935  9147 raft_consensus.cc:2243] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.811641  9147 raft_consensus.cc:2272] T 15565c698f45442aa353abbe927bfc68 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.813758  9147 tablet_replica.cc:333] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.814393  9147 raft_consensus.cc:2243] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.814888 16881 raft_consensus.cc:493] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:18:07.815318 16881 raft_consensus.cc:515] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "cb71def93f904f619a1527aa48a32294" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44995 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:07.816366  9147 raft_consensus.cc:2272] T 1f4dd97a92804cc6927c6fff64d16f39 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.817214 16881 leader_election.cc:290] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:07.819413  9147 tablet_replica.cc:333] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.820808  9147 raft_consensus.cc:2243] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.821825  9147 raft_consensus.cc:2272] T bb19b1ef417a439c833c0b7627cf7c00 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.824412  9147 tablet_replica.cc:333] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.824985  9147 raft_consensus.cc:2243] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.825555  9147 raft_consensus.cc:2272] T 7df30c54c90e4fcfaeb14736ccbcec7c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.828359  9147 tablet_replica.cc:333] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.829124  9147 raft_consensus.cc:2243] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.829803  9147 raft_consensus.cc:2272] T f892a371a6e2431ab5718daa82f2b02e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:07.830169 10965 leader_election.cc:336] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
W20260709 13:18:07.830889 10965 leader_election.cc:336] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111)
I20260709 13:18:07.831296 10965 leader_election.cc:304] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, cb71def93f904f619a1527aa48a32294
I20260709 13:18:07.832098 16881 raft_consensus.cc:2749] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.832417  9147 tablet_replica.cc:333] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.833223  9147 raft_consensus.cc:2243] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.834182  9147 pending_rounds.cc:70] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Trying to abort 1 pending ops.
I20260709 13:18:07.834453  9147 pending_rounds.cc:77] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04: Aborting op as it isn't in flight: id { term: 18 index: 15 } timestamp: 7305638241367752704 op_type: NO_OP noop_request { }
I20260709 13:18:07.834757  9147 raft_consensus.cc:2889] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:07.835093  9147 raft_consensus.cc:2272] T 9187284d595443aab84a71601d6fe9ea P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.836233 16881 raft_consensus.cc:493] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73825599c2644b898cebaafbccd86e99)
I20260709 13:18:07.836805 16881 raft_consensus.cc:515] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ab33f0a79ddf4f5a8ba81b3b0e120529" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 40671 } } peers { permanent_uuid: "73825599c2644b898cebaafbccd86e99" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 40329 } } peers { permanent_uuid: "72a1fe75b2bc4fb698d13f9d0b2dda04" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35437 } attrs { promote: false } }
I20260709 13:18:07.837888  9147 tablet_replica.cc:333] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.838766  9147 raft_consensus.cc:2243] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.839175 16881 leader_election.cc:290] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671), 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329)
I20260709 13:18:07.839825  9147 raft_consensus.cc:2272] T e6fa99a4824140528f1f002c969d567c P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.842835  9147 tablet_replica.cc:333] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.843636  9147 raft_consensus.cc:2243] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:18:07.843564 10965 leader_election.cc:336] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 73825599c2644b898cebaafbccd86e99 (127.8.238.195:40329): Network error: Client connection negotiation failed: client connection to 127.8.238.195:40329: connect: Connection refused (error 111)
I20260709 13:18:07.844799  9147 raft_consensus.cc:2272] T 002cc8ee6e9043929d5cd5532317aab7 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.847028  9147 tablet_replica.cc:333] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.847649  9147 raft_consensus.cc:2243] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.848357  9147 raft_consensus.cc:2272] T d97c1a2214d54cff9377d68a3d00054b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.850543  9147 tablet_replica.cc:333] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.851114  9147 raft_consensus.cc:2243] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.851657  9147 raft_consensus.cc:2272] T ee5a9192e938463ea07352f70853ef2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:07.853009 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.854326  9147 tablet_replica.cc:333] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.854945  9147 raft_consensus.cc:2243] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.855512  9147 raft_consensus.cc:2272] T ebb1d9c88bdd4df9942232a578267aa6 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:07.858683 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.860697  9147 tablet_replica.cc:333] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.861363  9147 raft_consensus.cc:2243] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.861956  9147 raft_consensus.cc:2272] T 67d43312af804527af89708edfbd9177 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.864221  9147 tablet_replica.cc:333] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.864820  9147 raft_consensus.cc:2243] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.865566  9147 raft_consensus.cc:2272] T ab10f00e071642849d7b7c7d29ee29ee P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.867733  9147 tablet_replica.cc:333] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.868297  9147 raft_consensus.cc:2243] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.868788  9147 raft_consensus.cc:2272] T 16f38b8c79f844dc83f9505884422f2a P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.870970  9147 tablet_replica.cc:333] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.871522  9147 raft_consensus.cc:2243] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.872030  9147 raft_consensus.cc:2272] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.874053  9147 tablet_replica.cc:333] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.874696  9147 raft_consensus.cc:2243] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.875483  9147 raft_consensus.cc:2272] T 0ebd7b007a9b4c7eaa47f51eaea905b9 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.877810  9147 tablet_replica.cc:333] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.878412  9147 raft_consensus.cc:2243] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.879122  9147 raft_consensus.cc:2272] T 1667c24c31044f708dc4fcc524ea924d P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.881150  9147 tablet_replica.cc:333] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.883649  9147 raft_consensus.cc:2243] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.884533  9147 raft_consensus.cc:2272] T 976ea23dd44047a6adc91ad78f34fa79 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.886643  9147 tablet_replica.cc:333] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.887204  9147 raft_consensus.cc:2243] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.887843  9147 raft_consensus.cc:2272] T f26aceb684204af4b9a75341f4d72c53 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.889959  9147 tablet_replica.cc:333] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.890527  9147 raft_consensus.cc:2243] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.891065  9147 raft_consensus.cc:2272] T 0de4147226834030b0fd22d4a0948990 P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.893124  9147 tablet_replica.cc:333] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04: stopping tablet replica
I20260709 13:18:07.893618  9147 raft_consensus.cc:2243] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.894411  9147 raft_consensus.cc:2272] T a6d7bac4863c4b958392d525cba4f98b P 72a1fe75b2bc4fb698d13f9d0b2dda04 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:07.914114 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.935895 10966 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.936645 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.980324 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.032778 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.033912 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.037732 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.080569 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.129858 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.160267 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.162381 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.184413 10967 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.246796 10968 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.267253 10965 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.287345 10967 leader_election.cc:336] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:18:08.287828 10967 leader_election.cc:304] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72a1fe75b2bc4fb698d13f9d0b2dda04; no voters: 73825599c2644b898cebaafbccd86e99, ab33f0a79ddf4f5a8ba81b3b0e120529
W20260709 13:18:08.288486 10967 raft_consensus.cc:2686] T a07acf0009094d989235d04de13c6c2e P 72a1fe75b2bc4fb698d13f9d0b2dda04: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:08.570739  9147 tablet_server.cc:196] TabletServer@127.8.238.196:0 shutdown complete.
I20260709 13:18:08.642624  9147 master.cc:562] Master@127.8.238.254:38317 shutting down...
W20260709 13:18:08.674379 10196 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:18:08.674747 10196 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:08.674994 10196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:11.826295 10134 catalog_manager.cc:4755] TS ab33f0a79ddf4f5a8ba81b3b0e120529 (127.8.238.193:40671): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 19b05041c6f947c3bf56f4fc003bfabb: Network error: Client connection negotiation failed: client connection to 127.8.238.193:40671: connect: Connection refused (error 111)
W20260709 13:18:36.080147 10179 debug-util.cc:398] Leaking SignalData structure 0x7b0800254c80 after lost signal to thread 9150
W20260709 13:18:36.080753 10179 debug-util.cc:398] Leaking SignalData structure 0x7b080008ed20 after lost signal to thread 10182
W20260709 13:18:58.656764 10132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111) [suppressed 49 similar messages]
W20260709 13:18:58.660903 10132 catalog_manager.cc:4755] TS cb71def93f904f619a1527aa48a32294 (127.8.238.194:44995): ChangeConfig:REMOVE_PEER RPC failed for tablet 23ce7c1f0ea74a808f62e7870ca8579f: Network error: Client connection negotiation failed: client connection to 127.8.238.194:44995: connect: Connection refused (error 111)
I20260709 13:19:00.158278  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.159391  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.159799  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P 07026dacaf3c454eb902b449c5c122fe: stopping tablet replica
I20260709 13:19:00.527689  9147 master.cc:584] Master@127.8.238.254:38317 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (267739 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:00.651337  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:34437
I20260709 13:19:00.652551  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:00.658545 16901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.659658 16902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.660282 16904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:00.661027  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:00.664114  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:00.664335  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:00.664536  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603140664503 us; error 0 us; skew 500 ppm
I20260709 13:19:00.665117  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:00.667977  9147 webserver.cc:533] Webserver started at http://127.8.238.254:45547/ using document root <none> and password file <none>
I20260709 13:19:00.668520  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:00.668720  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:00.669013  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:00.670397  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "93aeba2e37ba4851be7f4a4571bf4248"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-ml7r"
I20260709 13:19:00.675107  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:19:00.678776 16909 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.679571  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:19:00.680099  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "93aeba2e37ba4851be7f4a4571bf4248"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-ml7r"
I20260709 13:19:00.680399  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:00.716193  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:00.717548  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:00.757503  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:34437
I20260709 13:19:00.757602 16960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:34437 every 8 connection(s)
I20260709 13:19:00.761932 16961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:00.773979 16961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248: Bootstrap starting.
I20260709 13:19:00.779073 16961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.783773 16961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248: No bootstrap required, opened a new log
I20260709 13:19:00.786023 16961 raft_consensus.cc:359] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93aeba2e37ba4851be7f4a4571bf4248" member_type: VOTER }
I20260709 13:19:00.786623 16961 raft_consensus.cc:385] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.786818 16961 raft_consensus.cc:740] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aeba2e37ba4851be7f4a4571bf4248, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.787424 16961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93aeba2e37ba4851be7f4a4571bf4248" member_type: VOTER }
I20260709 13:19:00.787928 16961 raft_consensus.cc:399] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:00.788192 16961 raft_consensus.cc:493] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:00.788472 16961 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.793262 16961 raft_consensus.cc:515] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93aeba2e37ba4851be7f4a4571bf4248" member_type: VOTER }
I20260709 13:19:00.793838 16961 leader_election.cc:304] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93aeba2e37ba4851be7f4a4571bf4248; no voters: 
I20260709 13:19:00.795059 16961 leader_election.cc:290] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:00.795595 16964 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.797135 16964 raft_consensus.cc:697] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 1 LEADER]: Becoming Leader. State: Replica: 93aeba2e37ba4851be7f4a4571bf4248, State: Running, Role: LEADER
I20260709 13:19:00.797946 16964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93aeba2e37ba4851be7f4a4571bf4248" member_type: VOTER }
I20260709 13:19:00.798197 16961 sys_catalog.cc:565] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:00.806720 16966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93aeba2e37ba4851be7f4a4571bf4248. Latest consensus state: current_term: 1 leader_uuid: "93aeba2e37ba4851be7f4a4571bf4248" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93aeba2e37ba4851be7f4a4571bf4248" member_type: VOTER } }
I20260709 13:19:00.806998 16965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93aeba2e37ba4851be7f4a4571bf4248" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93aeba2e37ba4851be7f4a4571bf4248" member_type: VOTER } }
I20260709 13:19:00.807485 16966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:00.807768 16965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:00.809494 16974 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:00.815425 16974 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:00.816442  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:00.825212 16974 catalog_manager.cc:1383] Generated new cluster ID: 61c334f6349946ef98b3874678f98ec8
I20260709 13:19:00.825536 16974 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:00.847095 16974 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:00.848435 16974 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:00.863042 16974 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248: Generated new TSK 0
I20260709 13:19:00.863729 16974 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:00.883317  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:00.889638 16982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.890836 16983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:00.892329 16985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:00.893195  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:00.895841  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:00.896059  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:00.896195  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603140896182 us; error 0 us; skew 500 ppm
I20260709 13:19:00.896716  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:00.899242  9147 webserver.cc:533] Webserver started at http://127.8.238.193:34707/ using document root <none> and password file <none>
I20260709 13:19:00.899843  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:00.900053  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:00.900344  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:00.901474  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "16794c032a6645e2b267583ad59c9572"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-ml7r"
I20260709 13:19:00.906194  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:00.909888 16990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.910781  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:00.911178  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "16794c032a6645e2b267583ad59c9572"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-ml7r"
I20260709 13:19:00.911470  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:00.924697  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:00.926000  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:00.927598  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:00.930154  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:00.930488  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.930776  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:00.930968  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:00.984086  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:46481
I20260709 13:19:00.984190 17052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:46481 every 8 connection(s)
I20260709 13:19:00.989769  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:01.000008 17057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.002830 17058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.004170  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:01.006062 17061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.007423  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:01.007681  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:01.007864  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603141007845 us; error 0 us; skew 500 ppm
I20260709 13:19:01.008436  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:01.011139  9147 webserver.cc:533] Webserver started at http://127.8.238.194:45589/ using document root <none> and password file <none>
I20260709 13:19:01.011730  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:01.011988  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:01.012322  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:01.013985  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "1364e853d9ea4df1950346fb170498b8"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-ml7r"
I20260709 13:19:01.014667 17053 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34437
I20260709 13:19:01.015081 17053 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:01.015892 17053 heartbeater.cc:507] Master 127.8.238.254:34437 requested a full tablet report, sending...
I20260709 13:19:01.018375 16926 ts_manager.cc:194] Registered new tserver with Master: 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:01.019606  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:01.021039 16926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54124
I20260709 13:19:01.024544 17065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.025408  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:19:01.025748  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "1364e853d9ea4df1950346fb170498b8"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-ml7r"
I20260709 13:19:01.026049  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:01.041942  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:01.043303  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:01.044819  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:01.047259  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:01.047510  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.047756  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:01.047922  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.090778  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:38593
I20260709 13:19:01.090888 17127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:38593 every 8 connection(s)
I20260709 13:19:01.096143  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:01.104327 17131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.106071 17132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.108048  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:01.108976 17134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.109987 17128 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34437
I20260709 13:19:01.110178  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:01.110463 17128 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:01.110596  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:01.110939  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603141110922 us; error 0 us; skew 500 ppm
I20260709 13:19:01.111481 17128 heartbeater.cc:507] Master 127.8.238.254:34437 requested a full tablet report, sending...
I20260709 13:19:01.111541  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:01.113850 16926 ts_manager.cc:194] Registered new tserver with Master: 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:01.114850  9147 webserver.cc:533] Webserver started at http://127.8.238.195:46877/ using document root <none> and password file <none>
I20260709 13:19:01.115422  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:01.115398 16926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54140
I20260709 13:19:01.115886  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:01.116226  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:01.117431  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "896fb6e3b27e4874a469245a7b103111"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-ml7r"
I20260709 13:19:01.122117  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:19:01.125912 17139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.126946  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:01.127303  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "896fb6e3b27e4874a469245a7b103111"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-ml7r"
I20260709 13:19:01.127592  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:01.138218  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:01.139915  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:01.141501  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:01.143942  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:01.144165  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.144456  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:01.144620  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.187292  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:36971
I20260709 13:19:01.187402 17201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:36971 every 8 connection(s)
I20260709 13:19:01.192823  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:01.200420 17205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:01.201067 17206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.204203  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:01.204747 17208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:01.205631 17202 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34437
I20260709 13:19:01.206023  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:01.206104 17202 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:01.206460  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:01.206696  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603141206666 us; error 0 us; skew 500 ppm
I20260709 13:19:01.207257 17202 heartbeater.cc:507] Master 127.8.238.254:34437 requested a full tablet report, sending...
I20260709 13:19:01.207523  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:01.209839 16926 ts_manager.cc:194] Registered new tserver with Master: 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:01.210530  9147 webserver.cc:533] Webserver started at http://127.8.238.196:36259/ using document root <none> and password file <none>
I20260709 13:19:01.211159  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:01.211383  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:01.211527 16926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54150
I20260709 13:19:01.211663  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:01.213235  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-3-root/instance:
uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-ml7r"
I20260709 13:19:01.217942  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:19:01.221707 17213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.222680  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:19:01.223081  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-3-root
uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
format_stamp: "Formatted at 2026-07-09 13:19:01 on dist-test-slave-ml7r"
I20260709 13:19:01.223361  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:01.239609  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:01.240877  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:01.242409  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:01.244769  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:01.244966  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.245298  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:01.245463  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:01.289383  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.196:35033
I20260709 13:19:01.289486 17275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.196:35033 every 8 connection(s)
I20260709 13:19:01.304322 17276 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34437
I20260709 13:19:01.304787 17276 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:01.305794 17276 heartbeater.cc:507] Master 127.8.238.254:34437 requested a full tablet report, sending...
I20260709 13:19:01.307966 16926 ts_manager.cc:194] Registered new tserver with Master: f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:01.308148  9147 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015597932s
I20260709 13:19:01.309942 16926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54154
I20260709 13:19:01.336752 16926 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54160:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:01.596108 17167 tablet_service.cc:1511] Processing CreateTablet for tablet 098e645055dd449c91b9fe4481f66aa6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:01.597812 17167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098e645055dd449c91b9fe4481f66aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.598556 17163 tablet_service.cc:1511] Processing CreateTablet for tablet a1d7f3735ebc41f691fbce7d2c33ab12 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:01.599735 17166 tablet_service.cc:1511] Processing CreateTablet for tablet 359d72c1f10442b9819867ccdde73870 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:01.600386 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d7f3735ebc41f691fbce7d2c33ab12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.601212 17166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359d72c1f10442b9819867ccdde73870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.605312 17162 tablet_service.cc:1511] Processing CreateTablet for tablet 8397c824876e4947a125624f56c2501d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:01.607060 17162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8397c824876e4947a125624f56c2501d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.607514 17165 tablet_service.cc:1511] Processing CreateTablet for tablet 618435fe625b47de9afd290384ff676e (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:01.610669 17164 tablet_service.cc:1511] Processing CreateTablet for tablet e7434c84892a4b8ba1c3985992fa5747 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:01.611307 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618435fe625b47de9afd290384ff676e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.612244 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7434c84892a4b8ba1c3985992fa5747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.622066 17161 tablet_service.cc:1511] Processing CreateTablet for tablet 41adc375fb524f19b4a65524c5f78041 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:01.623749 17161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41adc375fb524f19b4a65524c5f78041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.626432 17092 tablet_service.cc:1511] Processing CreateTablet for tablet e7ff634467f042329ddeb7a8af515f56 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:01.628090 17092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ff634467f042329ddeb7a8af515f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.632134 17091 tablet_service.cc:1511] Processing CreateTablet for tablet 618435fe625b47de9afd290384ff676e (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:01.632558 17093 tablet_service.cc:1511] Processing CreateTablet for tablet 359d72c1f10442b9819867ccdde73870 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:01.633744 17091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618435fe625b47de9afd290384ff676e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.634532 17093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359d72c1f10442b9819867ccdde73870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.636602 17090 tablet_service.cc:1511] Processing CreateTablet for tablet e7434c84892a4b8ba1c3985992fa5747 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:01.638094 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7434c84892a4b8ba1c3985992fa5747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.650727 17160 tablet_service.cc:1511] Processing CreateTablet for tablet 86b2b5c741884596ad46b33b32c725d3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:01.652287 17160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b2b5c741884596ad46b33b32c725d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.653795 17296 tablet_bootstrap.cc:492] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:01.641042 17088 tablet_service.cc:1511] Processing CreateTablet for tablet 8397c824876e4947a125624f56c2501d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:01.655953 17088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8397c824876e4947a125624f56c2501d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.657052 17241 tablet_service.cc:1511] Processing CreateTablet for tablet 098e645055dd449c91b9fe4481f66aa6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:01.639582 17089 tablet_service.cc:1511] Processing CreateTablet for tablet 727d16a19f284201998350af3f7ebcdc (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:01.659413 17089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727d16a19f284201998350af3f7ebcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.659564 17240 tablet_service.cc:1511] Processing CreateTablet for tablet e7ff634467f042329ddeb7a8af515f56 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:01.661067 17240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ff634467f042329ddeb7a8af515f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.642417 17087 tablet_service.cc:1511] Processing CreateTablet for tablet 41adc375fb524f19b4a65524c5f78041 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:01.663210 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 8d22686aaba74b978f567f111d0cee28 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:01.663530 17239 tablet_service.cc:1511] Processing CreateTablet for tablet 618435fe625b47de9afd290384ff676e (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:01.664196 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41adc375fb524f19b4a65524c5f78041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.664909 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d22686aaba74b978f567f111d0cee28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.665059 17239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618435fe625b47de9afd290384ff676e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.667548 17238 tablet_service.cc:1511] Processing CreateTablet for tablet 727d16a19f284201998350af3f7ebcdc (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:01.669025 17238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727d16a19f284201998350af3f7ebcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.671303 17236 tablet_service.cc:1511] Processing CreateTablet for tablet 8397c824876e4947a125624f56c2501d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:01.672827 17236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8397c824876e4947a125624f56c2501d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.675546 17237 tablet_service.cc:1511] Processing CreateTablet for tablet a1d7f3735ebc41f691fbce7d2c33ab12 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:01.677078 17237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d7f3735ebc41f691fbce7d2c33ab12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.682683 17241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098e645055dd449c91b9fe4481f66aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.684372 17085 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2ec9fe6964476aaa1dcb2b717a1660 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:01.685961 17085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2ec9fe6964476aaa1dcb2b717a1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.687853 17235 tablet_service.cc:1511] Processing CreateTablet for tablet 8d22686aaba74b978f567f111d0cee28 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:01.689647 17235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d22686aaba74b978f567f111d0cee28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.713711 17162 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2ec9fe6964476aaa1dcb2b717a1660 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:01.715365 17092 tablet_service.cc:1511] Processing CreateTablet for tablet 2155d9ece65f41eabe4ffb9dfd1671c3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:01.716859 17092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2155d9ece65f41eabe4ffb9dfd1671c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.718739 17015 tablet_service.cc:1511] Processing CreateTablet for tablet e7434c84892a4b8ba1c3985992fa5747 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:01.719553 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 098e645055dd449c91b9fe4481f66aa6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:01.720290 17015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7434c84892a4b8ba1c3985992fa5747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.715509 17162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2ec9fe6964476aaa1dcb2b717a1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.725800 17014 tablet_service.cc:1511] Processing CreateTablet for tablet 727d16a19f284201998350af3f7ebcdc (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:01.726168 17167 tablet_service.cc:1511] Processing CreateTablet for tablet 2155d9ece65f41eabe4ffb9dfd1671c3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:01.725832 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 86b2b5c741884596ad46b33b32c725d3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:01.770156 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b2b5c741884596ad46b33b32c725d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.727656 17016 tablet_service.cc:1511] Processing CreateTablet for tablet e7ff634467f042329ddeb7a8af515f56 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:01.729583 17013 tablet_service.cc:1511] Processing CreateTablet for tablet a1d7f3735ebc41f691fbce7d2c33ab12 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:01.733373 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 4c69155bc1714330b50c63899c8400fb (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:01.778450 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c69155bc1714330b50c63899c8400fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.736153 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2ec9fe6964476aaa1dcb2b717a1660 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:01.781419 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2ec9fe6964476aaa1dcb2b717a1660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.738337 17232 tablet_service.cc:1511] Processing CreateTablet for tablet 4c69155bc1714330b50c63899c8400fb (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:01.787182 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c69155bc1714330b50c63899c8400fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.738930 17017 tablet_service.cc:1511] Processing CreateTablet for tablet 359d72c1f10442b9819867ccdde73870 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:01.739357 17166 tablet_service.cc:1511] Processing CreateTablet for tablet 17b25597e8e2479b9bf69918cf1c0a02 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:01.746579 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098e645055dd449c91b9fe4481f66aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.747684 17084 tablet_service.cc:1511] Processing CreateTablet for tablet f5acc03bc88b41babf7cfbdf04fe0238 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:01.748837 17012 tablet_service.cc:1511] Processing CreateTablet for tablet 41adc375fb524f19b4a65524c5f78041 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:01.750161 17010 tablet_service.cc:1511] Processing CreateTablet for tablet 86b2b5c741884596ad46b33b32c725d3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:01.795202 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5acc03bc88b41babf7cfbdf04fe0238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.796221 17013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d7f3735ebc41f691fbce7d2c33ab12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.796974 17016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ff634467f042329ddeb7a8af515f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.751487 17011 tablet_service.cc:1511] Processing CreateTablet for tablet 8d22686aaba74b978f567f111d0cee28 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:01.797840 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41adc375fb524f19b4a65524c5f78041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.751981 17009 tablet_service.cc:1511] Processing CreateTablet for tablet 2155d9ece65f41eabe4ffb9dfd1671c3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:01.766036 17090 tablet_service.cc:1511] Processing CreateTablet for tablet e3d4b49dd94d4fa5bb066af8bd56d6e0 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:01.799629 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d4b49dd94d4fa5bb066af8bd56d6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.661059 17296 tablet_bootstrap.cc:654] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.776934 17158 tablet_service.cc:1511] Processing CreateTablet for tablet e3d4b49dd94d4fa5bb066af8bd56d6e0 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:01.791815 17167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2155d9ece65f41eabe4ffb9dfd1671c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.751334 17159 tablet_service.cc:1511] Processing CreateTablet for tablet f5acc03bc88b41babf7cfbdf04fe0238 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:01.798750 17014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 727d16a19f284201998350af3f7ebcdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.815037 17163 tablet_service.cc:1511] Processing CreateTablet for tablet 50c639a326f04d8d8eed7bd41bc8df2b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:01.816987 17087 tablet_service.cc:1511] Processing CreateTablet for tablet e31daec548cf48f6bedf21556ead46f6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:01.810765 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5acc03bc88b41babf7cfbdf04fe0238. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:01.812320 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:01.809482 17297 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:01.827323 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b2b5c741884596ad46b33b32c725d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.845211 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 17b25597e8e2479b9bf69918cf1c0a02 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:01.846678 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b25597e8e2479b9bf69918cf1c0a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.849998 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c639a326f04d8d8eed7bd41bc8df2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.851016 17158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d4b49dd94d4fa5bb066af8bd56d6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.854588 17297 tablet_bootstrap.cc:654] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.856542 17166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b25597e8e2479b9bf69918cf1c0a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.860734 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31daec548cf48f6bedf21556ead46f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.863817 17011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d22686aaba74b978f567f111d0cee28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.864650 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2155d9ece65f41eabe4ffb9dfd1671c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.873790 17164 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4ba9ad373e446b82700a8a82294225 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:01.875312 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4ba9ad373e446b82700a8a82294225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.881232 17239 tablet_service.cc:1511] Processing CreateTablet for tablet f5acc03bc88b41babf7cfbdf04fe0238 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:01.891165 17239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5acc03bc88b41babf7cfbdf04fe0238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.891060 17235 tablet_service.cc:1511] Processing CreateTablet for tablet e31daec548cf48f6bedf21556ead46f6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:01.892594 17235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31daec548cf48f6bedf21556ead46f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.907442 17091 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4ba9ad373e446b82700a8a82294225 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:01.909123 17091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4ba9ad373e446b82700a8a82294225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.914324 17240 tablet_service.cc:1511] Processing CreateTablet for tablet 50c639a326f04d8d8eed7bd41bc8df2b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:01.915829 17240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c639a326f04d8d8eed7bd41bc8df2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.915555 17092 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca94b47708e4c198ba2a3f085f3e6f7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:01.916966 17092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca94b47708e4c198ba2a3f085f3e6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.922674 17017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359d72c1f10442b9819867ccdde73870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.922422 17238 tablet_service.cc:1511] Processing CreateTablet for tablet 1c4ba9ad373e446b82700a8a82294225 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:01.923892 17238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c4ba9ad373e446b82700a8a82294225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.931181 17298 tablet_bootstrap.cc:492] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:01.956231 17296 tablet_bootstrap.cc:492] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:01.957031 17296 ts_tablet_manager.cc:1403] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.304s	user 0.016s	sys 0.025s
I20260709 13:19:01.962180 17013 tablet_service.cc:1511] Processing CreateTablet for tablet 17b25597e8e2479b9bf69918cf1c0a02 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:01.965647 17013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b25597e8e2479b9bf69918cf1c0a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.965459 17165 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca94b47708e4c198ba2a3f085f3e6f7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:01.966995 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca94b47708e4c198ba2a3f085f3e6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.976323 17090 tablet_service.cc:1511] Processing CreateTablet for tablet 9ebac26a00d94bbda935011611c3311c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:01.977850 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ebac26a00d94bbda935011611c3311c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.953745 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 4c69155bc1714330b50c63899c8400fb (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:01.982461 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c69155bc1714330b50c63899c8400fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.983278 17232 tablet_service.cc:1511] Processing CreateTablet for tablet 9ebac26a00d94bbda935011611c3311c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:01.984704 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ebac26a00d94bbda935011611c3311c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.989265 17015 tablet_service.cc:1511] Processing CreateTablet for tablet e3d4b49dd94d4fa5bb066af8bd56d6e0 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:01.993301 17159 tablet_service.cc:1511] Processing CreateTablet for tablet 08dbd048d2c24d53bb50081b63f1625b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:01.994763 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dbd048d2c24d53bb50081b63f1625b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:01.998461 17296 raft_consensus.cc:359] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:01.999341 17296 raft_consensus.cc:385] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.999495 17298 tablet_bootstrap.cc:654] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.999727 17296 raft_consensus.cc:740] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.000806 17014 tablet_service.cc:1511] Processing CreateTablet for tablet 50c639a326f04d8d8eed7bd41bc8df2b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:02.004271 17015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d4b49dd94d4fa5bb066af8bd56d6e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.004359 17297 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:02.004933 17297 ts_tablet_manager.cc:1403] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.196s	user 0.006s	sys 0.011s
I20260709 13:19:02.008338 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 08dbd048d2c24d53bb50081b63f1625b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:02.009872 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dbd048d2c24d53bb50081b63f1625b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.010959 17011 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca94b47708e4c198ba2a3f085f3e6f7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:02.008888 17301 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:02.012410 17296 consensus_queue.cc:260] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.017974 17012 tablet_service.cc:1511] Processing CreateTablet for tablet e31daec548cf48f6bedf21556ead46f6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:02.025007 17053 heartbeater.cc:499] Master 127.8.238.254:34437 was elected leader, sending a full tablet report...
I20260709 13:19:02.032128 17010 tablet_service.cc:1511] Processing CreateTablet for tablet 9ebac26a00d94bbda935011611c3311c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:02.042673 17011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca94b47708e4c198ba2a3f085f3e6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.043570 17016 tablet_service.cc:1511] Processing CreateTablet for tablet 08dbd048d2c24d53bb50081b63f1625b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:02.045006 17016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dbd048d2c24d53bb50081b63f1625b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.046582 17014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c639a326f04d8d8eed7bd41bc8df2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.054531 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31daec548cf48f6bedf21556ead46f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.057255 17237 tablet_service.cc:1511] Processing CreateTablet for tablet 6d87f62879274a0ab4ec5951b7fe01a7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:02.058799 17237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d87f62879274a0ab4ec5951b7fe01a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.063491 17301 tablet_bootstrap.cc:654] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.059818 17297 raft_consensus.cc:359] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.064070 17297 raft_consensus.cc:385] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.067911 17297 raft_consensus.cc:740] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.060130 17163 tablet_service.cc:1511] Processing CreateTablet for tablet 6d87f62879274a0ab4ec5951b7fe01a7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:02.053488 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 6d87f62879274a0ab4ec5951b7fe01a7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:02.076355 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d87f62879274a0ab4ec5951b7fe01a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.077033 17296 ts_tablet_manager.cc:1434] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.120s	user 0.013s	sys 0.005s
I20260709 13:19:02.077239 17164 tablet_service.cc:1511] Processing CreateTablet for tablet 00ba94e0be5f4a638535c8d9bb9211d3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:02.078197 17296 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:02.078613 17202 heartbeater.cc:499] Master 127.8.238.254:34437 was elected leader, sending a full tablet report...
I20260709 13:19:02.079049 17297 consensus_queue.cc:260] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.078737 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d87f62879274a0ab4ec5951b7fe01a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.058291 17087 tablet_service.cc:1511] Processing CreateTablet for tablet 00ba94e0be5f4a638535c8d9bb9211d3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:02.099622 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ba94e0be5f4a638535c8d9bb9211d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.116149 17009 tablet_service.cc:1511] Processing CreateTablet for tablet 00ba94e0be5f4a638535c8d9bb9211d3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:02.118366 17128 heartbeater.cc:499] Master 127.8.238.254:34437 was elected leader, sending a full tablet report...
I20260709 13:19:02.133617 17084 tablet_service.cc:1511] Processing CreateTablet for tablet 74f5191b11fd41debf2fb4c4422f4b8a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:02.134742 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 74f5191b11fd41debf2fb4c4422f4b8a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:02.137122 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f5191b11fd41debf2fb4c4422f4b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.074635 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ebac26a00d94bbda935011611c3311c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.139077 17166 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd80cd71cb14d5ba099ab44ff0a69ba (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:02.150020 17166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd80cd71cb14d5ba099ab44ff0a69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.152009 17012 tablet_service.cc:1511] Processing CreateTablet for tablet 74f5191b11fd41debf2fb4c4422f4b8a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:02.163388 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f5191b11fd41debf2fb4c4422f4b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.168397 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74f5191b11fd41debf2fb4c4422f4b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.200094 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ba94e0be5f4a638535c8d9bb9211d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:02.201309 17203 tablet.cc:2406] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:02.203615 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ba94e0be5f4a638535c8d9bb9211d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.238977 17232 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd80cd71cb14d5ba099ab44ff0a69ba (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:02.239634 17014 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd80cd71cb14d5ba099ab44ff0a69ba (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:02.241398 17014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd80cd71cb14d5ba099ab44ff0a69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.242200 17298 tablet_bootstrap.cc:492] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:02.242823 17298 ts_tablet_manager.cc:1403] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.312s	user 0.010s	sys 0.013s
I20260709 13:19:02.243788 17304 raft_consensus.cc:493] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.244365 17304 raft_consensus.cc:515] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.248256 17298 raft_consensus.cc:359] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.249137 17298 raft_consensus.cc:385] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.249456 17298 raft_consensus.cc:740] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.253106 17297 ts_tablet_manager.cc:1434] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.248s	user 0.018s	sys 0.011s
I20260709 13:19:02.240454 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd80cd71cb14d5ba099ab44ff0a69ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.254398 17297 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:02.262050 17304 leader_election.cc:290] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:02.278432 17090 tablet_service.cc:1511] Processing CreateTablet for tablet 3d563c9ac0f54e16bdf8c304a05b0ee6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:02.279915 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d563c9ac0f54e16bdf8c304a05b0ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.289736 17297 tablet_bootstrap.cc:654] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.274852 17298 consensus_queue.cc:260] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.306779 17296 tablet_bootstrap.cc:654] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.313478 17276 heartbeater.cc:499] Master 127.8.238.254:34437 was elected leader, sending a full tablet report...
I20260709 13:19:02.332141 17301 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:02.333022 17301 ts_tablet_manager.cc:1403] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.325s	user 0.047s	sys 0.073s
I20260709 13:19:02.340593 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 3d563c9ac0f54e16bdf8c304a05b0ee6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:02.342747 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d563c9ac0f54e16bdf8c304a05b0ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.355111 17308 raft_consensus.cc:493] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.355724 17308 raft_consensus.cc:515] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.371342 17018 tablet_service.cc:1511] Processing CreateTablet for tablet c4f214fc5aac4e8d82b544d227421217 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:02.372860 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f214fc5aac4e8d82b544d227421217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.373641 17298 ts_tablet_manager.cc:1434] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.131s	user 0.004s	sys 0.010s
I20260709 13:19:02.375161 17298 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:02.376434 17163 tablet_service.cc:1511] Processing CreateTablet for tablet 3d563c9ac0f54e16bdf8c304a05b0ee6 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:02.372241 17084 tablet_service.cc:1511] Processing CreateTablet for tablet c4f214fc5aac4e8d82b544d227421217 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:02.379367 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f214fc5aac4e8d82b544d227421217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.382483 17308 leader_election.cc:290] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:02.376518 17301 raft_consensus.cc:359] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.378101 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d563c9ac0f54e16bdf8c304a05b0ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.384369 17301 raft_consensus.cc:385] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.384791 17301 raft_consensus.cc:740] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.387802 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:02.385663 17301 consensus_queue.cc:260] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.407480 17009 tablet_service.cc:1511] Processing CreateTablet for tablet 4749463a5f494207809283ca94150c73 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:02.408166 17296 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:02.408702 17297 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:02.408962 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4749463a5f494207809283ca94150c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.408996 17296 ts_tablet_manager.cc:1403] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.331s	user 0.004s	sys 0.016s
I20260709 13:19:02.409394 17297 ts_tablet_manager.cc:1403] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.002s
I20260709 13:19:02.420830 17166 tablet_service.cc:1511] Processing CreateTablet for tablet c4f214fc5aac4e8d82b544d227421217 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:02.422448 17166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f214fc5aac4e8d82b544d227421217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.437479 17010 tablet_service.cc:1511] Processing CreateTablet for tablet 28414584faaa415dab69430bf5735027 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:02.437935 17090 tablet_service.cc:1511] Processing CreateTablet for tablet 4749463a5f494207809283ca94150c73 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:02.439473 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28414584faaa415dab69430bf5735027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.437935 17087 tablet_service.cc:1511] Processing CreateTablet for tablet 3a8311e3adec426caac0f0b50057d6d7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:02.439621 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4749463a5f494207809283ca94150c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.447719 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8311e3adec426caac0f0b50057d6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.451606 17164 tablet_service.cc:1511] Processing CreateTablet for tablet 28414584faaa415dab69430bf5735027 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:02.453091 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28414584faaa415dab69430bf5735027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.455859 17159 tablet_service.cc:1511] Processing CreateTablet for tablet 3a8311e3adec426caac0f0b50057d6d7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:02.457335 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8311e3adec426caac0f0b50057d6d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:02.446707 17068 leader_election.cc:343] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:02.478446 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 75192.7us
I20260709 13:19:02.484828 17297 raft_consensus.cc:359] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:02.490468 17302 raft_consensus.cc:493] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.490711 17297 raft_consensus.cc:385] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.491115 17297 raft_consensus.cc:740] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.491081 17302 raft_consensus.cc:515] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.492275 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:02.492430 17297 consensus_queue.cc:260] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:02.495194 17297 ts_tablet_manager.cc:1434] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.004s
I20260709 13:19:02.496294 17297 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:02.498483 17298 tablet_bootstrap.cc:654] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.435587 17296 raft_consensus.cc:359] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.501875 17296 raft_consensus.cc:385] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.502353 17296 raft_consensus.cc:740] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.501950 17237 tablet_service.cc:1511] Processing CreateTablet for tablet 4749463a5f494207809283ca94150c73 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:02.503435 17237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4749463a5f494207809283ca94150c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.503115 17296 consensus_queue.cc:260] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.504170 17177 raft_consensus.cc:2468] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:02.511157 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 28414584faaa415dab69430bf5735027 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:02.512622 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28414584faaa415dab69430bf5735027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.513056 17084 tablet_service.cc:1511] Processing CreateTablet for tablet c40787f6c37c4588b30b9cac2233c0a3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:02.514487 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40787f6c37c4588b30b9cac2233c0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.476392 17012 tablet_service.cc:1511] Processing CreateTablet for tablet c40787f6c37c4588b30b9cac2233c0a3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:02.531884 17302 leader_election.cc:290] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:02.547425 17239 tablet_service.cc:1511] Processing CreateTablet for tablet 3a8311e3adec426caac0f0b50057d6d7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:02.548964 17239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8311e3adec426caac0f0b50057d6d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.557821 17068 leader_election.cc:304] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:02.559055 17304 raft_consensus.cc:2804] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:02.559499 17304 raft_consensus.cc:493] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.560009 17298 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:02.559514 17165 tablet_service.cc:1511] Processing CreateTablet for tablet c40787f6c37c4588b30b9cac2233c0a3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:02.560106 17304 raft_consensus.cc:3060] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.560669 17298 ts_tablet_manager.cc:1403] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.186s	user 0.024s	sys 0.018s
I20260709 13:19:02.561282 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40787f6c37c4588b30b9cac2233c0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.568446 17304 raft_consensus.cc:515] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.571502 17304 leader_election.cc:290] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:02.574527 17298 raft_consensus.cc:359] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.575368 17298 raft_consensus.cc:385] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.575699 17298 raft_consensus.cc:740] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.576481 17298 consensus_queue.cc:260] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.579113 17298 ts_tablet_manager.cc:1434] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:19:02.580260 17298 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:02.586941 17298 tablet_bootstrap.cc:654] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.587221 17301 ts_tablet_manager.cc:1434] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.254s	user 0.014s	sys 0.003s
I20260709 13:19:02.587926 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
W20260709 13:19:02.589612 17068 leader_election.cc:343] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.588166 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40787f6c37c4588b30b9cac2233c0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.598390 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:02.599331 17177 raft_consensus.cc:3060] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.597078 17301 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:02.597162 17318 raft_consensus.cc:493] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.601436 17318 raft_consensus.cc:515] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.633062 17297 tablet_bootstrap.cc:654] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.656916 17318 leader_election.cc:290] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:02.670758 17297 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
W20260709 13:19:02.670586 16912 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 73060.4us
I20260709 13:19:02.672894 17297 ts_tablet_manager.cc:1403] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.012s
I20260709 13:19:02.671540 17301 tablet_bootstrap.cc:654] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.676007 17296 ts_tablet_manager.cc:1434] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.266s	user 0.004s	sys 0.010s
I20260709 13:19:02.711875 17297 raft_consensus.cc:359] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.712776 17297 raft_consensus.cc:385] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.715408 17297 raft_consensus.cc:740] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.718443 17297 consensus_queue.cc:260] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.715360 17296 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:02.727465 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618435fe625b47de9afd290384ff676e" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:02.730095 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618435fe625b47de9afd290384ff676e" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:02.731182 17084 tablet_service.cc:1511] Processing CreateTablet for tablet 570ac42568104f29ba5df81bb07d7683 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:02.732645 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570ac42568104f29ba5df81bb07d7683. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:02.732805 17216 leader_election.cc:343] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.734965 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8397c824876e4947a125624f56c2501d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
W20260709 13:19:02.736863 17142 leader_election.cc:343] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.741680 17012 tablet_service.cc:1511] Processing CreateTablet for tablet 570ac42568104f29ba5df81bb07d7683 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:02.743170 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570ac42568104f29ba5df81bb07d7683. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:02.733560 17216 leader_election.cc:343] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.745472 17216 leader_election.cc:304] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:02.746840 17310 raft_consensus.cc:2749] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:02.745492 17177 raft_consensus.cc:2468] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:02.759913 17297 ts_tablet_manager.cc:1434] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.087s	user 0.011s	sys 0.013s
I20260709 13:19:02.761145 17297 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:02.760748 17164 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab0391bda54325b10799d23b44b332 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:02.762441 17068 leader_election.cc:304] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:02.763733 17304 raft_consensus.cc:2804] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:02.764400 17010 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab0391bda54325b10799d23b44b332 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:02.765831 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab0391bda54325b10799d23b44b332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.770879 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab0391bda54325b10799d23b44b332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.771181 17090 tablet_service.cc:1511] Processing CreateTablet for tablet 926ebf63b80f401d9c985bd2905a1b65 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:02.771219 17163 tablet_service.cc:1511] Processing CreateTablet for tablet 926ebf63b80f401d9c985bd2905a1b65 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:02.773099 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926ebf63b80f401d9c985bd2905a1b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.777868 17239 tablet_service.cc:1511] Processing CreateTablet for tablet 85ab0391bda54325b10799d23b44b332 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:02.779425 17239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ab0391bda54325b10799d23b44b332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.781265 17298 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:02.781852 17298 ts_tablet_manager.cc:1403] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.202s	user 0.029s	sys 0.026s
I20260709 13:19:02.783036 17301 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:02.785131 17301 ts_tablet_manager.cc:1403] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.188s	user 0.030s	sys 0.027s
I20260709 13:19:02.795307 17301 raft_consensus.cc:359] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.803442 17301 raft_consensus.cc:385] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.804555 17301 raft_consensus.cc:740] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.786878 17237 tablet_service.cc:1511] Processing CreateTablet for tablet 570ac42568104f29ba5df81bb07d7683 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:02.788650 17232 tablet_service.cc:1511] Processing CreateTablet for tablet 926ebf63b80f401d9c985bd2905a1b65 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:02.807250 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926ebf63b80f401d9c985bd2905a1b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.805949 17301 consensus_queue.cc:260] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.809242 17087 tablet_service.cc:1511] Processing CreateTablet for tablet f06adc55b95e4338b38e9323041f9eb7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:02.811378 17301 ts_tablet_manager.cc:1434] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:19:02.814957 17166 tablet_service.cc:1511] Processing CreateTablet for tablet f06adc55b95e4338b38e9323041f9eb7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:02.816972 17166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06adc55b95e4338b38e9323041f9eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.819042 17237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 570ac42568104f29ba5df81bb07d7683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.785480 17298 raft_consensus.cc:359] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:02.797748 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926ebf63b80f401d9c985bd2905a1b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.823596 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8397c824876e4947a125624f56c2501d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
W20260709 13:19:02.826002 17140 leader_election.cc:343] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.826723 17140 leader_election.cc:304] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:02.828606 17324 raft_consensus.cc:2749] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:02.798034 17009 tablet_service.cc:1511] Processing CreateTablet for tablet f06adc55b95e4338b38e9323041f9eb7 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:02.801200 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:02.831514 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06adc55b95e4338b38e9323041f9eb7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:02.832890 16993 leader_election.cc:343] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.834332 17298 raft_consensus.cc:385] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.834684 17298 raft_consensus.cc:740] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.835479 17298 consensus_queue.cc:260] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:02.837785 17301 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:02.839687 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 41a0c88c5fa240e5a0cc957f5569c1f4 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:02.840132 17298 ts_tablet_manager.cc:1434] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.002s
I20260709 13:19:02.841109 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a0c88c5fa240e5a0cc957f5569c1f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:02.844599 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:02.844753 17301 tablet_bootstrap.cc:654] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.846130 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:02.847023 17297 tablet_bootstrap.cc:654] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:02.847846 16993 leader_election.cc:343] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.848292 17296 tablet_bootstrap.cc:654] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:02.848366 16993 leader_election.cc:304] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:02.849939 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06adc55b95e4338b38e9323041f9eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.850837 17318 raft_consensus.cc:2749] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:02.854274 17304 raft_consensus.cc:697] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:02.855297 17304 consensus_queue.cc:237] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.862747 17010 tablet_service.cc:1511] Processing CreateTablet for tablet 41a0c88c5fa240e5a0cc957f5569c1f4 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:02.864231 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a0c88c5fa240e5a0cc957f5569c1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.873660 17084 tablet_service.cc:1511] Processing CreateTablet for tablet 41a0c88c5fa240e5a0cc957f5569c1f4 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:02.875999 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 75097aacc2fe4fd6be138902792ad16f (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:02.876350 17165 tablet_service.cc:1511] Processing CreateTablet for tablet 75097aacc2fe4fd6be138902792ad16f (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:02.877938 17298 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:02.877957 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75097aacc2fe4fd6be138902792ad16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.877955 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a0c88c5fa240e5a0cc957f5569c1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.884410 17297 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:02.885643 17297 ts_tablet_manager.cc:1403] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.001s
I20260709 13:19:02.889623 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 75097aacc2fe4fd6be138902792ad16f (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:02.896637 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75097aacc2fe4fd6be138902792ad16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.896464 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8a7e0630e4439ca8abb6c40beeaa0d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:02.896890 17159 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8a7e0630e4439ca8abb6c40beeaa0d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:02.897975 17330 raft_consensus.cc:493] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.898839 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75097aacc2fe4fd6be138902792ad16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.898613 17330 raft_consensus.cc:515] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:02.897991 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8a7e0630e4439ca8abb6c40beeaa0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.903226 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8a7e0630e4439ca8abb6c40beeaa0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.909865 17240 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8a7e0630e4439ca8abb6c40beeaa0d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:02.911408 17240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8a7e0630e4439ca8abb6c40beeaa0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.922720 17330 leader_election.cc:290] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:02.923357 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:02.923889 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:02.924373 17251 raft_consensus.cc:2468] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
W20260709 13:19:02.925557 17068 leader_election.cc:343] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.926570 17297 raft_consensus.cc:359] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.927373 17297 raft_consensus.cc:385] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.927707 17297 raft_consensus.cc:740] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.927604 17066 leader_election.cc:304] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:02.928761 17297 consensus_queue.cc:260] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:02.929006 17330 raft_consensus.cc:2804] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:02.933617 17330 raft_consensus.cc:493] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.938529 17330 raft_consensus.cc:3060] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.943989 17301 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:02.944559 17310 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.945645 17310 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:02.948149 17310 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:02.954339 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:02.954941 17090 tablet_service.cc:1511] Processing CreateTablet for tablet 13b09204a1f749018e4e1531e3410d0d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 13:19:02.956094 17216 leader_election.cc:343] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:02.956310 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b09204a1f749018e4e1531e3410d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.963711 17297 ts_tablet_manager.cc:1434] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.010s
I20260709 13:19:02.964888 17297 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:02.952282 17009 tablet_service.cc:1511] Processing CreateTablet for tablet 13b09204a1f749018e4e1531e3410d0d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:02.966084 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b09204a1f749018e4e1531e3410d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.944609 17301 ts_tablet_manager.cc:1403] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.009s
I20260709 13:19:02.976133 17301 raft_consensus.cc:359] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.976935 17301 raft_consensus.cc:385] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:02.977262 17301 raft_consensus.cc:740] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:02.961683 17330 raft_consensus.cc:515] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:02.963966 17296 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:02.985773 17232 tablet_service.cc:1511] Processing CreateTablet for tablet be5cb5807ca8471bab64797de2f9919b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:02.987195 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5cb5807ca8471bab64797de2f9919b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.987866 17330 leader_election.cc:290] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:02.978119 17301 consensus_queue.cc:260] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:02.991611 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:02.991883 17301 ts_tablet_manager.cc:1434] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:02.992385 17251 raft_consensus.cc:3060] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.993407 17301 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:02.993708 17165 tablet_service.cc:1511] Processing CreateTablet for tablet 13b09204a1f749018e4e1531e3410d0d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:02.995095 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b09204a1f749018e4e1531e3410d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.999330 17297 tablet_bootstrap.cc:654] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.006698 17330 raft_consensus.cc:493] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.007520 17330 raft_consensus.cc:515] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.008170 17010 tablet_service.cc:1511] Processing CreateTablet for tablet be5cb5807ca8471bab64797de2f9919b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:03.009711 17010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5cb5807ca8471bab64797de2f9919b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.962145 17298 tablet_bootstrap.cc:654] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.014663 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ff634467f042329ddeb7a8af515f56" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.015336 17163 tablet_service.cc:1511] Processing CreateTablet for tablet dcf71c3afe414daeb032d872c3c949c3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:19:03.016781 17066 leader_election.cc:343] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.011418 17296 ts_tablet_manager.cc:1403] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.332s	user 0.008s	sys 0.015s
I20260709 13:19:03.016875 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf71c3afe414daeb032d872c3c949c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.019340 17318 raft_consensus.cc:493] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.022671 17318 raft_consensus.cc:515] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.023712 17251 raft_consensus.cc:2468] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:03.025190 17318 leader_election.cc:290] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.025094 17066 leader_election.cc:304] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:03.025324 17239 tablet_service.cc:1511] Processing CreateTablet for tablet dcf71c3afe414daeb032d872c3c949c3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:03.026870 17239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf71c3afe414daeb032d872c3c949c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.027122 17086 tablet_service.cc:1511] Processing CreateTablet for tablet be5cb5807ca8471bab64797de2f9919b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:03.027376 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7f3735ebc41f691fbce7d2c33ab12" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.028566 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5cb5807ca8471bab64797de2f9919b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:03.029294 16993 leader_election.cc:343] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.030879 17301 tablet_bootstrap.cc:654] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.037415 17012 tablet_service.cc:1511] Processing CreateTablet for tablet dcf71c3afe414daeb032d872c3c949c3 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:03.038932 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcf71c3afe414daeb032d872c3c949c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.032793 17304 raft_consensus.cc:2804] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.046908 17304 raft_consensus.cc:697] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:03.047866 17304 consensus_queue.cc:237] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.031855 17330 leader_election.cc:290] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:03.064517 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
W20260709 13:19:03.081075 17068 leader_election.cc:343] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.090848 17296 raft_consensus.cc:359] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.091667 17296 raft_consensus.cc:385] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.092003 17296 raft_consensus.cc:740] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.095045 17087 tablet_service.cc:1511] Processing CreateTablet for tablet 8712f3f0952b48d5b34d644bdfdc263d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:03.096441 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8712f3f0952b48d5b34d644bdfdc263d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.097322 17159 tablet_service.cc:1511] Processing CreateTablet for tablet 8712f3f0952b48d5b34d644bdfdc263d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:03.098740 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8712f3f0952b48d5b34d644bdfdc263d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.099771 16925 catalog_manager.cc:5697] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.106590 17296 consensus_queue.cc:260] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.111728 17301 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:03.112332 17301 ts_tablet_manager.cc:1403] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.003s
I20260709 13:19:03.121914 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ff634467f042329ddeb7a8af515f56" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.122385 17297 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:03.123059 17297 ts_tablet_manager.cc:1403] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.015s
W20260709 13:19:03.123548 17068 leader_election.cc:343] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.123426 17301 raft_consensus.cc:359] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.124091 17068 leader_election.cc:304] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:03.125152 17304 raft_consensus.cc:2749] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.126197 17298 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:03.126888 17298 ts_tablet_manager.cc:1403] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.269s	user 0.020s	sys 0.006s
I20260709 13:19:03.126506 17297 raft_consensus.cc:359] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.127358 17297 raft_consensus.cc:385] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.127707 17297 raft_consensus.cc:740] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.128623 17297 consensus_queue.cc:260] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.131114 17297 ts_tablet_manager.cc:1434] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:03.132926 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 468c1b5e86fc4f40995e64ce4cfe446a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:03.134423 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468c1b5e86fc4f40995e64ce4cfe446a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.134874 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7f3735ebc41f691fbce7d2c33ab12" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.135192 17298 raft_consensus.cc:359] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.135968 17298 raft_consensus.cc:385] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.136299 17298 raft_consensus.cc:740] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
W20260709 13:19:03.136586 16991 leader_election.cc:343] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.137059 17298 consensus_queue.cc:260] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.137100 16991 leader_election.cc:304] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:03.141968 17318 raft_consensus.cc:2749] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.144819 17298 ts_tablet_manager.cc:1434] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:19:03.146059 17298 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:03.148425 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 8712f3f0952b48d5b34d644bdfdc263d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:03.154803 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 468c1b5e86fc4f40995e64ce4cfe446a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:03.155535 17296 ts_tablet_manager.cc:1434] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.134s	user 0.007s	sys 0.000s
I20260709 13:19:03.124301 17301 raft_consensus.cc:385] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.158140 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8712f3f0952b48d5b34d644bdfdc263d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.166002 17301 raft_consensus.cc:740] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.166574 17297 tablet_bootstrap.cc:492] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:03.167074 17301 consensus_queue.cc:260] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.161707 17163 tablet_service.cc:1511] Processing CreateTablet for tablet 468c1b5e86fc4f40995e64ce4cfe446a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:03.175462 17318 raft_consensus.cc:493] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.176206 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468c1b5e86fc4f40995e64ce4cfe446a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.180156 17087 tablet_service.cc:1511] Processing CreateTablet for tablet cd013d3d29734959949861700ba2f0bf (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:03.163128 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.176229 17318 raft_consensus.cc:515] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.184237 17296 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:03.163432 17232 tablet_service.cc:1511] Processing CreateTablet for tablet cd013d3d29734959949861700ba2f0bf (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:03.164168 17009 tablet_service.cc:1511] Processing CreateTablet for tablet cd013d3d29734959949861700ba2f0bf (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:03.187355 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd013d3d29734959949861700ba2f0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.187415 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd013d3d29734959949861700ba2f0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.193674 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.194617 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:03.195317 17103 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:03.159243 17298 tablet_bootstrap.cc:654] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:03.195390 16993 leader_election.cc:343] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.165481 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 468c1b5e86fc4f40995e64ce4cfe446a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.199249 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd013d3d29734959949861700ba2f0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.198905 17165 tablet_service.cc:1511] Processing CreateTablet for tablet 12efab3d68e44ec697cc29a3695960e4 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:03.200301 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12efab3d68e44ec697cc29a3695960e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.203055 16993 leader_election.cc:304] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:03.192430 17318 leader_election.cc:290] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:03.206625 17318 raft_consensus.cc:2804] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.207041 17318 raft_consensus.cc:493] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.207413 17318 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.209436 17310 raft_consensus.cc:493] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.210145 17310 raft_consensus.cc:515] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.212370 17310 leader_election.cc:290] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:03.214022 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 12efab3d68e44ec697cc29a3695960e4 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:03.214536 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ff634467f042329ddeb7a8af515f56" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:03.215318 17103 raft_consensus.cc:2468] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:03.217170 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 12efab3d68e44ec697cc29a3695960e4 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:03.218564 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12efab3d68e44ec697cc29a3695960e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.218657 17090 tablet_service.cc:1511] Processing CreateTablet for tablet 1443c01c216f42078dc34c1c904e9bfa (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:03.220063 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1443c01c216f42078dc34c1c904e9bfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:03.222856 17216 leader_election.cc:343] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.215529 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12efab3d68e44ec697cc29a3695960e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.223326 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ff634467f042329ddeb7a8af515f56" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.223400 17216 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:03.225502 17216 leader_election.cc:304] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:03.226153 17310 raft_consensus.cc:2749] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.227356 17310 raft_consensus.cc:2804] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.228093 17310 raft_consensus.cc:493] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.228559 17310 raft_consensus.cc:3060] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.214839 17296 tablet_bootstrap.cc:654] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.208189 16925 catalog_manager.cc:5697] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.239141 17304 raft_consensus.cc:493] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.239746 17304 raft_consensus.cc:515] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.243408 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.243860 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.244168 17028 raft_consensus.cc:2468] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:03.244093 17159 tablet_service.cc:1511] Processing CreateTablet for tablet 1443c01c216f42078dc34c1c904e9bfa (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:03.245499 17068 leader_election.cc:304] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
W20260709 13:19:03.246837 17068 leader_election.cc:343] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.247377 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1443c01c216f42078dc34c1c904e9bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.247658 17330 raft_consensus.cc:2804] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.248090 17330 raft_consensus.cc:493] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.248448 17330 raft_consensus.cc:3060] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.252300 17298 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:03.252947 17298 ts_tablet_manager.cc:1403] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.002s
I20260709 13:19:03.242013 17304 leader_election.cc:290] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:03.260442 17298 raft_consensus.cc:359] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.261217 17298 raft_consensus.cc:385] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.261512 17298 raft_consensus.cc:740] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.262370 17297 tablet_bootstrap.cc:654] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.264071 17330 raft_consensus.cc:515] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.265407 17324 raft_consensus.cc:493] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.270653 17324 raft_consensus.cc:515] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.273244 17324 leader_election.cc:290] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.265393 17298 consensus_queue.cc:260] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.275840 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:03.276517 17028 raft_consensus.cc:3060] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.278846 17298 ts_tablet_manager.cc:1434] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:19:03.293152 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:03.297351 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.297466 17164 tablet_service.cc:1511] Processing CreateTablet for tablet b8ea321625d744dc9ec9ad41bd84079a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:03.298166 17027 raft_consensus.cc:2468] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:03.298223 17009 tablet_service.cc:1511] Processing CreateTablet for tablet b8ea321625d744dc9ec9ad41bd84079a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:03.298904 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ea321625d744dc9ec9ad41bd84079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.299602 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ea321625d744dc9ec9ad41bd84079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.299595 17142 leader_election.cc:304] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:03.300894 17324 raft_consensus.cc:2804] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.301282 17324 raft_consensus.cc:493] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.301605 17324 raft_consensus.cc:3060] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.284309 17330 leader_election.cc:290] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:03.306631 17298 tablet_bootstrap.cc:492] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
W20260709 13:19:03.308388 17068 leader_election.cc:343] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.310647 17090 tablet_service.cc:1511] Processing CreateTablet for tablet b8ea321625d744dc9ec9ad41bd84079a (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:03.311770 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ea321625d744dc9ec9ad41bd84079a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.317158 17296 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
W20260709 13:19:03.322027 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 96623us
W20260709 13:19:03.322633 16993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 119674us
I20260709 13:19:03.327809 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.330431 17234 tablet_service.cc:1511] Processing CreateTablet for tablet 1443c01c216f42078dc34c1c904e9bfa (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:03.331866 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1443c01c216f42078dc34c1c904e9bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.332647 17012 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6eedb2345347888597839f1da5742c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:03.334033 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6eedb2345347888597839f1da5742c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.318652 17028 raft_consensus.cc:2468] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:03.335702 17068 leader_election.cc:304] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:03.335534 17318 raft_consensus.cc:515] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.317432 17310 raft_consensus.cc:515] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.321373 17296 ts_tablet_manager.cc:1403] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.007s
I20260709 13:19:03.337440 17330 raft_consensus.cc:2804] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.346179 17330 raft_consensus.cc:697] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:03.347183 17330 consensus_queue.cc:237] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.347492 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6eedb2345347888597839f1da5742c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:03.348937 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6eedb2345347888597839f1da5742c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.350975 17310 leader_election.cc:290] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:03.352074 17296 raft_consensus.cc:359] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.352902 17296 raft_consensus.cc:385] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.353180 17296 raft_consensus.cc:740] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
W20260709 13:19:03.358784 17068 consensus_peers.cc:597] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:03.360498 17018 tablet_service.cc:1511] Processing CreateTablet for tablet b01575d8b45646519b3c341e62c407f9 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:03.360777 17165 tablet_service.cc:1511] Processing CreateTablet for tablet b01575d8b45646519b3c341e62c407f9 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:03.361944 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01575d8b45646519b3c341e62c407f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.362109 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01575d8b45646519b3c341e62c407f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.366868 17296 consensus_queue.cc:260] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.341717 17324 raft_consensus.cc:515] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.371898 17318 leader_election.cc:290] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:03.372550 17318 raft_consensus.cc:493] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.372560 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:03.373167 17318 raft_consensus.cc:515] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.374153 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:03.374845 17177 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.376169 17087 tablet_service.cc:1511] Processing CreateTablet for tablet cdb7c15929434ca0a9f7925722859adf (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:03.377550 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb7c15929434ca0a9f7925722859adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.378047 17163 tablet_service.cc:1511] Processing CreateTablet for tablet cdb7c15929434ca0a9f7925722859adf (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:03.372674 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:03.379290 17103 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.379487 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb7c15929434ca0a9f7925722859adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.374184 17028 raft_consensus.cc:3060] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.398543 17012 tablet_service.cc:1511] Processing CreateTablet for tablet 41bb77fb0c0749f09d8c4bd783a3aa4b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:03.400043 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bb77fb0c0749f09d8c4bd783a3aa4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.403187 17232 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6eedb2345347888597839f1da5742c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:03.403915 17084 tablet_service.cc:1511] Processing CreateTablet for tablet 41bb77fb0c0749f09d8c4bd783a3aa4b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:03.404592 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6eedb2345347888597839f1da5742c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.405244 17084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bb77fb0c0749f09d8c4bd783a3aa4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.407402 17298 tablet_bootstrap.cc:654] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.408954 17177 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:03.410635 16993 leader_election.cc:304] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:03.412124 17346 raft_consensus.cc:2804] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.412802 17346 raft_consensus.cc:697] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:03.413985 17346 consensus_queue.cc:237] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:03.418939 17216 leader_election.cc:343] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:03.440045 17140 leader_election.cc:343] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.441721 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ff634467f042329ddeb7a8af515f56" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:03.441838 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:03.443341 17234 tablet_service.cc:1511] Processing CreateTablet for tablet b01575d8b45646519b3c341e62c407f9 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:03.445272 17239 tablet_service.cc:1511] Processing CreateTablet for tablet cdb7c15929434ca0a9f7925722859adf (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:03.420385 17103 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:03.446725 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ff634467f042329ddeb7a8af515f56" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:03.447435 17102 raft_consensus.cc:3060] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.449352 17159 tablet_service.cc:1511] Processing CreateTablet for tablet 41bb77fb0c0749f09d8c4bd783a3aa4b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:03.448961 16924 catalog_manager.cc:5697] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.450767 17159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bb77fb0c0749f09d8c4bd783a3aa4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.450824 17234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b01575d8b45646519b3c341e62c407f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.453881 17239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb7c15929434ca0a9f7925722859adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.396272 17324 leader_election.cc:290] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.481649 17028 raft_consensus.cc:2468] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:03.482827 17297 tablet_bootstrap.cc:492] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:03.483424 17297 ts_tablet_manager.cc:1403] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.317s	user 0.018s	sys 0.012s
I20260709 13:19:03.483443 17142 leader_election.cc:304] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
W20260709 13:19:03.490834 17140 leader_election.cc:343] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.490573 17330 consensus_queue.cc:1048] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:03.493279 17216 leader_election.cc:343] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.494120 17324 raft_consensus.cc:2804] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.494966 17324 raft_consensus.cc:697] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:03.495918 17324 consensus_queue.cc:237] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.498997 17318 leader_election.cc:290] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.499862 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.500506 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.501375 17102 raft_consensus.cc:2468] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
W20260709 13:19:03.503522 16991 leader_election.cc:343] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.504925 16991 leader_election.cc:304] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:03.504985 17216 leader_election.cc:304] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:03.506129 17347 raft_consensus.cc:2804] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.506705 17347 raft_consensus.cc:697] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:03.508435 17297 raft_consensus.cc:359] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.508587 17347 consensus_queue.cc:237] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.509418 17297 raft_consensus.cc:385] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.509788 17297 raft_consensus.cc:740] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.512249 17090 tablet_service.cc:1511] Processing CreateTablet for tablet bd0eff3471854a72a1357beeb5723b41 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:03.513654 17090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0eff3471854a72a1357beeb5723b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.513821 16924 catalog_manager.cc:5697] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.511946 17297 consensus_queue.cc:260] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.517191 17346 raft_consensus.cc:2749] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.517113 17232 tablet_service.cc:1511] Processing CreateTablet for tablet bd0eff3471854a72a1357beeb5723b41 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:03.518376 17297 ts_tablet_manager.cc:1434] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:19:03.518791 17232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0eff3471854a72a1357beeb5723b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.519507 17297 tablet_bootstrap.cc:492] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:03.526516 17240 tablet_service.cc:1511] Processing CreateTablet for tablet af101ab31e994b5b9c841d81524c4e1b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:03.528259 17240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af101ab31e994b5b9c841d81524c4e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.531234 17018 tablet_service.cc:1511] Processing CreateTablet for tablet af101ab31e994b5b9c841d81524c4e1b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:03.532612 17301 ts_tablet_manager.cc:1434] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.420s	user 0.024s	sys 0.020s
I20260709 13:19:03.532722 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af101ab31e994b5b9c841d81524c4e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.534972 17296 ts_tablet_manager.cc:1434] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.187s	user 0.010s	sys 0.000s
I20260709 13:19:03.537420 17297 tablet_bootstrap.cc:654] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.549191 17296 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:03.550637 17163 tablet_service.cc:1511] Processing CreateTablet for tablet af101ab31e994b5b9c841d81524c4e1b (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:03.552413 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af101ab31e994b5b9c841d81524c4e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.552533 17086 tablet_service.cc:1511] Processing CreateTablet for tablet 855427fe4a17404c80344adfff8a420d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:03.558514 17086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855427fe4a17404c80344adfff8a420d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.563742 17165 tablet_service.cc:1511] Processing CreateTablet for tablet 855427fe4a17404c80344adfff8a420d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:03.507341 17012 tablet_service.cc:1511] Processing CreateTablet for tablet bd0eff3471854a72a1357beeb5723b41 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:03.557294 17301 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:03.565729 17012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0eff3471854a72a1357beeb5723b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.573032 17165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855427fe4a17404c80344adfff8a420d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.577651 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 855427fe4a17404c80344adfff8a420d (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:03.579123 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 855427fe4a17404c80344adfff8a420d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:03.579396 17068 consensus_peers.cc:597] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:03.580390 17296 tablet_bootstrap.cc:654] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.582468 17347 raft_consensus.cc:493] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.583101 17347 raft_consensus.cc:515] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.583555 17009 tablet_service.cc:1511] Processing CreateTablet for tablet 7f937b33484e46e090f4544fe372a5a9 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:03.584945 17009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f937b33484e46e090f4544fe372a5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.587576 17347 leader_election.cc:290] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:03.587797 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:03.589293 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:03.589457 17216 leader_election.cc:343] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:03.590837 17216 leader_election.cc:343] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.591292 17216 leader_election.cc:304] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:03.595276 16923 catalog_manager.cc:5697] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.598490 17298 tablet_bootstrap.cc:492] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:03.599239 17298 ts_tablet_manager.cc:1403] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.293s	user 0.017s	sys 0.024s
I20260709 13:19:03.601464 17297 tablet_bootstrap.cc:492] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:03.602036 17297 ts_tablet_manager.cc:1403] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.004s
I20260709 13:19:03.605392 17297 raft_consensus.cc:359] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.606127 17297 raft_consensus.cc:385] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.606592 17297 raft_consensus.cc:740] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.607442 17297 consensus_queue.cc:260] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.610196 17297 ts_tablet_manager.cc:1434] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:19:03.614428 17298 raft_consensus.cc:359] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.598415 17347 raft_consensus.cc:2749] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.615315 17087 tablet_service.cc:1511] Processing CreateTablet for tablet 7f937b33484e46e090f4544fe372a5a9 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:03.616603 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f937b33484e46e090f4544fe372a5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.617606 17297 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:03.621567 17164 tablet_service.cc:1511] Processing CreateTablet for tablet 7f937b33484e46e090f4544fe372a5a9 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:03.624720 17164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f937b33484e46e090f4544fe372a5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.615314 17298 raft_consensus.cc:385] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.632915 17298 raft_consensus.cc:740] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.633731 17298 consensus_queue.cc:260] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.636216 17298 ts_tablet_manager.cc:1434] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:19:03.637336 17298 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:03.637522 16924 catalog_manager.cc:5697] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:03.644891 17301 tablet_bootstrap.cc:654] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.650122 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 31001da831bd4090a480461096b888c5 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:03.653820 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31001da831bd4090a480461096b888c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.660723 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 31001da831bd4090a480461096b888c5 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:03.662050 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31001da831bd4090a480461096b888c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.665149 17297 tablet_bootstrap.cc:654] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.666991 17298 tablet_bootstrap.cc:654] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.668687 17087 tablet_service.cc:1511] Processing CreateTablet for tablet 31001da831bd4090a480461096b888c5 (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:03.685448 17087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31001da831bd4090a480461096b888c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.686838 17330 consensus_queue.cc:1048] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:03.700670 17163 tablet_service.cc:1511] Processing CreateTablet for tablet 5a94f0c007bb449daa0dfd34bdf4222c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:03.702464 17163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a94f0c007bb449daa0dfd34bdf4222c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.736759 17296 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:03.737370 17296 ts_tablet_manager.cc:1403] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.188s	user 0.026s	sys 0.018s
I20260709 13:19:03.740942 17301 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:03.740707 17296 raft_consensus.cc:359] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.741586 17301 ts_tablet_manager.cc:1403] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.007s
I20260709 13:19:03.741720 17296 raft_consensus.cc:385] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.742178 17296 raft_consensus.cc:740] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.743006 17296 consensus_queue.cc:260] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.745097 17297 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:03.745636 17297 ts_tablet_manager.cc:1403] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.128s	user 0.006s	sys 0.011s
I20260709 13:19:03.746279 17296 ts_tablet_manager.cc:1434] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:19:03.749204 17233 tablet_service.cc:1511] Processing CreateTablet for tablet 5a94f0c007bb449daa0dfd34bdf4222c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:03.748649 17297 raft_consensus.cc:359] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.750149 17297 raft_consensus.cc:385] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.750456 17296 tablet_bootstrap.cc:492] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:03.750478 17297 raft_consensus.cc:740] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.751694 17297 consensus_queue.cc:260] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.754544 17018 tablet_service.cc:1511] Processing CreateTablet for tablet 5a94f0c007bb449daa0dfd34bdf4222c (DEFAULT_TABLE table=test-workload [id=21e051e07d8e4d18908df11760452f8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:03.755913 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a94f0c007bb449daa0dfd34bdf4222c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.750535 17233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a94f0c007bb449daa0dfd34bdf4222c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:03.761016 17296 tablet_bootstrap.cc:654] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.762828 17297 ts_tablet_manager.cc:1434] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:19:03.770910 17297 tablet_bootstrap.cc:492] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:03.772840 17301 raft_consensus.cc:359] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.773736 17301 raft_consensus.cc:385] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.774123 17301 raft_consensus.cc:740] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.775060 17301 consensus_queue.cc:260] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.755910 17298 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:03.776300 17298 ts_tablet_manager.cc:1403] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.023s
I20260709 13:19:03.773273 17296 tablet_bootstrap.cc:492] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:03.779328 17296 ts_tablet_manager.cc:1403] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.002s
I20260709 13:19:03.782675 17296 raft_consensus.cc:359] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.788308 17296 raft_consensus.cc:385] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.788726 17296 raft_consensus.cc:740] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.789541 17296 consensus_queue.cc:260] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.792054 17296 ts_tablet_manager.cc:1434] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:19:03.793191 17296 tablet_bootstrap.cc:492] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:03.784011 17297 tablet_bootstrap.cc:654] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.785542 17298 raft_consensus.cc:359] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.798084 17298 raft_consensus.cc:385] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.798504 17298 raft_consensus.cc:740] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.799330 17298 consensus_queue.cc:260] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.787906 17301 ts_tablet_manager.cc:1434] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.003s
I20260709 13:19:03.800647 17296 tablet_bootstrap.cc:654] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.801316 17301 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:03.805445 17298 ts_tablet_manager.cc:1434] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:19:03.808440 17297 tablet_bootstrap.cc:492] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:03.808971 17297 ts_tablet_manager.cc:1403] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 13:19:03.809805 17298 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:03.811939 17297 raft_consensus.cc:359] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.812707 17297 raft_consensus.cc:385] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.813057 17297 raft_consensus.cc:740] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.813809 17297 consensus_queue.cc:260] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.814617 17296 tablet_bootstrap.cc:492] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:03.815148 17296 ts_tablet_manager.cc:1403] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:19:03.817342 17297 ts_tablet_manager.cc:1434] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:03.818480 17297 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:03.818893 17296 raft_consensus.cc:359] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.819712 17296 raft_consensus.cc:385] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.820042 17296 raft_consensus.cc:740] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.820683 17298 tablet_bootstrap.cc:654] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.820851 17296 consensus_queue.cc:260] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.824631 17301 tablet_bootstrap.cc:654] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.828425 17296 ts_tablet_manager.cc:1434] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:19:03.829789 17296 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:03.831574 17304 consensus_queue.cc:1048] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:03.836903 17296 tablet_bootstrap.cc:654] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:03.852880 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:03.854888 17347 raft_consensus.cc:493] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.855681 17347 raft_consensus.cc:515] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.858011 17347 leader_election.cc:290] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:03.859442 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.863456 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098e645055dd449c91b9fe4481f66aa6" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.864651 17027 raft_consensus.cc:2393] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f75c7dc3c3f24e2e800d40d91f7311f4 in current term 1: Already voted for candidate 896fb6e3b27e4874a469245a7b103111 in this term.
I20260709 13:19:03.865227 17297 tablet_bootstrap.cc:654] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.866508 17216 leader_election.cc:304] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:03.868253 17347 raft_consensus.cc:3060] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.871556 17301 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:03.872141 17301 ts_tablet_manager.cc:1403] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.000s
I20260709 13:19:03.873229 17296 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:03.873833 17296 ts_tablet_manager.cc:1403] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.032s
I20260709 13:19:03.875541 17301 raft_consensus.cc:359] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.876340 17301 raft_consensus.cc:385] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.876619 17301 raft_consensus.cc:740] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.877858 17296 raft_consensus.cc:359] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.878643 17324 raft_consensus.cc:493] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.878890 17296 raft_consensus.cc:385] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.879463 17298 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:03.879343 17296 raft_consensus.cc:740] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.879220 17324 raft_consensus.cc:515] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.880100 17298 ts_tablet_manager.cc:1403] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.031s
I20260709 13:19:03.880697 17296 consensus_queue.cc:260] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.881722 17324 leader_election.cc:290] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:03.883193 17298 raft_consensus.cc:359] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.883909 17298 raft_consensus.cc:385] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.884177 17298 raft_consensus.cc:740] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.884305 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7f3735ebc41f691fbce7d2c33ab12" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.885039 17298 consensus_queue.cc:260] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.886142 17251 raft_consensus.cc:2468] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:03.887501 17298 ts_tablet_manager.cc:1434] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:19:03.887570 17304 raft_consensus.cc:493] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.887655 17140 leader_election.cc:304] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:03.888362 17304 raft_consensus.cc:515] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.888897 17353 raft_consensus.cc:2804] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.889370 17353 raft_consensus.cc:493] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.889724 17353 raft_consensus.cc:3060] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.892143 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ec9fe6964476aaa1dcb2b717a1660" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.892871 17177 raft_consensus.cc:2468] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:03.894285 17068 leader_election.cc:304] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:03.885779 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7f3735ebc41f691fbce7d2c33ab12" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:03.895404 17330 raft_consensus.cc:2804] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.895505 17027 raft_consensus.cc:2468] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:03.895862 17330 raft_consensus.cc:493] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.896407 17346 consensus_queue.cc:1048] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:03.898543 17301 consensus_queue.cc:260] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.894094 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ec9fe6964476aaa1dcb2b717a1660" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.896409 17330 raft_consensus.cc:3060] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:03.903383 17066 leader_election.cc:343] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.903532 17296 ts_tablet_manager.cc:1434] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:19:03.890880 17347 raft_consensus.cc:2749] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:03.904713 17296 tablet_bootstrap.cc:492] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:03.906795 17301 ts_tablet_manager.cc:1434] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 13:19:03.908167 17301 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:03.896538 17304 leader_election.cc:290] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.888896 17298 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:03.913822 17353 raft_consensus.cc:515] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.914608 17330 raft_consensus.cc:515] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.927991 17324 consensus_queue.cc:1048] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:03.929234 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ec9fe6964476aaa1dcb2b717a1660" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:03.927997 17330 leader_election.cc:290] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.939733 17304 raft_consensus.cc:493] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.942310 17066 leader_election.cc:343] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:03.944686 17304 raft_consensus.cc:515] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:03.948311 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ec9fe6964476aaa1dcb2b717a1660" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:03.949043 17177 raft_consensus.cc:3060] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.949262 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7f3735ebc41f691fbce7d2c33ab12" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:03.949865 17251 raft_consensus.cc:3060] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.951790 17304 leader_election.cc:290] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:03.953684 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618435fe625b47de9afd290384ff676e" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:03.956565 17250 raft_consensus.cc:2468] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:03.956947 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7f3735ebc41f691fbce7d2c33ab12" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:03.957537 17027 raft_consensus.cc:3060] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.948410 17353 leader_election.cc:290] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:03.960284 17066 leader_election.cc:304] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:03.961983 17330 raft_consensus.cc:2804] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:03.962659 17330 raft_consensus.cc:493] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.963183 17330 raft_consensus.cc:3060] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.963445 17177 raft_consensus.cc:2468] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:03.964892 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618435fe625b47de9afd290384ff676e" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:03.969725 17176 raft_consensus.cc:2468] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:03.968998 17175 raft_consensus.cc:3060] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:03.970654 17376 raft_consensus.cc:493] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.971417 17376 raft_consensus.cc:515] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:03.972827 17027 raft_consensus.cc:2468] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:03.974551 17251 raft_consensus.cc:2468] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:03.974889 17142 leader_election.cc:304] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:03.975947 17353 raft_consensus.cc:2804] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:03.976523 17353 raft_consensus.cc:697] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:03.977787 17297 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:03.977808 17376 leader_election.cc:290] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:03.978453 17297 ts_tablet_manager.cc:1403] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.160s	user 0.032s	sys 0.037s
I20260709 13:19:03.977483 17353 consensus_queue.cc:237] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:03.981020 17301 tablet_bootstrap.cc:654] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.981630 17298 tablet_bootstrap.cc:654] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.981564 17297 raft_consensus.cc:359] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.982645 17297 raft_consensus.cc:385] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:03.982939 17297 raft_consensus.cc:740] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:03.983636 17297 consensus_queue.cc:260] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.985810 17296 tablet_bootstrap.cc:654] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.985968 17297 ts_tablet_manager.cc:1434] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:03.987056 17297 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:03.989559 17347 consensus_queue.cc:1048] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:03.994423 17346 raft_consensus.cc:493] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.994990 17346 raft_consensus.cc:515] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:03.995872 17297 tablet_bootstrap.cc:654] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:03.998025 17346 leader_election.cc:290] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:03.999800 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.001529 17251 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.001801 17330 raft_consensus.cc:515] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.003726 17101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.004343 16991 leader_election.cc:304] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.004745 17101 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.005491 17346 raft_consensus.cc:2804] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.005892 17346 raft_consensus.cc:493] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.006290 17346 raft_consensus.cc:3060] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.009909 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618435fe625b47de9afd290384ff676e" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:04.011358 17251 raft_consensus.cc:3060] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.012837 17330 leader_election.cc:290] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:04.012277 16925 catalog_manager.cc:5697] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.029485 17298 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.031948 17298 ts_tablet_manager.cc:1403] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.007s
I20260709 13:19:04.035347 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.035892 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.036794 17298 raft_consensus.cc:359] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.037829 17298 raft_consensus.cc:385] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.038189 17298 raft_consensus.cc:740] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.039130 17298 consensus_queue.cc:260] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.040999 17353 consensus_queue.cc:1048] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.041904 17298 ts_tablet_manager.cc:1434] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:04.043269 17298 tablet_bootstrap.cc:492] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.045286 17347 raft_consensus.cc:493] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.045957 17347 raft_consensus.cc:515] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.048458 17347 leader_election.cc:290] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.050414 17101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8397c824876e4947a125624f56c2501d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.051424 17101 raft_consensus.cc:2468] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:04.052307 17388 consensus_queue.cc:1048] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.053639 17216 leader_election.cc:304] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
W20260709 13:19:04.057281 17216 consensus_peers.cc:597] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.058262 17310 raft_consensus.cc:2804] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.058137 17068 leader_election.cc:304] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:04.058743 17310 raft_consensus.cc:493] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.059099 17330 raft_consensus.cc:2804] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.059108 17310 raft_consensus.cc:3060] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.059628 17330 raft_consensus.cc:697] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:04.060484 17330 consensus_queue.cc:237] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.065412 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618435fe625b47de9afd290384ff676e" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:04.072306 17175 raft_consensus.cc:3060] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.067752 17310 raft_consensus.cc:515] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.070775 17388 raft_consensus.cc:493] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.066383 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8397c824876e4947a125624f56c2501d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.072963 17251 raft_consensus.cc:2468] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:04.076985 17177 raft_consensus.cc:2468] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:04.074256 17346 raft_consensus.cc:515] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.077857 17310 leader_election.cc:290] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.050444 17301 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.124504 17301 ts_tablet_manager.cc:1403] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.217s	user 0.014s	sys 0.000s
I20260709 13:19:04.126977 17346 leader_election.cc:290] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:04.134362 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:04.135005 17251 raft_consensus.cc:3060] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.127808 17301 raft_consensus.cc:359] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.128834 17066 leader_election.cc:304] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.079881 17330 consensus_queue.cc:1048] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:19:04.137049 17376 raft_consensus.cc:2804] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.137558 17301 raft_consensus.cc:385] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.137646 17376 raft_consensus.cc:697] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:04.137920 17301 raft_consensus.cc:740] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.090361 17175 raft_consensus.cc:2468] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:04.112000 17353 raft_consensus.cc:493] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.138682 17376 consensus_queue.cc:237] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.138939 17353 raft_consensus.cc:515] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.139358 17301 consensus_queue.cc:260] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.141216 17353 leader_election.cc:290] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:04.076593 17388 raft_consensus.cc:515] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.079950 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8397c824876e4947a125624f56c2501d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:04.080797 17298 tablet_bootstrap.cc:654] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.100291 17296 tablet_bootstrap.cc:492] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.146152 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.146703 17296 ts_tablet_manager.cc:1403] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.242s	user 0.009s	sys 0.007s
I20260709 13:19:04.146171 17174 raft_consensus.cc:3060] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:04.082914 17068 leader_election.cc:343] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:04.148402 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 65537.5us
I20260709 13:19:04.120985 17297 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:04.095907 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8397c824876e4947a125624f56c2501d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:04.133092 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:04.107352 17392 raft_consensus.cc:493] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.143994 17388 leader_election.cc:290] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:04.146186 17101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.152659 17392 raft_consensus.cc:515] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:04.153240 17068 leader_election.cc:343] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.153770 17068 leader_election.cc:304] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.153939 17102 raft_consensus.cc:3060] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.154541 16993 leader_election.cc:304] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:04.155260 17392 leader_election.cc:290] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:04.156318 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.144048 17251 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.149302 17297 ts_tablet_manager.cc:1403] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.162s	user 0.026s	sys 0.011s
I20260709 13:19:04.150274 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.150929 17103 raft_consensus.cc:3060] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.151315 17028 raft_consensus.cc:3060] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.166422 17330 raft_consensus.cc:2749] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.168715 17297 raft_consensus.cc:359] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.169450 17297 raft_consensus.cc:385] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.169723 17297 raft_consensus.cc:740] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.170444 17297 consensus_queue.cc:260] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.151696 17296 raft_consensus.cc:359] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.159560 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.161191 17301 ts_tablet_manager.cc:1434] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:19:04.161691 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.162533 17174 raft_consensus.cc:2468] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:04.172899 17296 raft_consensus.cc:385] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.179546 17297 ts_tablet_manager.cc:1434] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:04.185773 17301 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:04.184474 17216 leader_election.cc:343] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.184973 17297 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:04.182740 17296 raft_consensus.cc:740] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.201538 17296 consensus_queue.cc:260] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.198709 16991 leader_election.cc:304] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.183951 17142 leader_election.cc:304] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:04.200513 17216 leader_election.cc:304] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.202509 17398 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.207849 17398 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.208938 17392 raft_consensus.cc:2804] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.209501 17392 raft_consensus.cc:697] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:04.210290 17102 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.210456 17297 tablet_bootstrap.cc:654] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.211603 17392 consensus_queue.cc:237] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.213542 17298 tablet_bootstrap.cc:492] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.214057 17298 ts_tablet_manager.cc:1403] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.011s
W20260709 13:19:04.216135 17216 leader_election.cc:343] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.217270 17216 leader_election.cc:304] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:04.219094 17301 tablet_bootstrap.cc:654] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.219223 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.219587 17298 raft_consensus.cc:359] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.220245 17298 raft_consensus.cc:385] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.220517 17298 raft_consensus.cc:740] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
W20260709 13:19:04.220945 16993 leader_election.cc:343] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.220749 17103 raft_consensus.cc:2468] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:04.221269 17298 consensus_queue.cc:260] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.222077 17395 raft_consensus.cc:2749] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.223526 17298 ts_tablet_manager.cc:1434] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:04.225661 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.227370 17298 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.231909 17296 ts_tablet_manager.cc:1434] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.002s
I20260709 13:19:04.234021 17251 raft_consensus.cc:2468] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.232800 16926 catalog_manager.cc:5697] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.239319 16926 catalog_manager.cc:5697] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.242420 17296 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.224762 17398 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:04.246120 17385 raft_consensus.cc:2749] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:04.236972 16991 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.248425 17399 raft_consensus.cc:2804] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.249034 17399 raft_consensus.cc:697] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:04.249946 17399 consensus_queue.cc:237] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.251922 17346 raft_consensus.cc:2804] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.252378 17346 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.252763 17346 raft_consensus.cc:3060] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.268993 17296 tablet_bootstrap.cc:654] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.275046 17330 raft_consensus.cc:493] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.275751 17330 raft_consensus.cc:515] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.276230 16925 catalog_manager.cc:5697] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.279841 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.281599 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:04.283725 17068 leader_election.cc:343] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:04.284432 17068 leader_election.cc:343] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.284829 17068 leader_election.cc:304] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.285753 17376 raft_consensus.cc:2749] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.277971 17330 leader_election.cc:290] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.291132 17346 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.294436 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:04.295636 17298 tablet_bootstrap.cc:654] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:04.296502 16993 leader_election.cc:343] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.298602 17392 raft_consensus.cc:493] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.299347 17392 raft_consensus.cc:515] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.306638 17392 leader_election.cc:290] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.309379 17301 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.309875 17301 ts_tablet_manager.cc:1403] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.006s
I20260709 13:19:04.310511 17346 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:04.313516 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ec9fe6964476aaa1dcb2b717a1660" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.313793 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2ec9fe6964476aaa1dcb2b717a1660" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.314623 17176 raft_consensus.cc:2393] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f75c7dc3c3f24e2e800d40d91f7311f4 in current term 1: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:04.316229 17297 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:04.316251 17216 leader_election.cc:304] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.316679 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:04.316881 17297 ts_tablet_manager.cc:1403] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.002s
I20260709 13:19:04.317284 17251 raft_consensus.cc:3060] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.317777 17392 raft_consensus.cc:3060] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.316411 17301 raft_consensus.cc:359] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.320182 17301 raft_consensus.cc:385] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.320425 17301 raft_consensus.cc:740] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.319765 17388 raft_consensus.cc:2749] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.323849 17298 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.324402 17298 ts_tablet_manager.cc:1403] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.000s
I20260709 13:19:04.321393 17301 consensus_queue.cc:260] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.330166 17392 raft_consensus.cc:2749] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.330835 17301 ts_tablet_manager.cc:1434] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:19:04.331869 17301 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.331629 17298 raft_consensus.cc:359] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.332381 17298 raft_consensus.cc:385] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.332672 17298 raft_consensus.cc:740] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.333384 17298 consensus_queue.cc:260] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.335472 17298 ts_tablet_manager.cc:1434] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:19:04.335762 17296 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.336264 17296 ts_tablet_manager.cc:1403] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.103s	user 0.003s	sys 0.016s
I20260709 13:19:04.337868 16925 catalog_manager.cc:5697] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.339264 17297 raft_consensus.cc:359] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.339915 17297 raft_consensus.cc:385] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.340147 17297 raft_consensus.cc:740] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.340807 17297 consensus_queue.cc:260] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.327860 17251 raft_consensus.cc:2468] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.345341 16991 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.346622 17388 raft_consensus.cc:2804] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.347150 17388 raft_consensus.cc:697] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:04.347879 17298 tablet_bootstrap.cc:492] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.348075 17388 consensus_queue.cc:237] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.338380 17296 raft_consensus.cc:359] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.350629 17296 raft_consensus.cc:385] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.350953 17296 raft_consensus.cc:740] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.351693 17296 consensus_queue.cc:260] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.353837 17296 ts_tablet_manager.cc:1434] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:19:04.355532 17297 ts_tablet_manager.cc:1434] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:19:04.356606 17298 tablet_bootstrap.cc:654] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.356818 17297 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:04.363310 17301 tablet_bootstrap.cc:654] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.366042 17297 tablet_bootstrap.cc:654] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.369722 17298 tablet_bootstrap.cc:492] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.369961 17296 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.370292 17298 ts_tablet_manager.cc:1403] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:19:04.370934 17301 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.371490 17301 ts_tablet_manager.cc:1403] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.005s
I20260709 13:19:04.373425 17298 raft_consensus.cc:359] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.374179 17298 raft_consensus.cc:385] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.374806 17298 raft_consensus.cc:740] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.374974 17301 raft_consensus.cc:359] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.375927 17301 raft_consensus.cc:385] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.376269 17301 raft_consensus.cc:740] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.375571 17298 consensus_queue.cc:260] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.376835 17296 tablet_bootstrap.cc:654] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.368767 16923 catalog_manager.cc:5697] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.377010 17301 consensus_queue.cc:260] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.380072 17301 ts_tablet_manager.cc:1434] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:19:04.381522 17298 ts_tablet_manager.cc:1434] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:04.387197 17298 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.387705 17296 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.388033 17301 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.393487 17298 tablet_bootstrap.cc:654] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.395561 17301 tablet_bootstrap.cc:654] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.388221 17296 ts_tablet_manager.cc:1403] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:19:04.388324 17297 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:04.399381 17297 ts_tablet_manager.cc:1403] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.005s
I20260709 13:19:04.401683 17296 raft_consensus.cc:359] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.402853 17296 raft_consensus.cc:385] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.403280 17296 raft_consensus.cc:740] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.404321 17296 consensus_queue.cc:260] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.406847 17392 raft_consensus.cc:493] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.407495 17392 raft_consensus.cc:515] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.414565 17385 raft_consensus.cc:493] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.415553 17392 leader_election.cc:290] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.415380 17385 raft_consensus.cc:515] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.417959 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4ba9ad373e446b82700a8a82294225" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.419481 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4ba9ad373e446b82700a8a82294225" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.423094 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.423863 17297 raft_consensus.cc:359] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.425037 17297 raft_consensus.cc:385] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:04.425244 17142 leader_election.cc:343] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.425431 17297 raft_consensus.cc:740] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.426781 17297 consensus_queue.cc:260] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.427934 17385 leader_election.cc:290] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
W20260709 13:19:04.426801 17216 leader_election.cc:343] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:04.429482 17216 leader_election.cc:343] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.429922 17216 leader_election.cc:304] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.430414 17297 ts_tablet_manager.cc:1434] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:19:04.430876 17392 raft_consensus.cc:2749] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.431881 17330 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.432893 17388 raft_consensus.cc:493] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.433652 17388 raft_consensus.cc:515] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.432600 17330 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.437768 17330 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.445953 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.438444 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.439828 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.447779 17296 ts_tablet_manager.cc:1434] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:19:04.441504 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.448542 17176 raft_consensus.cc:2468] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.450435 16993 leader_election.cc:304] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
W20260709 13:19:04.450955 17140 leader_election.cc:343] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.441907 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.451562 17140 leader_election.cc:304] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:04.452119 17346 raft_consensus.cc:2804] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.452553 17346 raft_consensus.cc:493] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.452919 17346 raft_consensus.cc:3060] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:04.459000 17068 leader_election.cc:343] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:04.461133 17068 leader_election.cc:343] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.462494 17385 raft_consensus.cc:2749] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.461840 17068 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.445768 17388 leader_election.cc:290] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.462608 17103 raft_consensus.cc:2468] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.467619 17301 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.468132 17301 ts_tablet_manager.cc:1403] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.037s
I20260709 13:19:04.469534 17346 raft_consensus.cc:515] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.470180 17385 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.470791 17330 raft_consensus.cc:2749] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.470651 17301 raft_consensus.cc:359] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.471428 17301 raft_consensus.cc:385] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.471722 17301 raft_consensus.cc:740] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.471940 17346 leader_election.cc:290] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.471822 17297 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:04.472486 17301 consensus_queue.cc:260] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.472946 17330 consensus_queue.cc:1048] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.470746 17385 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.474628 17301 ts_tablet_manager.cc:1434] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:19:04.475605 17298 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.475811 17301 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.474634 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:04.476310 17298 ts_tablet_manager.cc:1403] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.089s	user 0.034s	sys 0.041s
I20260709 13:19:04.476413 17103 raft_consensus.cc:3060] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.481055 17385 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.475477 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:04.481279 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.481806 17296 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.479169 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.482282 17301 tablet_bootstrap.cc:654] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.482676 17251 raft_consensus.cc:2393] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:04.484073 17140 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:04.485222 17385 raft_consensus.cc:3060] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.481938 17174 raft_consensus.cc:3060] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.488507 17297 tablet_bootstrap.cc:654] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.485093 17298 raft_consensus.cc:359] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.491267 17298 raft_consensus.cc:385] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.491772 17298 raft_consensus.cc:740] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.492939 17298 consensus_queue.cc:260] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.493867 17385 raft_consensus.cc:2749] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.496322 17298 ts_tablet_manager.cc:1434] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:19:04.502591 17330 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.509646 17330 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.510296 17298 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.513037 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.513787 17251 raft_consensus.cc:2468] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:04.515401 17066 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.516690 17376 raft_consensus.cc:2804] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.517081 17376 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.517442 17376 raft_consensus.cc:3060] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.517503 17298 tablet_bootstrap.cc:654] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.522581 17392 raft_consensus.cc:493] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.523165 17392 raft_consensus.cc:515] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.525395 17392 leader_election.cc:290] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.526278 17346 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.526943 17346 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.527490 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c639a326f04d8d8eed7bd41bc8df2b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.527626 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c639a326f04d8d8eed7bd41bc8df2b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.529124 17346 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:04.530050 17216 leader_election.cc:343] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:04.530805 17216 leader_election.cc:343] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.531275 17216 leader_election.cc:304] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.532186 17330 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.532495 17301 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.533133 17301 ts_tablet_manager.cc:1403] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.058s	user 0.024s	sys 0.026s
I20260709 13:19:04.530835 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.534855 17392 raft_consensus.cc:2749] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.536489 17301 raft_consensus.cc:359] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.537210 17301 raft_consensus.cc:385] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.537489 17301 raft_consensus.cc:740] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.535673 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.538447 17251 raft_consensus.cc:2468] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.538203 17301 consensus_queue.cc:260] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.539875 16991 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.540699 17346 raft_consensus.cc:2804] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.541157 17346 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.541600 17346 raft_consensus.cc:3060] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.544196 17304 consensus_queue.cc:1048] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.547936 17298 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.548601 17298 ts_tablet_manager.cc:1403] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.008s
I20260709 13:19:04.508953 17296 tablet_bootstrap.cc:654] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.550805 17346 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.552914 17298 raft_consensus.cc:359] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.554188 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:04.554829 17298 raft_consensus.cc:385] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.555163 17250 raft_consensus.cc:3060] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.555190 17298 raft_consensus.cc:740] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.556319 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.557284 17026 raft_consensus.cc:2393] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:04.557242 17298 consensus_queue.cc:260] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.559430 17301 ts_tablet_manager.cc:1434] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:19:04.560359 17346 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:04.561600 17301 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.561657 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:04.560768 17103 raft_consensus.cc:2468] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.564339 17174 raft_consensus.cc:2468] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.565253 16993 leader_election.cc:304] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:04.566497 17298 ts_tablet_manager.cc:1434] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:04.567593 17298 tablet_bootstrap.cc:492] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.568972 17301 tablet_bootstrap.cc:654] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.574278 17324 consensus_queue.cc:1048] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.579368 17388 raft_consensus.cc:2804] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.580330 17388 raft_consensus.cc:697] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:04.582044 17298 tablet_bootstrap.cc:654] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.582334 17301 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.582827 17301 ts_tablet_manager.cc:1403] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:19:04.549796 17376 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.586218 17102 raft_consensus.cc:2393] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:04.586741 17301 raft_consensus.cc:359] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.587476 17301 raft_consensus.cc:385] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.587769 17301 raft_consensus.cc:740] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.588881 17376 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.588570 17301 consensus_queue.cc:260] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.588987 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:04.590730 17028 raft_consensus.cc:3060] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.582566 17388 consensus_queue.cc:237] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.601642 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:04.602964 17027 raft_consensus.cc:2393] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:04.605113 17301 ts_tablet_manager.cc:1434] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:19:04.606536 17301 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.590902 17250 raft_consensus.cc:2468] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.610771 17324 consensus_queue.cc:1048] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.611622 16991 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:04.612644 17346 raft_consensus.cc:2804] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.613269 17346 raft_consensus.cc:697] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:04.614126 17346 consensus_queue.cc:237] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.618573 17398 raft_consensus.cc:493] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.619268 17398 raft_consensus.cc:515] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.617419 17068 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:04.624006 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.624419 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.624745 17102 raft_consensus.cc:2468] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:04.626112 16993 leader_election.cc:304] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
W20260709 13:19:04.627348 16993 leader_election.cc:343] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.628937 17399 raft_consensus.cc:2804] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.629488 17399 raft_consensus.cc:493] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.629918 17399 raft_consensus.cc:3060] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.632947 17378 consensus_queue.cc:1048] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.634946 17376 raft_consensus.cc:2749] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.621914 17398 leader_election.cc:290] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.649123 17296 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.649887 17296 ts_tablet_manager.cc:1403] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.000s
I20260709 13:19:04.655862 17296 raft_consensus.cc:359] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.656858 17296 raft_consensus.cc:385] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.657352 17296 raft_consensus.cc:740] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.659082 17301 tablet_bootstrap.cc:654] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.658262 17296 consensus_queue.cc:260] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.651463 17398 raft_consensus.cc:493] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.664300 17398 raft_consensus.cc:515] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.670337 17296 ts_tablet_manager.cc:1434] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:19:04.671391 17296 tablet_bootstrap.cc:492] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.671382 17398 leader_election.cc:290] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.673121 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:04.677141 17298 tablet_bootstrap.cc:492] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.677675 17298 ts_tablet_manager.cc:1403] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.025s
I20260709 13:19:04.679563 17296 tablet_bootstrap.cc:654] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.683229 17298 raft_consensus.cc:359] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.684257 17298 raft_consensus.cc:385] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.684613 17298 raft_consensus.cc:740] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.681447 17399 raft_consensus.cc:515] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.694198 17297 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:04.695814 17297 ts_tablet_manager.cc:1403] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.264s	user 0.037s	sys 0.061s
I20260709 13:19:04.698160 16924 catalog_manager.cc:5697] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.703631 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:04.704304 17174 raft_consensus.cc:3060] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.707222 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:04.707927 17102 raft_consensus.cc:3060] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.710250 17301 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.710812 17301 ts_tablet_manager.cc:1403] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.001s
I20260709 13:19:04.713652 17301 raft_consensus.cc:359] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.714371 17301 raft_consensus.cc:385] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.716372 17301 raft_consensus.cc:740] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.717064 17301 consensus_queue.cc:260] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.718931 17304 consensus_queue.cc:1048] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.719380 17301 ts_tablet_manager.cc:1434] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:19:04.720414 17301 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.720602 17398 consensus_queue.cc:1048] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.726778 17301 tablet_bootstrap.cc:654] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.699615 17297 raft_consensus.cc:359] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.685539 17298 consensus_queue.cc:260] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.729279 17174 raft_consensus.cc:2468] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.733457 16993 leader_election.cc:304] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:04.702410 17399 leader_election.cc:290] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:04.733582 17298 ts_tablet_manager.cc:1434] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:19:04.734521 17431 raft_consensus.cc:2804] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.735229 17431 raft_consensus.cc:697] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:04.735489 17298 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.736102 17431 consensus_queue.cc:237] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.695053 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.741271 16993 leader_election.cc:304] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.743007 17398 raft_consensus.cc:2749] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.743947 17298 tablet_bootstrap.cc:654] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.732197 17297 raft_consensus.cc:385] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.746191 17392 raft_consensus.cc:493] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.746795 17392 raft_consensus.cc:515] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.747694 17297 raft_consensus.cc:740] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.748809 17392 leader_election.cc:290] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.749464 17102 raft_consensus.cc:2468] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:04.748935 17297 consensus_queue.cc:260] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.751569 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25597e8e2479b9bf69918cf1c0a02" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:04.753705 17216 leader_election.cc:343] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.754000 17297 ts_tablet_manager.cc:1434] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:19:04.755100 17297 tablet_bootstrap.cc:492] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:04.765475 17296 tablet_bootstrap.cc:492] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.766683 17296 ts_tablet_manager.cc:1403] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.017s
I20260709 13:19:04.751585 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25597e8e2479b9bf69918cf1c0a02" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:04.769500 17298 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.770184 17298 ts_tablet_manager.cc:1403] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.002s
I20260709 13:19:04.773167 17298 raft_consensus.cc:359] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.774036 17298 raft_consensus.cc:385] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.774441 17298 raft_consensus.cc:740] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.775242 17298 consensus_queue.cc:260] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.776798 17297 tablet_bootstrap.cc:654] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.777840 17298 ts_tablet_manager.cc:1434] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:04.778117 17346 consensus_queue.cc:1048] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.779079 17298 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
W20260709 13:19:04.783399 17216 leader_election.cc:343] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.787220 17216 leader_election.cc:304] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:04.790903 17392 raft_consensus.cc:2749] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:04.797171 17301 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.797742 17301 ts_tablet_manager.cc:1403] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.007s
I20260709 13:19:04.801378 17392 consensus_queue.cc:1048] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:04.803397 17296 raft_consensus.cc:359] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.804217 17296 raft_consensus.cc:385] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.804490 17296 raft_consensus.cc:740] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.805222 17296 consensus_queue.cc:260] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.807451 17296 ts_tablet_manager.cc:1434] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:19:04.807123 17301 raft_consensus.cc:359] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.807919 17301 raft_consensus.cc:385] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.808234 17301 raft_consensus.cc:740] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.808483 17296 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.808979 17301 consensus_queue.cc:260] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.815774 17298 tablet_bootstrap.cc:654] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.816519 17301 ts_tablet_manager.cc:1434] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:04.817560 17301 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.823458 16924 catalog_manager.cc:5697] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.825598 16924 catalog_manager.cc:5697] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.826702 17301 tablet_bootstrap.cc:654] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.828754 17304 raft_consensus.cc:493] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.829557 17304 raft_consensus.cc:515] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.833873 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.834880 17251 raft_consensus.cc:2468] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:04.838129 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:04.839010 17066 leader_election.cc:304] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.840371 17378 raft_consensus.cc:2804] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:04.840924 17378 raft_consensus.cc:493] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.841368 17378 raft_consensus.cc:3060] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.845317 17301 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.845850 17301 ts_tablet_manager.cc:1403] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.002s
W20260709 13:19:04.848280 17068 leader_election.cc:343] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.848685 17296 tablet_bootstrap.cc:654] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.848762 17301 raft_consensus.cc:359] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.849586 17301 raft_consensus.cc:385] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.849874 17301 raft_consensus.cc:740] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.862720 17447 consensus_queue.cc:1048] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.862861 17398 consensus_queue.cc:1048] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:04.867539 17296 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.868121 17296 ts_tablet_manager.cc:1403] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.000s
I20260709 13:19:04.876379 17296 raft_consensus.cc:359] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.877151 17296 raft_consensus.cc:385] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.877439 17296 raft_consensus.cc:740] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.881311 17304 leader_election.cc:290] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.881650 17301 consensus_queue.cc:260] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.884267 17301 ts_tablet_manager.cc:1434] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:19:04.885334 17301 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.878115 17296 consensus_queue.cc:260] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.893857 17296 ts_tablet_manager.cc:1434] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:19:04.894878 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:04.897418 17301 tablet_bootstrap.cc:654] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.895020 17296 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.916577 17296 tablet_bootstrap.cc:654] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.916719 17301 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:04.917418 17301 ts_tablet_manager.cc:1403] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 13:19:04.919483 17297 tablet_bootstrap.cc:492] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:04.920287 17297 ts_tablet_manager.cc:1403] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.024s
I20260709 13:19:04.921053 17301 raft_consensus.cc:359] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.922196 17301 raft_consensus.cc:385] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.922691 17301 raft_consensus.cc:740] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.923730 17301 consensus_queue.cc:260] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:04.925441 17297 raft_consensus.cc:359] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.926545 17297 raft_consensus.cc:385] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.926932 17297 raft_consensus.cc:740] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.927134 17301 ts_tablet_manager.cc:1434] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:04.931586 17296 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:04.932189 17296 ts_tablet_manager.cc:1403] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.002s
I20260709 13:19:04.935140 17296 raft_consensus.cc:359] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.935861 17296 raft_consensus.cc:385] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.936118 17296 raft_consensus.cc:740] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.939947 17301 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:04.937036 17296 consensus_queue.cc:260] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.948138 17297 consensus_queue.cc:260] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:04.949904 17378 raft_consensus.cc:515] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.943145 17296 ts_tablet_manager.cc:1434] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:19:04.956288 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:04.956846 17296 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:04.956959 17251 raft_consensus.cc:3060] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:04.958631 17298 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:04.959602 17298 ts_tablet_manager.cc:1403] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.181s	user 0.066s	sys 0.065s
I20260709 13:19:04.962782 17398 consensus_queue.cc:1048] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:04.963056 17298 raft_consensus.cc:359] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.966440 17298 raft_consensus.cc:385] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:04.960150 17301 tablet_bootstrap.cc:654] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:04.966777 17298 raft_consensus.cc:740] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.978179 17251 raft_consensus.cc:2468] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:04.979362 17298 consensus_queue.cc:260] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.981083 17378 leader_election.cc:290] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.985586 17324 raft_consensus.cc:493] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.986132 17066 leader_election.cc:304] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.986147 17324 raft_consensus.cc:515] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:04.987530 17378 raft_consensus.cc:2804] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:04.988310 17378 raft_consensus.cc:697] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:04.981643 17298 ts_tablet_manager.cc:1434] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:19:04.988672 17324 leader_election.cc:290] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:04.982663 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:04.989351 17378 consensus_queue.cc:237] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:04.989765 17298 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:04.990631 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25597e8e2479b9bf69918cf1c0a02" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:04.992942 17251 raft_consensus.cc:2468] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
W20260709 13:19:04.993433 17068 leader_election.cc:343] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:04.995013 17140 leader_election.cc:304] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:04.998998 17027 raft_consensus.cc:3060] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.000763 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25597e8e2479b9bf69918cf1c0a02" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.001492 17026 raft_consensus.cc:2468] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:05.004361 17297 ts_tablet_manager.cc:1434] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.000s
I20260709 13:19:05.005268 17297 tablet_bootstrap.cc:492] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:04.999260 17324 raft_consensus.cc:2804] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.007160 17324 raft_consensus.cc:493] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.007535 17324 raft_consensus.cc:3060] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.026621 17296 tablet_bootstrap.cc:654] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.027702 17298 tablet_bootstrap.cc:654] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.028200 17447 raft_consensus.cc:493] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.028913 17447 raft_consensus.cc:515] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.030879 17398 consensus_queue.cc:1048] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.034204 17297 tablet_bootstrap.cc:654] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.020694 17324 raft_consensus.cc:515] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.039660 17301 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:05.049474 17301 ts_tablet_manager.cc:1403] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.023s
I20260709 13:19:05.051851 17298 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:05.052598 17298 ts_tablet_manager.cc:1403] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.000s
I20260709 13:19:05.054204 17398 raft_consensus.cc:493] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.056255 17385 raft_consensus.cc:493] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.056592 17398 raft_consensus.cc:515] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.056807 17385 raft_consensus.cc:515] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.056991 17301 raft_consensus.cc:359] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.057756 17301 raft_consensus.cc:385] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.057826 17324 leader_election.cc:290] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:05.058099 17301 raft_consensus.cc:740] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.058826 17385 leader_election.cc:290] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:05.058987 17398 leader_election.cc:290] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:05.060143 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.060585 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:05.060930 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c639a326f04d8d8eed7bd41bc8df2b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.061403 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c639a326f04d8d8eed7bd41bc8df2b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.061615 17028 raft_consensus.cc:2468] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:05.062112 17249 raft_consensus.cc:2468] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
W20260709 13:19:05.062332 16993 leader_election.cc:343] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.060585 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25597e8e2479b9bf69918cf1c0a02" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:05.060824 17250 raft_consensus.cc:2468] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:05.063107 17026 raft_consensus.cc:3060] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.036623 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.064137 16991 leader_election.cc:304] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:05.064850 17102 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:05.066063 17216 leader_election.cc:304] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:05.066680 17440 raft_consensus.cc:2804] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.067176 17453 raft_consensus.cc:2804] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.067801 17453 raft_consensus.cc:493] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.067467 17298 raft_consensus.cc:359] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.067092 17142 leader_election.cc:304] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:05.068298 17298 raft_consensus.cc:385] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.068696 17298 raft_consensus.cc:740] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.068192 17453 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.073058 17388 consensus_queue.cc:1048] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.067138 17440 raft_consensus.cc:493] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.070120 16923 catalog_manager.cc:5697] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.075013 17440 raft_consensus.cc:3060] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.074818 17301 consensus_queue.cc:260] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.078004 17385 raft_consensus.cc:2804] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.078104 17447 leader_election.cc:290] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.078651 17385 raft_consensus.cc:493] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.079099 17385 raft_consensus.cc:3060] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.079618 17301 ts_tablet_manager.cc:1434] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.005s
I20260709 13:19:05.080631 17301 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:05.081027 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:05.081815 17174 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:05.061002 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b25597e8e2479b9bf69918cf1c0a02" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:05.084493 17251 raft_consensus.cc:3060] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.086863 17385 raft_consensus.cc:515] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.087818 17298 consensus_queue.cc:260] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.090692 17301 tablet_bootstrap.cc:654] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.091480 17298 ts_tablet_manager.cc:1434] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:19:05.092578 17298 tablet_bootstrap.cc:492] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:05.097630 17324 raft_consensus.cc:493] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.098529 17385 leader_election.cc:290] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:05.098333 17324 raft_consensus.cc:515] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.102916 17298 tablet_bootstrap.cc:654] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.105686 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4ba9ad373e446b82700a8a82294225" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.108618 17388 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.109225 17388 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.109993 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c639a326f04d8d8eed7bd41bc8df2b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:05.110877 17028 raft_consensus.cc:3060] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.111470 17388 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.112066 17388 consensus_queue.cc:1048] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.114164 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
W20260709 13:19:05.116150 16993 leader_election.cc:343] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.117002 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.121574 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4ba9ad373e446b82700a8a82294225" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.122397 17248 raft_consensus.cc:2468] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:05.122967 17103 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:05.125088 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c639a326f04d8d8eed7bd41bc8df2b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:05.125963 17249 raft_consensus.cc:3060] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.130973 17026 raft_consensus.cc:2468] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:05.133690 16993 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:05.143836 17399 raft_consensus.cc:2804] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.144392 17399 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.144834 17399 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.144974 17398 consensus_queue.cc:1048] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:05.139015 17142 leader_election.cc:343] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.149693 17140 leader_election.cc:304] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:05.151082 17353 raft_consensus.cc:2804] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.151609 17353 raft_consensus.cc:493] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.152061 17353 raft_consensus.cc:3060] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.161988 17324 leader_election.cc:290] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:05.167441 17142 leader_election.cc:304] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:05.170058 17385 raft_consensus.cc:2804] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.170205 17251 raft_consensus.cc:2468] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:05.170864 17385 raft_consensus.cc:697] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:05.172125 17385 consensus_queue.cc:237] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.140153 17453 raft_consensus.cc:515] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.206065 17028 raft_consensus.cc:2468] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:05.235478 17296 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.235996 17296 ts_tablet_manager.cc:1403] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.279s	user 0.008s	sys 0.011s
I20260709 13:19:05.243181 17249 raft_consensus.cc:2468] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:05.233737 17453 leader_election.cc:290] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.248215 17353 raft_consensus.cc:515] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.252568 17353 leader_election.cc:290] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:05.232218 17440 raft_consensus.cc:515] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.247665 17142 leader_election.cc:304] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:05.250511 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.254218 17102 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.257302 17298 tablet_bootstrap.cc:492] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:05.257793 17298 ts_tablet_manager.cc:1403] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.165s	user 0.008s	sys 0.019s
I20260709 13:19:05.262759 17301 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:05.263274 17301 ts_tablet_manager.cc:1403] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.183s	user 0.019s	sys 0.011s
I20260709 13:19:05.268929 17297 tablet_bootstrap.cc:492] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.269470 17297 ts_tablet_manager.cc:1403] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.264s	user 0.016s	sys 0.018s
I20260709 13:19:05.259681 17353 raft_consensus.cc:2804] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.271661 17296 raft_consensus.cc:359] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.275660 17296 raft_consensus.cc:385] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.275933 17296 raft_consensus.cc:740] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.262424 17399 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.278872 17296 consensus_queue.cc:260] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.272428 17453 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.284265 17399 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.276364 17353 raft_consensus.cc:697] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:05.284823 17301 raft_consensus.cc:359] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.285341 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4ba9ad373e446b82700a8a82294225" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:05.285480 17353 consensus_queue.cc:237] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.286062 17251 raft_consensus.cc:3060] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.282660 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c4ba9ad373e446b82700a8a82294225" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.285547 17301 raft_consensus.cc:385] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.288383 17301 raft_consensus.cc:740] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.287406 17399 consensus_queue.cc:1048] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:05.284327 17453 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.289124 17301 consensus_queue.cc:260] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.274776 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:05.290334 17175 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.293371 17388 raft_consensus.cc:493] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.294061 17388 raft_consensus.cc:515] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.297857 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:05.299088 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.300769 17103 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.299964 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:05.303247 17177 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.324621 17301 ts_tablet_manager.cc:1434] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:19:05.286166 17296 ts_tablet_manager.cc:1434] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.006s
I20260709 13:19:05.325850 17301 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:05.329473 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:05.330178 17248 raft_consensus.cc:3060] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.335623 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.336611 17250 raft_consensus.cc:2393] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:05.337150 17297 raft_consensus.cc:359] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.337900 17297 raft_consensus.cc:385] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.338176 17297 raft_consensus.cc:740] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.338943 17297 consensus_queue.cc:260] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.340404 17100 raft_consensus.cc:3060] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.340689 17431 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.341181 17431 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.343417 17431 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:05.343954 17431 consensus_queue.cc:1048] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.345582 17177 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:05.326211 17296 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:05.347620 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.348917 17101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c69155bc1714330b50c63899c8400fb" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.350368 17440 leader_election.cc:290] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:05.350548 17100 raft_consensus.cc:2468] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:05.351012 17103 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:05.352022 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.355011 17298 raft_consensus.cc:359] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.356506 17453 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:05.356769 16993 leader_election.cc:343] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.372246 16993 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:05.369829 17301 tablet_bootstrap.cc:654] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.358969 17297 ts_tablet_manager.cc:1434] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 13:19:05.359138 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.363758 17250 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
W20260709 13:19:05.326786 17140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 54253.1us
I20260709 13:19:05.377274 17297 tablet_bootstrap.cc:492] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:05.346855 17388 leader_election.cc:290] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:05.357918 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.369913 17298 raft_consensus.cc:385] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.380945 17298 raft_consensus.cc:740] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.375918 17440 raft_consensus.cc:2804] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.381805 17440 raft_consensus.cc:697] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:05.382208 17298 consensus_queue.cc:260] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.382956 17440 consensus_queue.cc:237] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.384233 17298 ts_tablet_manager.cc:1434] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.126s	user 0.003s	sys 0.005s
I20260709 13:19:05.385212 17298 tablet_bootstrap.cc:492] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:05.385990 17175 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:05.379427 17026 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:05.374029 16993 leader_election.cc:304] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:05.394562 17142 leader_election.cc:304] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:05.395496 17353 raft_consensus.cc:2804] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.395593 17431 raft_consensus.cc:3060] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.396090 17353 raft_consensus.cc:697] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:05.396991 17353 consensus_queue.cc:237] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
W20260709 13:19:05.389338 17216 leader_election.cc:343] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.400043 17216 leader_election.cc:304] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:05.389596 16924 catalog_manager.cc:5697] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.402441 17453 raft_consensus.cc:2804] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.401978 16924 catalog_manager.cc:5697] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.404354 17296 tablet_bootstrap.cc:654] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.404865 17251 raft_consensus.cc:2468] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:05.390426 16991 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
W20260709 13:19:05.405794 16993 leader_election.cc:343] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.406016 17388 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.406672 17388 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.407160 17388 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.406981 17216 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:05.409538 17392 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.409965 17392 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.410405 17392 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.411017 17248 raft_consensus.cc:2468] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:05.414907 16991 leader_election.cc:304] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:05.415786 17399 raft_consensus.cc:2804] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.416311 17399 raft_consensus.cc:697] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:05.417207 17399 consensus_queue.cc:237] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.406106 17453 raft_consensus.cc:697] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:05.419401 17297 tablet_bootstrap.cc:654] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.438664 17388 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.419530 17102 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:05.419289 17453 consensus_queue.cc:237] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.421116 17392 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.392611 17298 tablet_bootstrap.cc:654] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.447460 17296 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.448081 17296 ts_tablet_manager.cc:1403] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.000s
I20260709 13:19:05.434756 17431 raft_consensus.cc:2749] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.435273 16924 catalog_manager.cc:5697] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.437141 17301 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:05.457038 17301 ts_tablet_manager.cc:1403] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.000s
I20260709 13:19:05.452672 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:05.458673 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:05.458963 17027 raft_consensus.cc:2393] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f75c7dc3c3f24e2e800d40d91f7311f4 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:05.460741 17248 raft_consensus.cc:2393] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:05.451864 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.447489 17392 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:05.463112 17388 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:05.463403 17296 raft_consensus.cc:359] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.464459 17296 raft_consensus.cc:385] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.464808 17296 raft_consensus.cc:740] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.464982 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
W20260709 13:19:05.463581 17216 leader_election.cc:343] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.465904 17216 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:05.465628 17296 consensus_queue.cc:260] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
W20260709 13:19:05.467199 16993 leader_election.cc:343] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.467244 17392 raft_consensus.cc:2749] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.467774 16993 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:05.468937 17346 raft_consensus.cc:2749] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.469764 17296 ts_tablet_manager.cc:1434] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:19:05.461926 17301 raft_consensus.cc:359] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.470613 17301 raft_consensus.cc:385] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.470902 17301 raft_consensus.cc:740] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.471047 17296 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:05.471565 17301 consensus_queue.cc:260] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.472921 17353 raft_consensus.cc:493] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.473680 17353 raft_consensus.cc:515] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.478870 17297 tablet_bootstrap.cc:492] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.479522 17297 ts_tablet_manager.cc:1403] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.013s
I20260709 13:19:05.482880 17297 raft_consensus.cc:359] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.483773 17297 raft_consensus.cc:385] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.484084 17297 raft_consensus.cc:740] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.484895 17297 consensus_queue.cc:260] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.485888 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.485769 16923 catalog_manager.cc:5697] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.486806 17248 raft_consensus.cc:2393] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:05.487615 16923 catalog_manager.cc:5697] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.488897 17353 leader_election.cc:290] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:05.489096 17449 raft_consensus.cc:493] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.489959 17296 tablet_bootstrap.cc:654] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.473671 17301 ts_tablet_manager.cc:1434] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:19:05.491430 17301 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:05.489614 17449 raft_consensus.cc:515] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.494457 17449 leader_election.cc:290] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.496198 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d87f62879274a0ab4ec5951b7fe01a7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.496941 17100 raft_consensus.cc:2468] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:05.497328 17301 tablet_bootstrap.cc:654] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.499681 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d87f62879274a0ab4ec5951b7fe01a7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:05.490085 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.488929 17297 ts_tablet_manager.cc:1434] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:05.505666 17297 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:05.505903 17142 leader_election.cc:304] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:05.506800 17353 raft_consensus.cc:3060] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:05.507442 17216 leader_election.cc:343] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.508245 17216 leader_election.cc:304] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:05.509353 17453 raft_consensus.cc:2804] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.509811 17453 raft_consensus.cc:493] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.510159 17453 raft_consensus.cc:3060] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.513115 17297 tablet_bootstrap.cc:654] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.504185 17298 tablet_bootstrap.cc:492] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:05.516402 17298 ts_tablet_manager.cc:1403] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.003s
I20260709 13:19:05.514647 17353 raft_consensus.cc:2749] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.518484 17453 raft_consensus.cc:515] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.519229 17298 raft_consensus.cc:359] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.519906 17298 raft_consensus.cc:385] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.520150 17298 raft_consensus.cc:740] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.520671 17453 leader_election.cc:290] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.520776 17298 consensus_queue.cc:260] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.522686 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d87f62879274a0ab4ec5951b7fe01a7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.523342 17100 raft_consensus.cc:3060] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.524413 17296 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.525031 17296 ts_tablet_manager.cc:1403] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.003s
I20260709 13:19:05.525395 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d87f62879274a0ab4ec5951b7fe01a7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
W20260709 13:19:05.527320 17216 leader_election.cc:343] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.529686 17298 ts_tablet_manager.cc:1434] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:19:05.530803 17298 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:05.531106 16925 catalog_manager.cc:5697] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.527910 17296 raft_consensus.cc:359] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.535079 17296 raft_consensus.cc:385] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.535493 17296 raft_consensus.cc:740] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.536240 17296 consensus_queue.cc:260] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.536773 17298 tablet_bootstrap.cc:654] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.537855 17304 consensus_queue.cc:1048] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.538555 17100 raft_consensus.cc:2468] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:05.540007 17216 leader_election.cc:304] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:05.540879 17453 raft_consensus.cc:2804] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.541361 17453 raft_consensus.cc:697] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:05.542209 17453 consensus_queue.cc:237] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.551643 17301 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:05.552263 17301 ts_tablet_manager.cc:1403] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.001s
I20260709 13:19:05.554030 17297 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.554596 17297 ts_tablet_manager.cc:1403] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.003s
I20260709 13:19:05.557603 17297 raft_consensus.cc:359] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.558382 17297 raft_consensus.cc:385] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.558661 17297 raft_consensus.cc:740] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.559549 17297 consensus_queue.cc:260] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.561595 17297 ts_tablet_manager.cc:1434] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:19:05.562634 17297 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:05.568862 17301 raft_consensus.cc:359] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.569458 17453 raft_consensus.cc:493] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.570173 17453 raft_consensus.cc:515] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.571053 17296 ts_tablet_manager.cc:1434] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:19:05.572105 17298 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:05.572614 17298 ts_tablet_manager.cc:1403] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.007s
I20260709 13:19:05.573380 17330 consensus_queue.cc:1048] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.575519 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f5191b11fd41debf2fb4c4422f4b8a" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.569625 17301 raft_consensus.cc:385] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.577545 17301 raft_consensus.cc:740] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.575979 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f5191b11fd41debf2fb4c4422f4b8a" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.575955 17296 tablet_bootstrap.cc:492] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:05.572434 17453 leader_election.cc:290] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:05.583603 17216 leader_election.cc:343] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.584684 17301 consensus_queue.cc:260] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.585664 17026 raft_consensus.cc:2468] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:05.575546 17298 raft_consensus.cc:359] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.587020 17298 raft_consensus.cc:385] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.587307 17298 raft_consensus.cc:740] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.587809 17216 leader_election.cc:304] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:05.588025 17298 consensus_queue.cc:260] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.588981 17453 raft_consensus.cc:2804] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.589355 17453 raft_consensus.cc:493] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.590533 17296 tablet_bootstrap.cc:654] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.590497 17453 raft_consensus.cc:3060] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.589200 17301 ts_tablet_manager.cc:1434] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 13:19:05.589943 17297 tablet_bootstrap.cc:654] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.596024 17301 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:05.600610 17298 ts_tablet_manager.cc:1434] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:19:05.602061 17298 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:05.608327 17453 raft_consensus.cc:515] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.610627 17453 leader_election.cc:290] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:05.611737 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f5191b11fd41debf2fb4c4422f4b8a" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.612287 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f5191b11fd41debf2fb4c4422f4b8a" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:05.614645 16923 catalog_manager.cc:5697] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.618700 17026 raft_consensus.cc:3060] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:05.628350 17216 leader_election.cc:343] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.632771 17298 tablet_bootstrap.cc:654] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.633504 17301 tablet_bootstrap.cc:654] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.641697 17026 raft_consensus.cc:2468] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:05.649879 17216 leader_election.cc:304] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:05.651603 17296 tablet_bootstrap.cc:492] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.652184 17296 ts_tablet_manager.cc:1403] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.011s
I20260709 13:19:05.653015 17297 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.653597 17297 ts_tablet_manager.cc:1403] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.091s	user 0.026s	sys 0.024s
I20260709 13:19:05.654004 17453 raft_consensus.cc:2804] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:05.654800 17453 raft_consensus.cc:697] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:05.655136 17296 raft_consensus.cc:359] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.655857 17296 raft_consensus.cc:385] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.655613 17453 consensus_queue.cc:237] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.656178 17296 raft_consensus.cc:740] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.657027 17296 consensus_queue.cc:260] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.656417 17297 raft_consensus.cc:359] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.659209 17346 raft_consensus.cc:493] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.659686 17296 ts_tablet_manager.cc:1434] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:05.658015 17297 raft_consensus.cc:385] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.660889 17296 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:05.661130 17297 raft_consensus.cc:740] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.661865 17297 consensus_queue.cc:260] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.659917 17346 raft_consensus.cc:515] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.664006 17297 ts_tablet_manager.cc:1434] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:05.665102 17297 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:05.667093 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.667758 17100 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:05.667948 17296 tablet_bootstrap.cc:654] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.669135 16993 leader_election.cc:304] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:05.670001 17440 raft_consensus.cc:2804] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.670397 17440 raft_consensus.cc:493] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.670797 17440 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.671545 17297 tablet_bootstrap.cc:654] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.670246 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:05.673745 17175 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:05.665025 17346 leader_election.cc:290] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.682657 17440 raft_consensus.cc:515] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.686301 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:05.686975 17100 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.696194 17298 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:05.699805 17298 ts_tablet_manager.cc:1403] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.005s
I20260709 13:19:05.700245 17353 consensus_queue.cc:1048] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.703919 17296 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.704645 17296 ts_tablet_manager.cc:1403] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.005s
I20260709 13:19:05.706590 17298 raft_consensus.cc:359] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.707782 17298 raft_consensus.cc:385] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.708185 17298 raft_consensus.cc:740] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.714365 17298 consensus_queue.cc:260] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.711676 17296 raft_consensus.cc:359] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.715862 17296 raft_consensus.cc:385] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.716161 17296 raft_consensus.cc:740] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.716769 17297 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.717304 17297 ts_tablet_manager.cc:1403] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.017s
I20260709 13:19:05.718602 17298 ts_tablet_manager.cc:1434] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:19:05.719594 17298 tablet_bootstrap.cc:492] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:05.720108 17297 raft_consensus.cc:359] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.720808 17297 raft_consensus.cc:385] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.721068 17297 raft_consensus.cc:740] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.716830 17296 consensus_queue.cc:260] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.724402 16923 catalog_manager.cc:5697] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.726181 17453 raft_consensus.cc:493] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.726624 17298 tablet_bootstrap.cc:654] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.727022 17296 ts_tablet_manager.cc:1434] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:19:05.727933 17297 consensus_queue.cc:260] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.731612 17330 raft_consensus.cc:493] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.731482 17453 raft_consensus.cc:515] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.732215 17296 tablet_bootstrap.cc:492] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:05.732091 17330 raft_consensus.cc:515] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.734151 17453 leader_election.cc:290] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.737373 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f5191b11fd41debf2fb4c4422f4b8a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.740669 17296 tablet_bootstrap.cc:654] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.743629 17330 leader_election.cc:290] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:05.745952 17297 ts_tablet_manager.cc:1434] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:19:05.729811 17440 leader_election.cc:290] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:05.730908 17100 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:05.747977 17301 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:05.747231 17297 tablet_bootstrap.cc:492] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:05.748484 17301 ts_tablet_manager.cc:1403] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.001s
I20260709 13:19:05.751271 17301 raft_consensus.cc:359] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.752004 17301 raft_consensus.cc:385] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.752308 17301 raft_consensus.cc:740] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.753062 17301 consensus_queue.cc:260] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.756476 17297 tablet_bootstrap.cc:654] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.760584 17301 ts_tablet_manager.cc:1434] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:19:05.764698 17298 tablet_bootstrap.cc:492] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:05.765453 17298 ts_tablet_manager.cc:1403] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.003s
I20260709 13:19:05.769402 17298 raft_consensus.cc:359] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.772320 17298 raft_consensus.cc:385] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.772756 17298 raft_consensus.cc:740] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.773844 17298 consensus_queue.cc:260] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.779999 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d563c9ac0f54e16bdf8c304a05b0ee6" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.781095 17298 ts_tablet_manager.cc:1434] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:19:05.782197 17298 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:05.782671 17297 tablet_bootstrap.cc:492] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.783413 17297 ts_tablet_manager.cc:1403] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.013s
W20260709 13:19:05.786755 17216 leader_election.cc:343] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.788988 17297 raft_consensus.cc:359] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.789986 17297 raft_consensus.cc:385] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.790409 17297 raft_consensus.cc:740] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.790653 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d563c9ac0f54e16bdf8c304a05b0ee6" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:05.791399 17297 consensus_queue.cc:260] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.794431 17297 ts_tablet_manager.cc:1434] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:19:05.791821 17353 consensus_queue.cc:1048] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.797245 17353 consensus_queue.cc:1048] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.799044 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:05.799672 17175 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.804252 17298 tablet_bootstrap.cc:654] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.812620 17297 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
W20260709 13:19:05.818275 17216 leader_election.cc:343] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:05.820236 17296 tablet_bootstrap.cc:492] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.829288 17297 tablet_bootstrap.cc:654] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.829679 17296 ts_tablet_manager.cc:1403] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.008s
I20260709 13:19:05.832505 17296 raft_consensus.cc:359] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.833212 17296 raft_consensus.cc:385] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.833474 17296 raft_consensus.cc:740] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.834306 17301 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:05.834158 17296 consensus_queue.cc:260] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.836376 17385 consensus_queue.cc:1048] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.840291 17296 ts_tablet_manager.cc:1434] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:05.822958 17346 raft_consensus.cc:493] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.847371 17296 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:05.847013 17346 raft_consensus.cc:515] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.840786 17216 leader_election.cc:304] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:05.849359 17453 raft_consensus.cc:2749] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.851401 17346 leader_election.cc:290] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:05.856226 17301 tablet_bootstrap.cc:654] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.845548 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74f5191b11fd41debf2fb4c4422f4b8a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.858398 17026 raft_consensus.cc:2393] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:05.820952 17175 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:05.861734 17353 raft_consensus.cc:493] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.865154 17068 leader_election.cc:304] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:05.866446 17353 raft_consensus.cc:515] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:05.866750 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.867713 17251 raft_consensus.cc:2468] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:05.869544 17353 leader_election.cc:290] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:05.869863 17304 raft_consensus.cc:3060] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.874298 17296 tablet_bootstrap.cc:654] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.876125 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d87f62879274a0ab4ec5951b7fe01a7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:05.877064 17100 raft_consensus.cc:2393] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:05.795827 16993 leader_election.cc:304] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:05.878468 17346 raft_consensus.cc:2804] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:05.878049 16993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 82317.2us
I20260709 13:19:05.882939 16991 leader_election.cc:304] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:05.892875 17431 raft_consensus.cc:2804] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:05.893461 17431 raft_consensus.cc:493] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.893985 17431 raft_consensus.cc:3060] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.894172 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d87f62879274a0ab4ec5951b7fe01a7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.894695 17330 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.895293 17330 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:05.898444 17330 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:05.899263 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:05.899523 17324 consensus_queue.cc:1048] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.900358 17251 raft_consensus.cc:2393] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:05.901166 17297 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:05.901777 17297 ts_tablet_manager.cc:1403] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.089s	user 0.029s	sys 0.010s
I20260709 13:19:05.894061 17346 raft_consensus.cc:697] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:05.893986 17304 raft_consensus.cc:2749] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:05.906629 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:05.908118 17027 raft_consensus.cc:2393] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:05.909997 17068 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:05.908934 17297 raft_consensus.cc:359] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.923352 17297 raft_consensus.cc:385] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.923729 17297 raft_consensus.cc:740] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.924563 17297 consensus_queue.cc:260] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.924958 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:05.925649 17175 raft_consensus.cc:2468] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:05.911803 17324 consensus_queue.cc:1048] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.927011 17297 ts_tablet_manager.cc:1434] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:19:05.912834 17140 leader_election.cc:304] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:05.928187 17297 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:05.928601 17324 raft_consensus.cc:3060] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.930480 17301 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:05.931139 17301 ts_tablet_manager.cc:1403] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.007s
I20260709 13:19:05.934293 17304 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:05.942252 17453 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:05.904366 17346 consensus_queue.cc:237] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.958009 17301 raft_consensus.cc:359] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.960444 17301 raft_consensus.cc:385] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:05.960992 17301 raft_consensus.cc:740] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.963110 17301 consensus_queue.cc:260] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:05.965569 17301 ts_tablet_manager.cc:1434] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:19:05.969981 17440 consensus_queue.cc:1048] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:05.970927 17297 tablet_bootstrap.cc:654] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:05.970716 17449 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:05.976008 17301 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:05.974771 17431 raft_consensus.cc:515] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:05.995254 17296 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:05.996336 17296 ts_tablet_manager.cc:1403] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.012s
I20260709 13:19:05.983708 17399 consensus_queue.cc:1048] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:05.998567 17324 raft_consensus.cc:2749] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.013933 17304 raft_consensus.cc:2749] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.044139 17507 raft_consensus.cc:493] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.044752 17507 raft_consensus.cc:515] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.045660 17298 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:06.046222 17298 ts_tablet_manager.cc:1403] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.264s	user 0.038s	sys 0.046s
I20260709 13:19:06.046975 17507 leader_election.cc:290] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:06.044162 17453 raft_consensus.cc:493] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.048036 17453 raft_consensus.cc:515] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.049073 17298 raft_consensus.cc:359] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.049773 17298 raft_consensus.cc:385] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.052187 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8311e3adec426caac0f0b50057d6d7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:06.054013 17177 raft_consensus.cc:2468] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:06.052917 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8311e3adec426caac0f0b50057d6d7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.050079 17453 leader_election.cc:290] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
W20260709 13:19:06.070803 17216 leader_election.cc:343] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.071597 17216 leader_election.cc:304] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:06.073849 17453 raft_consensus.cc:2804] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:06.050027 17298 raft_consensus.cc:740] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.074324 17453 raft_consensus.cc:493] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.077636 17399 consensus_queue.cc:1048] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:06.076697 17453 raft_consensus.cc:3060] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.089911 17298 consensus_queue.cc:260] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.078616 17449 raft_consensus.cc:493] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.102794 17431 leader_election.cc:290] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
W20260709 13:19:06.106108 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:06.097983 17449 raft_consensus.cc:515] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.108248 17449 leader_election.cc:290] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:06.094539 17066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 80596.6us
I20260709 13:19:06.113065 17453 raft_consensus.cc:515] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.115520 17453 leader_election.cc:290] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:06.118105 17296 raft_consensus.cc:359] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.121013 17296 raft_consensus.cc:385] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.119818 17298 ts_tablet_manager.cc:1434] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.003s
I20260709 13:19:06.123472 17298 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:06.121868 17296 raft_consensus.cc:740] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
W20260709 13:19:06.142959 16993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 68818us
I20260709 13:19:06.150820 17296 consensus_queue.cc:260] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:06.152849 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 62428.3us
I20260709 13:19:06.158257 17301 tablet_bootstrap.cc:654] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.158545 17297 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:06.160575 17297 ts_tablet_manager.cc:1403] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.233s	user 0.029s	sys 0.012s
I20260709 13:19:06.162919 17353 raft_consensus.cc:493] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.163457 17353 raft_consensus.cc:515] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.164175 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.165544 17353 leader_election.cc:290] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:06.166129 17449 consensus_queue.cc:1048] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:19:06.167500 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:06.169080 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:06.179028 17251 raft_consensus.cc:3060] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.171917 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.174432 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8311e3adec426caac0f0b50057d6d7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:06.174602 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:06.173964 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.166983 17297 raft_consensus.cc:359] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.186305 17297 raft_consensus.cc:385] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.186717 17297 raft_consensus.cc:740] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.192574 17296 ts_tablet_manager.cc:1434] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.196s	user 0.008s	sys 0.000s
I20260709 13:19:06.193230 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:06.177812 17102 raft_consensus.cc:2468] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:06.193969 17173 raft_consensus.cc:3060] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:06.194561 17142 leader_election.cc:343] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.199131 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:06.203297 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8311e3adec426caac0f0b50057d6d7" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:06.204952 17173 raft_consensus.cc:2468] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:06.214823 17297 consensus_queue.cc:260] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.218843 17103 raft_consensus.cc:2468] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:06.219261 17175 raft_consensus.cc:3060] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.241812 17297 ts_tablet_manager.cc:1434] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:19:06.243947 17297 tablet_bootstrap.cc:492] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:06.244967 17296 tablet_bootstrap.cc:492] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.247010 17298 tablet_bootstrap.cc:654] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.247187 17511 raft_consensus.cc:493] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.232402 16993 leader_election.cc:304] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:06.245923 17142 leader_election.cc:304] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:06.244967 17251 raft_consensus.cc:2468] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:06.251926 17175 raft_consensus.cc:2468] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:06.255623 17353 raft_consensus.cc:2804] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:06.256079 17353 raft_consensus.cc:493] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.256429 17353 raft_consensus.cc:3060] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:06.249027 17216 leader_election.cc:343] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.250943 17511 raft_consensus.cc:515] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.254845 17346 raft_consensus.cc:2804] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:06.256552 16993 leader_election.cc:343] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.257421 17514 consensus_queue.cc:1048] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:06.263288 17346 raft_consensus.cc:493] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.265533 16991 leader_election.cc:304] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:06.266906 17346 raft_consensus.cc:3060] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.272259 17296 tablet_bootstrap.cc:654] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.269054 17511 leader_election.cc:290] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:06.270097 17301 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:06.277886 17353 raft_consensus.cc:515] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.280479 17301 ts_tablet_manager.cc:1403] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.314s	user 0.025s	sys 0.028s
I20260709 13:19:06.281994 17353 leader_election.cc:290] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:06.288656 17297 tablet_bootstrap.cc:654] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:06.264961 17216 leader_election.cc:343] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.283779 17514 raft_consensus.cc:2804] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:06.291786 17514 raft_consensus.cc:697] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:06.294430 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d563c9ac0f54e16bdf8c304a05b0ee6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:06.292704 17514 consensus_queue.cc:237] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.286058 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:06.287290 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:06.270700 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d563c9ac0f54e16bdf8c304a05b0ee6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:06.309563 17102 raft_consensus.cc:3060] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.320919 17301 raft_consensus.cc:359] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.321805 17301 raft_consensus.cc:385] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.322178 17301 raft_consensus.cc:740] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.324123 17301 consensus_queue.cc:260] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.318267 17251 raft_consensus.cc:2468] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:06.340577 17301 ts_tablet_manager.cc:1434] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:19:06.338337 16925 catalog_manager.cc:5697] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:06.336107 17068 leader_election.cc:343] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.345552 17301 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:06.351800 17296 tablet_bootstrap.cc:492] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.356487 17296 ts_tablet_manager.cc:1403] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.041s
I20260709 13:19:06.360066 17066 leader_election.cc:304] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:06.362150 17346 raft_consensus.cc:515] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.362985 17511 raft_consensus.cc:2804] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:06.363426 17511 raft_consensus.cc:493] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.363790 17511 raft_consensus.cc:3060] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.368268 17102 raft_consensus.cc:2468] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:06.371831 17346 leader_election.cc:290] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
W20260709 13:19:06.339226 17142 leader_election.cc:343] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.380853 17296 raft_consensus.cc:359] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.381688 17296 raft_consensus.cc:385] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.382256 17296 raft_consensus.cc:740] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
W20260709 13:19:06.380908 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 43548.2us
I20260709 13:19:06.383520 17296 consensus_queue.cc:260] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.384483 17142 leader_election.cc:304] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:06.385524 17522 raft_consensus.cc:2804] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:06.377496 17511 raft_consensus.cc:515] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.385599 17296 ts_tablet_manager.cc:1434] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:19:06.349076 17216 leader_election.cc:304] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:06.387473 17298 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:06.393244 17298 ts_tablet_manager.cc:1403] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.270s	user 0.009s	sys 0.009s
I20260709 13:19:06.394625 17522 raft_consensus.cc:697] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:06.395489 17513 raft_consensus.cc:2804] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:06.395725 17511 leader_election.cc:290] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:06.396751 17513 raft_consensus.cc:697] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:06.396952 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d563c9ac0f54e16bdf8c304a05b0ee6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:06.397598 17251 raft_consensus.cc:3060] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.397497 17298 raft_consensus.cc:359] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.397902 17513 consensus_queue.cc:237] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.398703 17298 raft_consensus.cc:385] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.399153 17298 raft_consensus.cc:740] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.401342 17296 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.388540 17297 tablet_bootstrap.cc:492] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
W20260709 13:19:06.402592 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 53632us
I20260709 13:19:06.402078 17297 ts_tablet_manager.cc:1403] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.005s
I20260709 13:19:06.395613 17522 consensus_queue.cc:237] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.410954 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:06.411680 17103 raft_consensus.cc:3060] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.413450 17298 consensus_queue.cc:260] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
W20260709 13:19:06.425747 17216 leader_election.cc:343] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.426538 17216 leader_election.cc:304] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:06.428820 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d563c9ac0f54e16bdf8c304a05b0ee6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:06.429850 17176 raft_consensus.cc:3060] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.435122 17103 raft_consensus.cc:2468] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:06.406100 17251 raft_consensus.cc:2468] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:06.441061 17066 leader_election.cc:304] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:06.442040 17330 raft_consensus.cc:2804] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:06.442519 17298 ts_tablet_manager.cc:1434] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:19:06.442612 17330 raft_consensus.cc:697] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:06.443868 17298 tablet_bootstrap.cc:492] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:06.444551 17301 tablet_bootstrap.cc:654] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.416878 17297 raft_consensus.cc:359] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.445310 17297 raft_consensus.cc:385] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.445586 17297 raft_consensus.cc:740] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.446833 17297 consensus_queue.cc:260] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.451926 17516 raft_consensus.cc:2749] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.452262 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:06.452816 17330 consensus_queue.cc:237] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.457722 17516 consensus_queue.cc:1048] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.461272 17513 consensus_queue.cc:1048] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.462939 17511 raft_consensus.cc:493] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.453652 17176 raft_consensus.cc:2468] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:06.463644 17513 consensus_queue.cc:1048] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.463557 17511 raft_consensus.cc:515] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.465991 17297 ts_tablet_manager.cc:1434] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:19:06.467705 17297 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
W20260709 13:19:06.469081 16993 leader_election.cc:343] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.472096 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8311e3adec426caac0f0b50057d6d7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:06.468585 17511 leader_election.cc:290] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:06.474007 17296 tablet_bootstrap.cc:654] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.476110 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8311e3adec426caac0f0b50057d6d7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:06.477391 17177 raft_consensus.cc:2393] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:06.478791 17068 leader_election.cc:304] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:06.480720 17298 tablet_bootstrap.cc:654] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.480782 17511 raft_consensus.cc:3060] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.498771 17297 tablet_bootstrap.cc:654] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.522620 16926 catalog_manager.cc:5697] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.494328 16993 leader_election.cc:304] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:06.531729 17346 raft_consensus.cc:2804] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:06.536990 17301 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:06.537526 17301 ts_tablet_manager.cc:1403] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.004s
I20260709 13:19:06.539983 17511 raft_consensus.cc:2749] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.540196 17301 raft_consensus.cc:359] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.540987 17301 raft_consensus.cc:385] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.541291 17301 raft_consensus.cc:740] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.541965 17301 consensus_queue.cc:260] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.545578 17296 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.546146 17296 ts_tablet_manager.cc:1403] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.028s
I20260709 13:19:06.543190 17346 raft_consensus.cc:697] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:06.548153 17301 ts_tablet_manager.cc:1434] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:06.550487 17301 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:06.548874 17346 consensus_queue.cc:237] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.557854 17301 tablet_bootstrap.cc:654] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.564548 17296 raft_consensus.cc:359] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.565673 17296 raft_consensus.cc:385] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.566052 17296 raft_consensus.cc:740] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.567139 17507 raft_consensus.cc:493] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.567930 17507 raft_consensus.cc:515] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.570801 17507 leader_election.cc:290] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:06.572081 17296 consensus_queue.cc:260] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.574251 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:06.588912 17296 ts_tablet_manager.cc:1434] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:19:06.575059 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.590776 17296 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.590176 17513 raft_consensus.cc:493] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.597662 17513 raft_consensus.cc:515] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.595948 17098 raft_consensus.cc:2393] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate 896fb6e3b27e4874a469245a7b103111 in this term.
I20260709 13:19:06.600348 16993 leader_election.cc:304] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:06.606251 17514 raft_consensus.cc:3060] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.611649 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28414584faaa415dab69430bf5735027" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:06.616382 17296 tablet_bootstrap.cc:654] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.614074 17514 raft_consensus.cc:2749] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.618985 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28414584faaa415dab69430bf5735027" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
W20260709 13:19:06.621003 17216 leader_election.cc:343] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:06.621711 17216 leader_election.cc:343] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.622150 17216 leader_election.cc:304] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:06.604560 17513 leader_election.cc:290] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:06.621883 16925 catalog_manager.cc:5697] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.624677 17298 tablet_bootstrap.cc:492] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:06.625352 17298 ts_tablet_manager.cc:1403] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.005s
I20260709 13:19:06.592407 17346 consensus_queue.cc:1048] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:19:06.625854 17513 raft_consensus.cc:2749] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.635525 17297 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:06.636246 17297 ts_tablet_manager.cc:1403] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.169s	user 0.019s	sys 0.020s
I20260709 13:19:06.639158 17297 raft_consensus.cc:359] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.641700 17297 raft_consensus.cc:385] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.641981 17297 raft_consensus.cc:740] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.646581 17298 raft_consensus.cc:359] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.650364 17298 raft_consensus.cc:385] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.650823 17298 raft_consensus.cc:740] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.650570 17297 consensus_queue.cc:260] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.652091 17298 consensus_queue.cc:260] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.654713 17297 ts_tablet_manager.cc:1434] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:06.656538 17514 consensus_queue.cc:1048] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.660192 17298 ts_tablet_manager.cc:1434] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:19:06.663126 17298 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:06.662385 16923 catalog_manager.cc:5697] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.664935 17297 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:06.680315 17298 tablet_bootstrap.cc:654] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.683614 17301 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:06.685202 17301 ts_tablet_manager.cc:1403] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.017s
I20260709 13:19:06.686087 17296 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.686628 17296 ts_tablet_manager.cc:1403] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.097s	user 0.036s	sys 0.032s
I20260709 13:19:06.688055 17301 raft_consensus.cc:359] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.689328 17296 raft_consensus.cc:359] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.690065 17296 raft_consensus.cc:385] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.690356 17296 raft_consensus.cc:740] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.691025 17296 consensus_queue.cc:260] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.692873 17296 ts_tablet_manager.cc:1434] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:06.693918 17296 tablet_bootstrap.cc:492] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.688799 17301 raft_consensus.cc:385] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.695683 17301 raft_consensus.cc:740] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.697221 17298 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:06.697882 17298 ts_tablet_manager.cc:1403] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.006s
I20260709 13:19:06.696439 16924 catalog_manager.cc:5697] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.701460 17296 tablet_bootstrap.cc:654] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.696442 17301 consensus_queue.cc:260] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.705169 17301 ts_tablet_manager.cc:1434] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:06.708060 17298 raft_consensus.cc:359] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.709167 17298 raft_consensus.cc:385] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.709595 17298 raft_consensus.cc:740] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.709858 17301 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:06.713454 17297 tablet_bootstrap.cc:654] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.713663 17296 tablet_bootstrap.cc:492] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.714282 17296 ts_tablet_manager.cc:1403] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:19:06.715792 17298 consensus_queue.cc:260] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.717244 17301 tablet_bootstrap.cc:654] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.717424 17296 raft_consensus.cc:359] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.718048 17298 ts_tablet_manager.cc:1434] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:19:06.718190 17296 raft_consensus.cc:385] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.718549 17296 raft_consensus.cc:740] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.719113 17298 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:06.719179 17296 consensus_queue.cc:260] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.721155 17296 ts_tablet_manager.cc:1434] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:06.722025 17296 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.725155 16925 catalog_manager.cc:5697] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.726994 17298 tablet_bootstrap.cc:654] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.727677 17296 tablet_bootstrap.cc:654] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.741053 17296 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.741573 17296 ts_tablet_manager.cc:1403] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:19:06.744342 17296 raft_consensus.cc:359] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.745178 17296 raft_consensus.cc:385] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.745494 17296 raft_consensus.cc:740] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.747210 17296 consensus_queue.cc:260] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.748157 17298 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:06.748682 17298 ts_tablet_manager.cc:1403] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.009s
I20260709 13:19:06.749259 17296 ts_tablet_manager.cc:1434] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:06.750290 17296 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.751691 17298 raft_consensus.cc:359] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.752449 17298 raft_consensus.cc:385] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.752712 17298 raft_consensus.cc:740] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.753561 17298 consensus_queue.cc:260] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.755573 17298 ts_tablet_manager.cc:1434] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:06.756565 17298 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:06.756938 17296 tablet_bootstrap.cc:654] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.760816 17431 consensus_queue.cc:1048] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.762934 17298 tablet_bootstrap.cc:654] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.764101 17296 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.764640 17296 ts_tablet_manager.cc:1403] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:19:06.765358 17385 raft_consensus.cc:493] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.765908 17385 raft_consensus.cc:515] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.768100 17296 raft_consensus.cc:359] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.768251 17385 leader_election.cc:290] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:06.769021 17296 raft_consensus.cc:385] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.769426 17296 raft_consensus.cc:740] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.770171 17296 consensus_queue.cc:260] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:06.773414 17296 ts_tablet_manager.cc:1434] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:19:06.774751 17296 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.776173 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.777024 17103 raft_consensus.cc:2393] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:06.779059 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:06.784107 17296 tablet_bootstrap.cc:654] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.787595 17346 raft_consensus.cc:493] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.788704 17142 leader_election.cc:304] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:06.790138 17385 raft_consensus.cc:3060] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.788429 17346 raft_consensus.cc:515] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.793919 17346 leader_election.cc:290] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:06.797973 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.799068 17103 raft_consensus.cc:2468] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:06.801510 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:06.802186 17249 raft_consensus.cc:2468] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:06.802268 16993 leader_election.cc:304] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:06.804024 17514 raft_consensus.cc:2804] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:06.804574 17514 raft_consensus.cc:493] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.805001 17514 raft_consensus.cc:3060] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.809930 17513 consensus_queue.cc:1048] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.815857 17298 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:06.816641 17298 ts_tablet_manager.cc:1403] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.007s
I20260709 13:19:06.816442 17513 consensus_queue.cc:1048] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:06.826305 17298 raft_consensus.cc:359] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.827287 17298 raft_consensus.cc:385] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.827617 17298 raft_consensus.cc:740] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.828493 17298 consensus_queue.cc:260] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.830283 17298 ts_tablet_manager.cc:1434] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:19:06.831231 17298 tablet_bootstrap.cc:492] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:06.842679 17297 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:06.844977 17297 ts_tablet_manager.cc:1403] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.007s
I20260709 13:19:06.863412 17297 raft_consensus.cc:359] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.864437 17297 raft_consensus.cc:385] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.864804 17297 raft_consensus.cc:740] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.865724 17297 consensus_queue.cc:260] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.869486 17297 ts_tablet_manager.cc:1434] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:19:06.871022 17297 tablet_bootstrap.cc:492] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:06.873515 17301 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:06.874091 17301 ts_tablet_manager.cc:1403] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.008s
I20260709 13:19:06.884838 17296 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:06.887161 17296 ts_tablet_manager.cc:1403] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.113s	user 0.029s	sys 0.053s
I20260709 13:19:06.894587 17301 raft_consensus.cc:359] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.895258 17301 raft_consensus.cc:385] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.876008 17385 raft_consensus.cc:2749] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:06.899863 17514 raft_consensus.cc:515] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.902626 17514 leader_election.cc:290] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:06.895493 17301 raft_consensus.cc:740] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.903643 17301 consensus_queue.cc:260] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.904513 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:06.905117 17249 raft_consensus.cc:3060] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.906101 17301 ts_tablet_manager.cc:1434] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:19:06.907169 17301 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:06.913081 17513 raft_consensus.cc:493] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.914412 17297 tablet_bootstrap.cc:654] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.913676 17513 raft_consensus.cc:515] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.915652 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:06.916376 17103 raft_consensus.cc:3060] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.917130 17513 leader_election.cc:290] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:06.919485 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab0391bda54325b10799d23b44b332" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:06.937913 17175 raft_consensus.cc:2468] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:06.920724 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab0391bda54325b10799d23b44b332" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:06.939328 17026 raft_consensus.cc:2468] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:06.940255 17216 leader_election.cc:304] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:06.921341 17298 tablet_bootstrap.cc:654] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.941107 17449 raft_consensus.cc:2804] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:06.941497 17449 raft_consensus.cc:493] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.941876 17449 raft_consensus.cc:3060] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:06.927222 17103 raft_consensus.cc:2468] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:06.945856 17297 tablet_bootstrap.cc:492] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:06.946470 17297 ts_tablet_manager.cc:1403] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.001s
I20260709 13:19:06.927291 17296 raft_consensus.cc:359] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.948104 17296 raft_consensus.cc:385] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.948424 17296 raft_consensus.cc:740] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.930114 17353 consensus_queue.cc:1048] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.949108 17296 consensus_queue.cc:260] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:06.951483 17296 ts_tablet_manager.cc:1434] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:19:06.952406 17296 tablet_bootstrap.cc:492] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:06.954502 17513 raft_consensus.cc:493] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.955044 17513 raft_consensus.cc:515] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:06.955967 17297 raft_consensus.cc:359] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.956672 17297 raft_consensus.cc:385] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:06.956980 17297 raft_consensus.cc:740] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.936915 17301 tablet_bootstrap.cc:654] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.960374 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:06.962106 17385 consensus_queue.cc:1048] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.965245 17296 tablet_bootstrap.cc:654] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:06.965798 17346 consensus_queue.cc:1048] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:06.957718 17297 consensus_queue.cc:260] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.969238 17297 ts_tablet_manager.cc:1434] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:19:06.969619 16993 leader_election.cc:304] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:06.970315 17297 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:06.970880 17346 raft_consensus.cc:2804] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:06.971486 17346 raft_consensus.cc:697] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:06.972472 17346 consensus_queue.cc:237] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:06.979526 17216 leader_election.cc:343] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.983091 17385 raft_consensus.cc:493] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.983729 17385 raft_consensus.cc:515] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:06.985798 17385 leader_election.cc:290] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:06.986389 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:06.957242 17513 leader_election.cc:290] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:06.989773 17216 leader_election.cc:343] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:06.990343 17216 leader_election.cc:304] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:06.991545 17249 raft_consensus.cc:2468] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:07.013341 17431 consensus_queue.cc:1048] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:07.007180 17516 raft_consensus.cc:2749] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:07.010874 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926ebf63b80f401d9c985bd2905a1b65" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:07.017318 17251 raft_consensus.cc:2468] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:07.011113 17513 raft_consensus.cc:493] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.020290 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926ebf63b80f401d9c985bd2905a1b65" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:07.027612 17140 leader_election.cc:304] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.040594 17324 raft_consensus.cc:2804] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.030479 17513 raft_consensus.cc:515] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.048328 17513 leader_election.cc:290] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:07.048990 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ac42568104f29ba5df81bb07d7683" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:07.051157 17216 leader_election.cc:343] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.037871 17102 raft_consensus.cc:2468] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:07.055344 17301 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:07.055876 17301 ts_tablet_manager.cc:1403] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.009s
I20260709 13:19:07.056670 17298 tablet_bootstrap.cc:492] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:07.057399 17298 ts_tablet_manager.cc:1403] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.226s	user 0.032s	sys 0.022s
I20260709 13:19:07.058390 17301 raft_consensus.cc:359] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.041731 17324 raft_consensus.cc:493] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.059122 17301 raft_consensus.cc:385] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.059335 17324 raft_consensus.cc:3060] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.059445 17301 raft_consensus.cc:740] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.060388 17301 consensus_queue.cc:260] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.045303 17346 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.064122 17346 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.067211 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:07.067921 17251 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:07.069218 16991 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.070585 17301 ts_tablet_manager.cc:1434] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:07.070178 17431 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:07.073904 17431 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.074302 17431 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.074647 17353 raft_consensus.cc:493] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.075189 17353 raft_consensus.cc:515] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.076610 17301 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:07.037389 17449 raft_consensus.cc:515] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.077370 17353 leader_election.cc:290] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.079155 17514 consensus_queue.cc:1048] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:07.082922 17449 leader_election.cc:290] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.080698 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28414584faaa415dab69430bf5735027" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:07.083918 17026 raft_consensus.cc:2468] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:07.070163 17298 raft_consensus.cc:359] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.084702 17298 raft_consensus.cc:385] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.085441 17142 leader_election.cc:304] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:07.087625 17353 raft_consensus.cc:2804] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.088043 17353 raft_consensus.cc:493] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.088354 17297 tablet_bootstrap.cc:654] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.089449 17511 consensus_queue.cc:1048] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:07.091687 17298 raft_consensus.cc:740] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.093134 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28414584faaa415dab69430bf5735027" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:07.094027 17251 raft_consensus.cc:2468] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:07.100926 17298 consensus_queue.cc:260] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.088400 17353 raft_consensus.cc:3060] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.070565 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ac42568104f29ba5df81bb07d7683" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:07.108407 17298 ts_tablet_manager.cc:1434] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.004s
I20260709 13:19:07.112046 17298 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:07.114431 17346 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:07.080816 17324 raft_consensus.cc:515] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.115042 17103 raft_consensus.cc:2468] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:07.135430 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:07.136221 17102 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:07.124924 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab0391bda54325b10799d23b44b332" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:07.137706 17216 leader_election.cc:304] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:07.140965 17449 raft_consensus.cc:2804] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.141368 17449 raft_consensus.cc:493] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.141712 17449 raft_consensus.cc:3060] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.143582 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926ebf63b80f401d9c985bd2905a1b65" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:07.144261 17102 raft_consensus.cc:3060] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.149887 17026 raft_consensus.cc:3060] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.153232 17449 raft_consensus.cc:515] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.155743 17324 leader_election.cc:290] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:07.156770 17296 tablet_bootstrap.cc:492] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:07.137665 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ab0391bda54325b10799d23b44b332" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:07.129195 17566 consensus_queue.cc:1048] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:19:07.159379 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926ebf63b80f401d9c985bd2905a1b65" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:07.179283 17251 raft_consensus.cc:3060] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.166085 17297 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:07.182428 17297 ts_tablet_manager.cc:1403] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.212s	user 0.011s	sys 0.018s
I20260709 13:19:07.165737 17353 raft_consensus.cc:515] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.166121 17027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ac42568104f29ba5df81bb07d7683" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:07.189113 17251 raft_consensus.cc:2468] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:07.168654 17301 tablet_bootstrap.cc:654] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.170506 16925 catalog_manager.cc:5697] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.172642 17296 ts_tablet_manager.cc:1403] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.220s	user 0.028s	sys 0.023s
I20260709 13:19:07.174856 17449 leader_election.cc:290] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:07.176034 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ac42568104f29ba5df81bb07d7683" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:07.176783 17298 tablet_bootstrap.cc:654] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.201606 17103 raft_consensus.cc:3060] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.201757 17140 leader_election.cc:304] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.205178 17353 leader_election.cc:290] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.205317 17385 raft_consensus.cc:2804] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.184592 17175 raft_consensus.cc:3060] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.198678 17027 raft_consensus.cc:3060] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.215585 17296 raft_consensus.cc:359] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.216573 17296 raft_consensus.cc:385] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.216862 17296 raft_consensus.cc:740] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.217526 17296 consensus_queue.cc:260] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.216313 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28414584faaa415dab69430bf5735027" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:07.219663 17250 raft_consensus.cc:3060] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.189622 17431 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.225472 17449 raft_consensus.cc:493] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.226645 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28414584faaa415dab69430bf5735027" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:07.227334 17028 raft_consensus.cc:3060] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.227667 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:07.227993 17431 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:07.228333 17249 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.233599 17353 raft_consensus.cc:493] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.234196 17353 raft_consensus.cc:515] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.234777 17449 raft_consensus.cc:515] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.236363 17353 leader_election.cc:290] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:07.236869 17324 raft_consensus.cc:493] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.237421 17324 raft_consensus.cc:515] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.230978 17297 raft_consensus.cc:359] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.208339 17385 raft_consensus.cc:697] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:07.238615 17297 raft_consensus.cc:385] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.238976 17297 raft_consensus.cc:740] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.245658 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:07.246433 17100 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.250737 17385 consensus_queue.cc:237] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.254902 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:07.257562 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:07.258092 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75097aacc2fe4fd6be138902792ad16f" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:07.258853 17173 raft_consensus.cc:2468] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
W20260709 13:19:07.259410 17142 leader_election.cc:343] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.260008 17216 leader_election.cc:304] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.260883 17517 raft_consensus.cc:2804] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.261324 17517 raft_consensus.cc:493] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:07.261420 17142 leader_election.cc:343] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.261705 17517 raft_consensus.cc:3060] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.261960 17142 leader_election.cc:304] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:07.262871 17353 raft_consensus.cc:2749] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:07.274657 17297 consensus_queue.cc:260] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.281073 17296 ts_tablet_manager.cc:1434] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:19:07.282701 17296 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:07.289960 17297 ts_tablet_manager.cc:1434] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.001s
I20260709 13:19:07.293569 17297 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:07.296985 17324 leader_election.cc:290] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.299149 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75097aacc2fe4fd6be138902792ad16f" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:07.302901 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75097aacc2fe4fd6be138902792ad16f" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:07.304636 17216 leader_election.cc:343] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.305670 17027 raft_consensus.cc:2468] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:07.307180 17216 leader_election.cc:304] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.308202 17175 raft_consensus.cc:2468] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:07.288838 17249 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:07.308969 17250 raft_consensus.cc:2468] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
W20260709 13:19:07.309473 17570 log.cc:927] Time spent T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:19:07.310915 17140 leader_election.cc:304] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.294656 17449 leader_election.cc:290] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.309140 17513 raft_consensus.cc:2804] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.340536 17513 raft_consensus.cc:697] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:07.341492 17513 consensus_queue.cc:237] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.336542 17216 leader_election.cc:304] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.359987 17296 tablet_bootstrap.cc:654] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.364853 17453 raft_consensus.cc:2804] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.365602 17453 raft_consensus.cc:697] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:07.310098 17026 raft_consensus.cc:2468] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:07.314064 17324 raft_consensus.cc:2804] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.313421 17028 raft_consensus.cc:2468] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:07.336830 17102 raft_consensus.cc:2468] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:07.385607 17453 consensus_queue.cc:237] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.383477 17324 raft_consensus.cc:697] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:07.366182 17100 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:07.403867 17298 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:07.404470 17298 ts_tablet_manager.cc:1403] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.293s	user 0.005s	sys 0.026s
I20260709 13:19:07.373684 16991 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
W20260709 13:19:07.406669 16991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 61912us
I20260709 13:19:07.409670 17507 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:07.410266 17507 raft_consensus.cc:697] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:07.410665 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75097aacc2fe4fd6be138902792ad16f" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:07.411144 17507 consensus_queue.cc:237] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.412568 17324 consensus_queue.cc:237] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.418355 17103 raft_consensus.cc:2468] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
W20260709 13:19:07.423636 17571 log.cc:927] Time spent T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:19:07.423554 17142 leader_election.cc:343] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.457191 17346 consensus_queue.cc:1048] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:07.459002 17296 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:07.459729 17296 ts_tablet_manager.cc:1403] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.177s	user 0.018s	sys 0.013s
I20260709 13:19:07.463217 17296 raft_consensus.cc:359] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.463948 17296 raft_consensus.cc:385] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.464452 17296 raft_consensus.cc:740] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.465133 17296 consensus_queue.cc:260] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.467571 17296 ts_tablet_manager.cc:1434] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:07.468837 17296 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:07.469480 17298 raft_consensus.cc:359] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.471808 17298 raft_consensus.cc:385] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.472206 17298 raft_consensus.cc:740] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.473760 17298 consensus_queue.cc:260] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.481923 17297 tablet_bootstrap.cc:654] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.485515 17298 ts_tablet_manager.cc:1434] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.001s
W20260709 13:19:07.486598 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 50693.9us
I20260709 13:19:07.499207 17517 raft_consensus.cc:515] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.500862 17248 raft_consensus.cc:2393] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:07.503216 17517 leader_election.cc:290] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.505172 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75097aacc2fe4fd6be138902792ad16f" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:07.505975 17177 raft_consensus.cc:3060] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.514804 17298 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:07.526189 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75097aacc2fe4fd6be138902792ad16f" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
W20260709 13:19:07.528512 17216 leader_election.cc:343] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.535017 17140 leader_election.cc:304] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
W20260709 13:19:07.548032 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:07.556326 17298 tablet_bootstrap.cc:654] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.569713 17301 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:07.570274 17301 ts_tablet_manager.cc:1403] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.494s	user 0.013s	sys 0.015s
I20260709 13:19:07.576015 16924 catalog_manager.cc:5697] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.568506 17324 raft_consensus.cc:493] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.577716 16924 catalog_manager.cc:5697] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.579329 17297 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:07.583133 17297 ts_tablet_manager.cc:1403] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.292s	user 0.019s	sys 0.004s
I20260709 13:19:07.584645 17324 raft_consensus.cc:515] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.586062 17297 raft_consensus.cc:359] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.587049 17324 leader_election.cc:290] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.587338 17297 raft_consensus.cc:385] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.587826 17297 raft_consensus.cc:740] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.588645 17297 consensus_queue.cc:260] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.591939 17301 raft_consensus.cc:359] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.592818 17301 raft_consensus.cc:385] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.593139 17301 raft_consensus.cc:740] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.593926 17575 raft_consensus.cc:493] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.594468 17575 raft_consensus.cc:515] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.594806 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf71c3afe414daeb032d872c3c949c3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:07.596688 17575 leader_election.cc:290] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:07.591943 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf71c3afe414daeb032d872c3c949c3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:07.597977 17248 raft_consensus.cc:2468] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:07.598206 17296 tablet_bootstrap.cc:654] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.599114 17177 raft_consensus.cc:2468] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:07.606132 17353 raft_consensus.cc:2749] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:07.601599 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8a7e0630e4439ca8abb6c40beeaa0d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:07.608558 17174 raft_consensus.cc:2468] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:07.610306 17216 leader_election.cc:304] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:07.611598 17216 leader_election.cc:304] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.612636 17330 raft_consensus.cc:493] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.602783 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8a7e0630e4439ca8abb6c40beeaa0d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:07.613770 17330 raft_consensus.cc:515] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:07.599792 17142 leader_election.cc:343] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.613456 17575 raft_consensus.cc:2804] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.601675 17297 ts_tablet_manager.cc:1434] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:19:07.616873 17140 leader_election.cc:304] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:07.617211 17330 leader_election.cc:290] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.602293 17507 consensus_queue.cc:1048] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:07.617681 17297 tablet_bootstrap.cc:492] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:07.618888 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:07.620718 17068 leader_election.cc:343] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.621591 17353 raft_consensus.cc:2804] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.622119 17353 raft_consensus.cc:493] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.622578 17353 raft_consensus.cc:3060] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.624680 17297 tablet_bootstrap.cc:654] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.626494 17575 raft_consensus.cc:697] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:07.627496 17575 consensus_queue.cc:237] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.632226 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:07.633224 17251 raft_consensus.cc:2468] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:07.636109 17296 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:07.636911 17296 ts_tablet_manager.cc:1403] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.168s	user 0.009s	sys 0.005s
W20260709 13:19:07.637200 17216 leader_election.cc:343] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.638427 17453 raft_consensus.cc:2804] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.638849 17453 raft_consensus.cc:493] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.639180 17453 raft_consensus.cc:3060] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.640858 17296 raft_consensus.cc:359] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.641889 17296 raft_consensus.cc:385] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.593954 17301 consensus_queue.cc:260] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.643929 16926 catalog_manager.cc:5697] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 2, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.657421 17296 raft_consensus.cc:740] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.658432 17296 consensus_queue.cc:260] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.660971 17324 consensus_queue.cc:1048] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:07.661384 17296 ts_tablet_manager.cc:1434] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:19:07.662818 17296 tablet_bootstrap.cc:492] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:07.662725 17066 leader_election.cc:304] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:07.664068 17330 raft_consensus.cc:2804] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.664498 17330 raft_consensus.cc:493] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.666196 17301 ts_tablet_manager.cc:1434] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.002s
I20260709 13:19:07.667747 17301 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:07.663820 17353 raft_consensus.cc:515] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.665874 17330 raft_consensus.cc:3060] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.683996 17353 leader_election.cc:290] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.674433 16923 catalog_manager.cc:5697] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.686982 16923 catalog_manager.cc:5697] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.688838 17453 raft_consensus.cc:515] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.691342 17453 leader_election.cc:290] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:07.688274 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf71c3afe414daeb032d872c3c949c3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
W20260709 13:19:07.693297 17142 leader_election.cc:343] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.697351 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf71c3afe414daeb032d872c3c949c3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:07.698334 17251 raft_consensus.cc:3060] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.700181 17298 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:07.700941 17298 ts_tablet_manager.cc:1403] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.188s	user 0.045s	sys 0.013s
I20260709 13:19:07.708288 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8a7e0630e4439ca8abb6c40beeaa0d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:07.709293 17174 raft_consensus.cc:3060] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.709671 17301 tablet_bootstrap.cc:654] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.710664 17507 raft_consensus.cc:493] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.713025 17507 raft_consensus.cc:515] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.721077 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:07.722074 17176 raft_consensus.cc:2468] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:07.724625 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8a7e0630e4439ca8abb6c40beeaa0d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:07.728683 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:07.729604 17100 raft_consensus.cc:2468] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
W20260709 13:19:07.732362 17216 leader_election.cc:343] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.715168 17507 leader_election.cc:290] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:07.764618 17353 consensus_queue.cc:1048] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:07.775756 17251 raft_consensus.cc:2468] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:07.757520 17330 raft_consensus.cc:515] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.807622 17297 tablet_bootstrap.cc:492] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:07.824946 17297 ts_tablet_manager.cc:1403] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.207s	user 0.016s	sys 0.015s
I20260709 13:19:07.832055 17330 leader_election.cc:290] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:07.813879 17296 tablet_bootstrap.cc:654] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.814997 16993 leader_election.cc:304] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:07.833249 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:07.834084 17247 raft_consensus.cc:3060] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.820847 17298 raft_consensus.cc:359] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.835582 17585 raft_consensus.cc:2804] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:07.835845 17298 raft_consensus.cc:385] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.836144 17585 raft_consensus.cc:493] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.836268 17298 raft_consensus.cc:740] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.836671 17585 raft_consensus.cc:3060] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.836679 17297 raft_consensus.cc:359] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.844559 17297 raft_consensus.cc:385] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.844977 17297 raft_consensus.cc:740] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.845908 17297 consensus_queue.cc:260] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.847167 17174 raft_consensus.cc:2468] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:07.845350 17585 raft_consensus.cc:515] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:07.848672 17297 ts_tablet_manager.cc:1434] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:19:07.849720 17297 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:07.849957 17585 leader_election.cc:290] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:07.843959 17247 raft_consensus.cc:2468] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:07.837085 17298 consensus_queue.cc:260] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.853453 17298 ts_tablet_manager.cc:1434] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.152s	user 0.011s	sys 0.008s
I20260709 13:19:07.854765 17301 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:07.855058 17066 leader_election.cc:304] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:07.856925 17296 tablet_bootstrap.cc:492] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:07.857136 17304 raft_consensus.cc:2804] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.857461 17296 ts_tablet_manager.cc:1403] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.195s	user 0.006s	sys 0.013s
I20260709 13:19:07.857209 17140 leader_election.cc:304] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:07.857905 17216 leader_election.cc:304] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:07.858837 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:07.859474 17098 raft_consensus.cc:3060] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.860317 17296 raft_consensus.cc:359] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.861029 17296 raft_consensus.cc:385] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.861311 17296 raft_consensus.cc:740] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.862030 17296 consensus_queue.cc:260] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.862701 17575 raft_consensus.cc:2804] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.863284 17575 raft_consensus.cc:697] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:07.864287 17296 ts_tablet_manager.cc:1434] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:07.864097 17575 consensus_queue.cc:237] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:07.865214 17296 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:07.865746 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:07.866407 17177 raft_consensus.cc:3060] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.858881 17385 raft_consensus.cc:2804] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.867192 17385 raft_consensus.cc:697] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:07.861397 16926 catalog_manager.cc:5697] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.868026 17385 consensus_queue.cc:237] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:07.873085 17296 tablet_bootstrap.cc:654] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.874197 17298 tablet_bootstrap.cc:492] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:07.876672 17247 raft_consensus.cc:1275] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:07.878554 17514 consensus_queue.cc:1048] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:07.884955 17304 raft_consensus.cc:697] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:07.886248 17304 consensus_queue.cc:237] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.894848 17102 raft_consensus.cc:1275] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:07.899806 17585 consensus_queue.cc:1048] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:07.908993 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:07.911918 17577 consensus_queue.cc:1048] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:07.914218 17177 raft_consensus.cc:2468] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:07.955261 17577 raft_consensus.cc:493] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.956071 17577 raft_consensus.cc:515] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:07.959322 17517 consensus_queue.cc:1048] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:07.963759 17577 leader_election.cc:290] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:07.966923 17068 leader_election.cc:343] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:07.976121 17297 tablet_bootstrap.cc:654] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.855293 17301 ts_tablet_manager.cc:1403] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.011s
I20260709 13:19:07.983984 17098 raft_consensus.cc:2468] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:07.998315 17577 consensus_queue.cc:1048] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:08.004832 17298 tablet_bootstrap.cc:654] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.007764 17297 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:08.008121 16993 leader_election.cc:304] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:08.008442 17297 ts_tablet_manager.cc:1403] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.010s
I20260709 13:19:08.009325 17585 raft_consensus.cc:2804] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:08.009866 17585 raft_consensus.cc:697] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:08.010373 17304 raft_consensus.cc:493] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.010929 17304 raft_consensus.cc:515] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.010778 17585 consensus_queue.cc:237] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.013221 17304 leader_election.cc:290] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.018622 17297 raft_consensus.cc:359] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.019695 17297 raft_consensus.cc:385] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.020056 17297 raft_consensus.cc:740] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.021214 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8a7e0630e4439ca8abb6c40beeaa0d" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:08.020915 17297 consensus_queue.cc:260] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.022111 17177 raft_consensus.cc:2393] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:08.023949 17297 ts_tablet_manager.cc:1434] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:19:08.025924 17297 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:08.035998 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8a7e0630e4439ca8abb6c40beeaa0d" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.052891 17297 tablet_bootstrap.cc:654] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.055575 16926 catalog_manager.cc:5697] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.061497 17301 raft_consensus.cc:359] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.046900 17324 consensus_queue.cc:1048] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:19:08.043891 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.043227 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:08.051486 17522 raft_consensus.cc:493] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.062556 17301 raft_consensus.cc:385] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.080967 17301 raft_consensus.cc:740] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.086612 17301 consensus_queue.cc:260] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:08.088907 17216 leader_election.cc:343] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:08.094216 17216 leader_election.cc:343] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.094874 17216 leader_election.cc:304] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.098209 16923 catalog_manager.cc:5697] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.065531 17577 consensus_queue.cc:1048] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:19:08.074774 17324 consensus_queue.cc:1048] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:19:08.102046 17575 raft_consensus.cc:2749] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:08.067358 17522 raft_consensus.cc:515] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.068843 17066 leader_election.cc:304] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:08.132354 16926 catalog_manager.cc:5697] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.136991 17297 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:08.137529 17297 ts_tablet_manager.cc:1403] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.016s
W20260709 13:19:08.138988 17066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 70255.7us
I20260709 13:19:08.143831 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:08.145483 17142 leader_election.cc:343] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.131018 17304 raft_consensus.cc:3060] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.152942 17297 raft_consensus.cc:359] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.154525 17522 leader_election.cc:290] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.154909 17301 ts_tablet_manager.cc:1434] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.176s	user 0.008s	sys 0.003s
I20260709 13:19:08.155720 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.163414 17385 raft_consensus.cc:493] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.166673 17304 raft_consensus.cc:2749] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:08.174463 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 73580.4us
I20260709 13:19:08.175786 17297 raft_consensus.cc:385] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.185468 17100 raft_consensus.cc:2468] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:08.188813 17301 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:08.190671 17297 raft_consensus.cc:740] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.193594 17297 consensus_queue.cc:260] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.191354 17298 tablet_bootstrap.cc:492] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:08.196483 17298 ts_tablet_manager.cc:1403] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.342s	user 0.016s	sys 0.000s
I20260709 13:19:08.199208 17142 leader_election.cc:304] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.219568 17297 ts_tablet_manager.cc:1434] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.005s
I20260709 13:19:08.220640 17296 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:08.221086 17297 tablet_bootstrap.cc:492] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:08.221282 17296 ts_tablet_manager.cc:1403] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.356s	user 0.085s	sys 0.119s
I20260709 13:19:08.189733 17385 raft_consensus.cc:515] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.231280 17296 raft_consensus.cc:359] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.236440 17296 raft_consensus.cc:385] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.236872 17296 raft_consensus.cc:740] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.236115 16924 catalog_manager.cc:5697] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:08.217111 17066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 76396.2us
I20260709 13:19:08.222676 17449 consensus_queue.cc:1048] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:19:08.247558 17298 raft_consensus.cc:359] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.248320 17298 raft_consensus.cc:385] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.248598 17298 raft_consensus.cc:740] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.249915 17385 leader_election.cc:290] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.218495 17353 raft_consensus.cc:2804] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:08.250033 17298 consensus_queue.cc:260] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.250698 17353 raft_consensus.cc:493] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.251080 17353 raft_consensus.cc:3060] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.252547 17298 ts_tablet_manager.cc:1434] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:19:08.253587 17298 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
W20260709 13:19:08.262672 17216 consensus_peers.cc:597] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:08.276117 17619 raft_consensus.cc:493] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.276733 17619 raft_consensus.cc:515] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.279016 17619 leader_election.cc:290] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:08.281553 17298 tablet_bootstrap.cc:654] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.283998 17026 raft_consensus.cc:3060] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:08.284072 17140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 78633.6us
I20260709 13:19:08.287415 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.287489 17296 consensus_queue.cc:260] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.289876 17296 ts_tablet_manager.cc:1434] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.068s	user 0.011s	sys 0.000s
I20260709 13:19:08.290268 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.291031 17250 raft_consensus.cc:2468] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:08.294282 17297 tablet_bootstrap.cc:654] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.295403 17296 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
W20260709 13:19:08.296213 17216 leader_election.cc:343] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.297936 17353 raft_consensus.cc:515] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.303498 17172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:08.304256 17172 raft_consensus.cc:2468] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:08.307394 17353 leader_election.cc:290] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.308018 17216 leader_election.cc:304] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:08.321491 17296 tablet_bootstrap.cc:654] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.324954 17449 raft_consensus.cc:2804] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:08.334410 17330 consensus_queue.cc:1048] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:08.335143 17449 raft_consensus.cc:493] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.340363 17449 raft_consensus.cc:3060] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.337050 17575 consensus_queue.cc:1048] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:08.350404 17140 leader_election.cc:304] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:08.351472 17625 raft_consensus.cc:2804] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:08.352063 17625 raft_consensus.cc:493] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.352434 17625 raft_consensus.cc:3060] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:08.377817 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 178687us
I20260709 13:19:08.381363 17297 tablet_bootstrap.cc:492] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:08.383280 17297 ts_tablet_manager.cc:1403] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.011s
I20260709 13:19:08.396653 17449 raft_consensus.cc:515] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.398420 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:08.399111 17100 raft_consensus.cc:3060] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.404881 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:08.398325 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.408540 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:08.409868 17449 leader_election.cc:290] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:08.411453 17625 raft_consensus.cc:515] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.414114 17301 tablet_bootstrap.cc:654] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.415263 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
W20260709 13:19:08.427696 17142 consensus_peers.cc:597] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:08.429586 17625 leader_election.cc:290] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.430124 17174 raft_consensus.cc:2393] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f75c7dc3c3f24e2e800d40d91f7311f4 in current term 1: Already voted for candidate 896fb6e3b27e4874a469245a7b103111 in this term.
W20260709 13:19:08.429348 17142 leader_election.cc:343] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.443557 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:08.444392 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8712f3f0952b48d5b34d644bdfdc263d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:08.449110 17247 raft_consensus.cc:2393] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:08.450984 17296 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:08.451582 17296 ts_tablet_manager.cc:1403] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.005s
I20260709 13:19:08.455116 17511 consensus_queue.cc:1048] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:08.459900 17296 raft_consensus.cc:359] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.460855 17522 consensus_queue.cc:1048] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:08.465145 17296 raft_consensus.cc:385] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.465505 17296 raft_consensus.cc:740] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.466549 17297 raft_consensus.cc:359] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.467274 17100 raft_consensus.cc:2468] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:08.467338 17297 raft_consensus.cc:385] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.469803 17297 raft_consensus.cc:740] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.471001 17616 consensus_queue.cc:1048] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:08.471154 17297 consensus_queue.cc:260] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.475773 17142 leader_election.cc:304] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.475773 17296 consensus_queue.cc:260] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.479344 17297 ts_tablet_manager.cc:1434] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.008s
I20260709 13:19:08.487573 17298 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:08.489475 17298 ts_tablet_manager.cc:1403] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.236s	user 0.015s	sys 0.017s
I20260709 13:19:08.489781 17297 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:08.491150 17216 leader_election.cc:304] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:08.494395 17625 raft_consensus.cc:2804] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:08.495008 17625 raft_consensus.cc:697] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:08.495925 17625 consensus_queue.cc:237] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.498255 17298 raft_consensus.cc:359] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.499024 17298 raft_consensus.cc:385] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.499275 17298 raft_consensus.cc:740] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.500061 17298 consensus_queue.cc:260] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.501667 17298 ts_tablet_manager.cc:1434] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:19:08.502718 17298 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:08.502652 17449 raft_consensus.cc:2749] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:08.509249 17453 consensus_queue.cc:1048] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:08.489427 17103 raft_consensus.cc:3060] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.517406 17296 ts_tablet_manager.cc:1434] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.002s
I20260709 13:19:08.518653 17296 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:08.536231 17511 raft_consensus.cc:493] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.536835 17511 raft_consensus.cc:515] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.540540 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:08.542752 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.543291 17103 raft_consensus.cc:2468] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:08.543519 17250 raft_consensus.cc:2468] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
W20260709 13:19:08.545310 17068 leader_election.cc:343] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.546125 17066 leader_election.cc:304] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.547025 17620 raft_consensus.cc:2804] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:08.547387 17620 raft_consensus.cc:493] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.547698 17620 raft_consensus.cc:3060] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.548879 17298 tablet_bootstrap.cc:654] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.535993 17296 tablet_bootstrap.cc:654] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.551560 17142 leader_election.cc:304] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:08.552419 17297 tablet_bootstrap.cc:654] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.552855 17621 raft_consensus.cc:2804] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:08.575688 17346 raft_consensus.cc:493] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1364e853d9ea4df1950346fb170498b8)
I20260709 13:19:08.601007 17346 raft_consensus.cc:515] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.602105 17621 raft_consensus.cc:697] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:08.606437 17624 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.575016 17301 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:08.608503 17301 ts_tablet_manager.cc:1403] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.426s	user 0.016s	sys 0.008s
I20260709 13:19:08.608306 17624 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.609480 17251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.567830 17507 consensus_queue.cc:1048] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:19:08.612435 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.613041 17624 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:08.614274 17142 leader_election.cc:343] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.615084 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:08.615319 17621 consensus_queue.cc:237] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
W20260709 13:19:08.616432 17142 leader_election.cc:343] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.616842 17142 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.617839 17624 raft_consensus.cc:2749] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:08.617529 16924 catalog_manager.cc:5697] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.612484 17301 raft_consensus.cc:359] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.620067 17301 raft_consensus.cc:385] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.620373 17301 raft_consensus.cc:740] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.621163 17301 consensus_queue.cc:260] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.629117 17301 ts_tablet_manager.cc:1434] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 13:19:08.630151 17301 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:08.643931 17297 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:08.644670 17297 ts_tablet_manager.cc:1403] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.164s	user 0.010s	sys 0.005s
I20260709 13:19:08.605317 17620 raft_consensus.cc:515] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.646849 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.656116 16993 leader_election.cc:304] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:08.656349 17296 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:08.647409 17346 leader_election.cc:290] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.649714 17301 tablet_bootstrap.cc:654] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.657162 17507 raft_consensus.cc:2749] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:08.562933 17511 leader_election.cc:290] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:08.652334 17298 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:08.658339 17296 ts_tablet_manager.cc:1403] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.000s
I20260709 13:19:08.658466 17298 ts_tablet_manager.cc:1403] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.022s
I20260709 13:19:08.659719 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:08.660364 17247 raft_consensus.cc:3060] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.661816 17298 raft_consensus.cc:359] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.662998 17298 raft_consensus.cc:385] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.663421 17298 raft_consensus.cc:740] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.664460 17298 consensus_queue.cc:260] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.668448 17247 raft_consensus.cc:2468] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:08.673326 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:08.673329 17066 leader_election.cc:304] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:08.671322 17301 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
W20260709 13:19:08.679003 17068 leader_election.cc:343] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.679822 17301 ts_tablet_manager.cc:1403] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.001s
I20260709 13:19:08.680128 17511 raft_consensus.cc:2804] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:08.680856 17511 raft_consensus.cc:697] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:08.681717 17511 consensus_queue.cc:237] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.682778 17301 raft_consensus.cc:359] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.686431 17301 raft_consensus.cc:385] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.686743 17301 raft_consensus.cc:740] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.687736 17301 consensus_queue.cc:260] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.681540 17296 raft_consensus.cc:359] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.689139 17296 raft_consensus.cc:385] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.689450 17296 raft_consensus.cc:740] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.690268 17301 ts_tablet_manager.cc:1434] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:08.690155 17296 consensus_queue.cc:260] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.683972 17297 raft_consensus.cc:359] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.691742 17297 raft_consensus.cc:385] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.692014 17297 raft_consensus.cc:740] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.698939 17298 ts_tablet_manager.cc:1434] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:19:08.702430 17298 tablet_bootstrap.cc:492] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:08.703150 17301 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:08.692716 17297 consensus_queue.cc:260] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.708310 17297 ts_tablet_manager.cc:1434] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.000s
I20260709 13:19:08.709378 17297 tablet_bootstrap.cc:492] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:08.711004 17296 ts_tablet_manager.cc:1434] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:19:08.712036 17296 tablet_bootstrap.cc:492] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:08.710083 17620 leader_election.cc:290] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:08.716190 17301 tablet_bootstrap.cc:654] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.717433 17298 tablet_bootstrap.cc:654] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.719076 17453 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.719662 17453 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.721398 17026 raft_consensus.cc:3060] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.721845 17453 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.724002 17297 tablet_bootstrap.cc:654] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:08.729236 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:08.722641 17296 tablet_bootstrap.cc:654] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.732669 17301 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:08.733944 17301 ts_tablet_manager.cc:1403] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:19:08.736160 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:08.739646 17301 raft_consensus.cc:359] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.742939 17301 raft_consensus.cc:385] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.743346 17301 raft_consensus.cc:740] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.743824 17298 tablet_bootstrap.cc:492] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:08.744029 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.744350 17298 ts_tablet_manager.cc:1403] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.008s
I20260709 13:19:08.744175 17301 consensus_queue.cc:260] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.742534 17297 tablet_bootstrap.cc:492] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:08.745437 17297 ts_tablet_manager.cc:1403] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.002s
I20260709 13:19:08.744707 17102 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:08.747458 17298 raft_consensus.cc:359] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.748229 17298 raft_consensus.cc:385] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.740217 17296 tablet_bootstrap.cc:492] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:08.748368 17297 raft_consensus.cc:359] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.749236 17298 raft_consensus.cc:740] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.748819 17296 ts_tablet_manager.cc:1403] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:19:08.748744 16924 catalog_manager.cc:5697] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.754396 17346 raft_consensus.cc:493] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.754493 17296 raft_consensus.cc:359] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.755391 17296 raft_consensus.cc:385] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.755097 17346 raft_consensus.cc:515] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.749276 17297 raft_consensus.cc:385] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.757972 17346 leader_election.cc:290] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.750080 17298 consensus_queue.cc:260] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.758665 17297 raft_consensus.cc:740] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.758726 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.759944 17297 consensus_queue.cc:260] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.761046 17296 raft_consensus.cc:740] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.761808 17296 consensus_queue.cc:260] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.758188 17301 ts_tablet_manager.cc:1434] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:19:08.763379 17301 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:08.764045 17296 ts_tablet_manager.cc:1434] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:08.764839 17297 ts_tablet_manager.cc:1434] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:19:08.767056 17297 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:08.765030 17296 tablet_bootstrap.cc:492] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:08.760829 17298 ts_tablet_manager.cc:1434] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:19:08.776153 17301 tablet_bootstrap.cc:654] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.777156 17298 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:08.778631 17297 tablet_bootstrap.cc:654] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.779896 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5cb5807ca8471bab64797de2f9919b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.780797 17247 raft_consensus.cc:2393] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:08.782207 16991 leader_election.cc:304] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:08.783802 17507 raft_consensus.cc:3060] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.788358 17298 tablet_bootstrap.cc:654] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.798177 17296 tablet_bootstrap.cc:654] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:08.800227 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 44049.9us
I20260709 13:19:08.801210 17216 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:08.811224 17296 tablet_bootstrap.cc:492] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:08.812029 17296 ts_tablet_manager.cc:1403] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.001s
I20260709 13:19:08.813125 17621 raft_consensus.cc:493] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.813880 17621 raft_consensus.cc:515] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.815011 17296 raft_consensus.cc:359] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.815734 17296 raft_consensus.cc:385] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.816013 17296 raft_consensus.cc:740] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.816694 17296 consensus_queue.cc:260] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.819135 17298 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:08.819522 17619 raft_consensus.cc:2804] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:08.823647 17619 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.824002 17619 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.828581 16926 catalog_manager.cc:5697] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.831986 17619 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.819222 17296 ts_tablet_manager.cc:1434] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:08.820909 17507 raft_consensus.cc:2749] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:08.835549 17621 leader_election.cc:290] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.836287 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.836992 17102 raft_consensus.cc:2468] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:08.838433 17142 leader_election.cc:304] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:08.841729 17621 raft_consensus.cc:2804] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:08.820317 17216 leader_election.cc:343] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.843081 17296 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:08.833420 17298 ts_tablet_manager.cc:1403] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.004s
I20260709 13:19:08.848698 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.851219 17250 raft_consensus.cc:2468] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:08.854209 17619 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.846061 17507 raft_consensus.cc:493] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.856161 17507 raft_consensus.cc:515] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.857307 17301 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:08.857854 17301 ts_tablet_manager.cc:1403] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.010s
I20260709 13:19:08.858381 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:08.861606 17301 raft_consensus.cc:359] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.862478 17301 raft_consensus.cc:385] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.862986 17301 raft_consensus.cc:740] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
W20260709 13:19:08.863525 17216 leader_election.cc:343] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.842986 17621 raft_consensus.cc:493] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.863703 17301 consensus_queue.cc:260] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.862396 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf71c3afe414daeb032d872c3c949c3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:08.867906 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcf71c3afe414daeb032d872c3c949c3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.869283 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:08.869880 17102 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.871158 17324 raft_consensus.cc:493] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.871690 17324 raft_consensus.cc:515] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.873575 17324 leader_election.cc:290] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:08.875593 16991 leader_election.cc:304] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:08.876507 17346 raft_consensus.cc:2749] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:08.878604 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12efab3d68e44ec697cc29a3695960e4" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:08.880481 17142 leader_election.cc:343] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.865693 17621 raft_consensus.cc:3060] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.886160 17102 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:08.887288 17301 ts_tablet_manager.cc:1434] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:19:08.893636 17301 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:08.897578 17296 tablet_bootstrap.cc:654] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.898309 17507 leader_election.cc:290] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.899772 17297 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:08.900480 17297 ts_tablet_manager.cc:1403] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.036s
I20260709 13:19:08.905869 17297 raft_consensus.cc:359] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.908588 17297 raft_consensus.cc:385] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.909726 17301 tablet_bootstrap.cc:654] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.910000 17296 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:08.910559 17296 ts_tablet_manager.cc:1403] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.004s
I20260709 13:19:08.910997 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12efab3d68e44ec697cc29a3695960e4" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.911700 17250 raft_consensus.cc:2468] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:08.914103 17296 raft_consensus.cc:359] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.915617 17296 raft_consensus.cc:385] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.915946 17296 raft_consensus.cc:740] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.909016 17297 raft_consensus.cc:740] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.919018 17621 raft_consensus.cc:515] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.919396 17297 consensus_queue.cc:260] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.922256 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:08.922467 17216 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.922876 17103 raft_consensus.cc:3060] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.923496 17297 ts_tablet_manager.cc:1434] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:19:08.924211 17619 raft_consensus.cc:2804] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:08.924593 17297 tablet_bootstrap.cc:492] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:08.924748 17619 raft_consensus.cc:697] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:08.925388 17296 consensus_queue.cc:260] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.925665 17619 consensus_queue.cc:237] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.927860 17296 ts_tablet_manager.cc:1434] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:19:08.931381 17298 raft_consensus.cc:359] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.932212 17298 raft_consensus.cc:385] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:08.932446 17296 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:08.932468 17298 raft_consensus.cc:740] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.939816 17140 leader_election.cc:304] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.944378 17324 raft_consensus.cc:2804] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:08.946375 17324 raft_consensus.cc:493] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.946758 17324 raft_consensus.cc:3060] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.963534 17624 raft_consensus.cc:493] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.964186 17624 raft_consensus.cc:515] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.967607 17625 raft_consensus.cc:493] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.968137 17625 raft_consensus.cc:515] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:08.968696 17324 raft_consensus.cc:515] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.970320 17625 leader_election.cc:290] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:08.971417 17353 raft_consensus.cc:493] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.971743 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:08.971877 17353 raft_consensus.cc:515] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:08.973006 17624 leader_election.cc:290] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.970332 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb7c15929434ca0a9f7925722859adf" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.973881 17296 tablet_bootstrap.cc:654] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.973623 17624 consensus_queue.cc:1048] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:08.974583 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:08.974056 17353 leader_election.cc:290] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:08.959844 17298 consensus_queue.cc:260] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:08.978049 17324 leader_election.cc:290] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
W20260709 13:19:08.979027 17142 leader_election.cc:343] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.979444 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:08.981096 17142 leader_election.cc:343] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:08.981714 17142 leader_election.cc:343] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.984978 17103 raft_consensus.cc:2468] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:08.985019 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb7c15929434ca0a9f7925722859adf" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.982326 17142 leader_election.cc:304] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:08.986711 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:08.987339 17353 raft_consensus.cc:2749] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:08.988010 17297 tablet_bootstrap.cc:654] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.988272 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12efab3d68e44ec697cc29a3695960e4" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:08.988930 17247 raft_consensus.cc:3060] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:08.988490 17298 ts_tablet_manager.cc:1434] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.145s	user 0.004s	sys 0.003s
I20260709 13:19:08.989393 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12efab3d68e44ec697cc29a3695960e4" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
W20260709 13:19:08.991271 17142 leader_election.cc:343] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:08.991952 17142 leader_election.cc:343] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:08.992405 17621 leader_election.cc:290] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:08.992643 17142 leader_election.cc:304] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:08.992085 17298 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:08.994802 17353 raft_consensus.cc:2804] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:08.992980 17301 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:08.995306 17353 raft_consensus.cc:697] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:08.995518 17301 ts_tablet_manager.cc:1403] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.102s	user 0.028s	sys 0.008s
I20260709 13:19:08.996109 17353 consensus_queue.cc:237] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:08.998574 17301 raft_consensus.cc:359] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:09.002868 17140 leader_election.cc:343] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.005282 17301 raft_consensus.cc:385] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.005337 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:09.006533 17250 raft_consensus.cc:3060] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.006332 17301 raft_consensus.cc:740] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.005280 17140 leader_election.cc:304] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
W20260709 13:19:09.010031 17140 leader_election.cc:343] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.010512 17140 leader_election.cc:304] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:09.012933 17625 raft_consensus.cc:2749] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:09.012385 16923 catalog_manager.cc:5697] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.008349 17301 consensus_queue.cc:260] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.012130 17324 raft_consensus.cc:2749] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:09.017227 17301 ts_tablet_manager.cc:1434] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:19:09.017617 17026 raft_consensus.cc:3060] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.018249 17301 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:09.018563 17247 raft_consensus.cc:2468] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:09.025722 17140 leader_election.cc:304] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:09.027899 17624 raft_consensus.cc:2804] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:09.028517 17624 raft_consensus.cc:697] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:09.029997 17624 consensus_queue.cc:237] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.040010 17301 tablet_bootstrap.cc:654] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.043648 17250 raft_consensus.cc:2468] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:09.044378 17296 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:09.045037 17296 ts_tablet_manager.cc:1403] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.010s
I20260709 13:19:09.050529 17624 consensus_queue.cc:1048] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:09.051793 17297 tablet_bootstrap.cc:492] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:09.052423 17297 ts_tablet_manager.cc:1403] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.004s
I20260709 13:19:09.003778 17298 tablet_bootstrap.cc:654] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.055994 17297 raft_consensus.cc:359] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.057137 17296 raft_consensus.cc:359] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.063025 17296 raft_consensus.cc:385] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.063025 17297 raft_consensus.cc:385] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.063442 17296 raft_consensus.cc:740] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.063618 17297 raft_consensus.cc:740] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.064241 17296 consensus_queue.cc:260] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.064437 17297 consensus_queue.cc:260] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.069902 17296 ts_tablet_manager.cc:1434] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:19:09.070961 17296 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:09.074144 17301 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:09.074747 17301 ts_tablet_manager.cc:1403] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.007s
I20260709 13:19:09.075613 17297 ts_tablet_manager.cc:1434] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:19:09.076720 17297 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:09.077589 17301 raft_consensus.cc:359] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.145602 17301 raft_consensus.cc:385] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.145987 17301 raft_consensus.cc:740] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.146735 17301 consensus_queue.cc:260] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.151844 17297 tablet_bootstrap.cc:654] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.157831 17296 tablet_bootstrap.cc:654] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.160223 16924 catalog_manager.cc:5697] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.163360 17511 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.163930 17511 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.165975 17511 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:09.166395 16924 catalog_manager.cc:5697] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.183964 17514 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.184628 17514 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.186942 17514 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:09.187094 17620 consensus_queue.cc:1048] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:09.191002 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:09.191771 17176 raft_consensus.cc:2468] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:09.193002 17301 ts_tablet_manager.cc:1434] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.118s	user 0.006s	sys 0.000s
I20260709 13:19:09.194479 17301 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:09.195614 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:09.196302 17176 raft_consensus.cc:2468] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:09.209564 16993 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:09.210397 17068 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:09.207430 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:09.211249 17620 raft_consensus.cc:2804] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.217206 17620 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.217716 17620 raft_consensus.cc:3060] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.213580 17666 raft_consensus.cc:2804] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.215451 17511 raft_consensus.cc:493] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.218569 17666 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.218990 17666 raft_consensus.cc:3060] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.218806 17511 raft_consensus.cc:515] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.221232 17511 leader_election.cc:290] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:09.227133 17301 tablet_bootstrap.cc:654] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.237516 17666 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.244556 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb7c15929434ca0a9f7925722859adf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:09.254043 17176 raft_consensus.cc:2468] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:09.249020 17296 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:09.263684 17296 ts_tablet_manager.cc:1403] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.193s	user 0.009s	sys 0.005s
I20260709 13:19:09.252113 17621 consensus_queue.cc:1048] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:09.237516 17298 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:09.246447 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb7c15929434ca0a9f7925722859adf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:09.257833 17666 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:09.257838 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:09.258491 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:09.269621 17298 ts_tablet_manager.cc:1403] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.013s
I20260709 13:19:09.270617 17026 raft_consensus.cc:2393] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:09.259935 17068 leader_election.cc:304] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:09.260169 17172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:09.271781 17172 raft_consensus.cc:3060] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.271914 17624 consensus_queue.cc:1048] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:09.261111 17301 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:09.274927 17301 ts_tablet_manager.cc:1403] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.002s
I20260709 13:19:09.276072 17298 raft_consensus.cc:359] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.276615 17298 raft_consensus.cc:385] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.276786 17298 raft_consensus.cc:740] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.277518 17298 consensus_queue.cc:260] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.278788 17301 raft_consensus.cc:359] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.279547 17301 raft_consensus.cc:385] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.279826 17301 raft_consensus.cc:740] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.280635 17301 consensus_queue.cc:260] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.282368 17298 ts_tablet_manager.cc:1434] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:19:09.282804 17301 ts_tablet_manager.cc:1434] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:09.282934 17172 raft_consensus.cc:2468] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:09.283505 17298 tablet_bootstrap.cc:492] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:09.283891 17301 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:09.284443 16993 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:09.287739 17666 raft_consensus.cc:2804] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:09.288414 17666 raft_consensus.cc:697] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:09.289242 17666 consensus_queue.cc:237] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.291157 17296 raft_consensus.cc:359] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.291926 17296 raft_consensus.cc:385] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.292199 17296 raft_consensus.cc:740] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.292855 17296 consensus_queue.cc:260] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.244364 17620 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.297842 17100 raft_consensus.cc:2393] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:09.298573 17620 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:09.300431 17301 tablet_bootstrap.cc:654] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.303328 17026 raft_consensus.cc:3060] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.307258 17298 tablet_bootstrap.cc:654] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.303340 17296 ts_tablet_manager.cc:1434] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:19:09.310725 17296 tablet_bootstrap.cc:492] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
W20260709 13:19:09.321286 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 61427.1us
I20260709 13:19:09.326960 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
W20260709 13:19:09.325713 17066 leader_election.cc:343] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.334671 17297 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:09.335242 17297 ts_tablet_manager.cc:1403] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.259s	user 0.030s	sys 0.036s
W20260709 13:19:09.335438 17066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 64454.1us
I20260709 13:19:09.340909 17296 tablet_bootstrap.cc:654] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.351048 17297 raft_consensus.cc:359] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.352259 17297 raft_consensus.cc:385] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.352653 17297 raft_consensus.cc:740] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.353695 17297 consensus_queue.cc:260] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.327930 17620 raft_consensus.cc:2804] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.360134 17620 raft_consensus.cc:493] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.343734 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:09.368652 17176 raft_consensus.cc:2393] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:09.360659 17620 raft_consensus.cc:3060] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.386565 16923 catalog_manager.cc:5697] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:09.397033 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 72404.9us
I20260709 13:19:09.404501 17068 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:09.400377 17449 raft_consensus.cc:493] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.408125 17449 raft_consensus.cc:515] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.397686 17511 consensus_queue.cc:1048] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:09.418493 17301 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:09.419064 17297 ts_tablet_manager.cc:1434] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.084s	user 0.016s	sys 0.033s
I20260709 13:19:09.419176 17301 ts_tablet_manager.cc:1403] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.009s
I20260709 13:19:09.420652 17297 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:09.423072 17621 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.425204 17449 leader_election.cc:290] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:09.424968 17621 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.427179 17621 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:09.429826 17301 raft_consensus.cc:359] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.430387 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6eedb2345347888597839f1da5742c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:09.430651 17301 raft_consensus.cc:385] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.431347 17301 raft_consensus.cc:740] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.432194 17301 consensus_queue.cc:260] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.434126 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:09.435393 17297 tablet_bootstrap.cc:654] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.437132 17301 ts_tablet_manager.cc:1434] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:19:09.438090 17298 tablet_bootstrap.cc:492] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:09.443260 17298 ts_tablet_manager.cc:1403] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.004s
I20260709 13:19:09.438176 17301 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:09.448616 17142 leader_election.cc:343] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.463186 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6eedb2345347888597839f1da5742c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
W20260709 13:19:09.465310 17216 leader_election.cc:343] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.439324 17028 raft_consensus.cc:2468] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:09.467149 17297 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:09.438369 17023 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.473816 17296 tablet_bootstrap.cc:492] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:09.474400 17296 ts_tablet_manager.cc:1403] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.014s
I20260709 13:19:09.476095 17297 ts_tablet_manager.cc:1403] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.010s
I20260709 13:19:09.442739 17679 raft_consensus.cc:2749] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:09.476840 17301 tablet_bootstrap.cc:654] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.499055 17297 raft_consensus.cc:359] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.500576 17297 raft_consensus.cc:385] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.500895 17297 raft_consensus.cc:740] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.501684 17297 consensus_queue.cc:260] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.505492 17297 ts_tablet_manager.cc:1434] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:19:09.506515 17297 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:09.507692 17296 raft_consensus.cc:359] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.509713 17296 raft_consensus.cc:385] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.510047 17296 raft_consensus.cc:740] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.521070 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:09.517791 17298 raft_consensus.cc:359] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.524644 17298 raft_consensus.cc:385] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.524959 17298 raft_consensus.cc:740] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.523978 17666 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.518947 17066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 68749.5us
I20260709 13:19:09.526983 17298 consensus_queue.cc:260] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.527135 17666 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.529193 17298 ts_tablet_manager.cc:1434] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:19:09.529971 17666 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:09.531423 17298 tablet_bootstrap.cc:492] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:09.525702 17621 consensus_queue.cc:1048] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:19:09.523447 17142 leader_election.cc:343] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.535049 17142 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:09.541498 17304 raft_consensus.cc:493] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.543673 17304 raft_consensus.cc:515] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.545753 17620 raft_consensus.cc:515] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.547417 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:09.548032 17620 leader_election.cc:290] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:09.548099 17103 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:09.545908 17304 leader_election.cc:290] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:09.551810 16993 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:09.540323 17621 raft_consensus.cc:2749] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:09.547942 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:09.553179 17585 raft_consensus.cc:2804] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:09.553366 17575 consensus_queue.cc:1048] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:09.555188 17022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:09.553643 17585 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.558218 17585 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:09.560078 17068 leader_election.cc:343] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.553539 17173 raft_consensus.cc:2468] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:09.564946 17216 leader_election.cc:304] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:09.565828 17449 raft_consensus.cc:2804] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.566193 17449 raft_consensus.cc:493] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.566596 17449 raft_consensus.cc:3060] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.580595 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:09.597050 17301 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:09.597651 17301 ts_tablet_manager.cc:1403] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.006s
I20260709 13:19:09.599324 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb7c15929434ca0a9f7925722859adf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:09.592561 17453 raft_consensus.cc:493] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.600598 17248 raft_consensus.cc:3060] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.601054 17453 raft_consensus.cc:515] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.601450 17068 leader_election.cc:304] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:09.602993 17296 consensus_queue.cc:260] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.606395 17682 raft_consensus.cc:2804] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.606871 17682 raft_consensus.cc:493] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.607204 17682 raft_consensus.cc:3060] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.616463 17296 ts_tablet_manager.cc:1434] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.001s
I20260709 13:19:09.617436 17296 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:09.619232 17023 raft_consensus.cc:3060] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.620788 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb7c15929434ca0a9f7925722859adf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:09.621455 17176 raft_consensus.cc:3060] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.631698 17172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:09.636087 17172 raft_consensus.cc:2468] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:09.638960 17216 leader_election.cc:304] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:09.639863 17619 raft_consensus.cc:2804] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:09.639739 17575 consensus_queue.cc:1048] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:09.641070 17248 raft_consensus.cc:2468] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:09.640355 17619 raft_consensus.cc:493] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.643985 17619 raft_consensus.cc:3060] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.646142 17453 leader_election.cc:290] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:09.647192 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:09.648809 17216 leader_election.cc:343] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.649387 17621 consensus_queue.cc:1048] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:09.658185 17298 tablet_bootstrap.cc:654] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.658449 17353 consensus_queue.cc:1048] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:09.641832 17301 raft_consensus.cc:359] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.662617 17301 raft_consensus.cc:385] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.662967 17301 raft_consensus.cc:740] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.663661 17301 consensus_queue.cc:260] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.663722 17619 raft_consensus.cc:515] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.665808 17301 ts_tablet_manager.cc:1434] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.000s
I20260709 13:19:09.666018 17619 leader_election.cc:290] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:09.669239 17066 leader_election.cc:304] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:09.678401 17172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:09.679147 17172 raft_consensus.cc:3060] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.679509 17301 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:09.679631 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:09.681640 17621 consensus_queue.cc:1048] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:09.684607 17216 leader_election.cc:343] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.653919 17449 raft_consensus.cc:515] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.739941 17172 raft_consensus.cc:2468] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:09.741119 17297 tablet_bootstrap.cc:654] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.686988 17684 raft_consensus.cc:2804] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:09.738071 17301 tablet_bootstrap.cc:654] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.703995 17514 consensus_queue.cc:1048] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:19:09.746742 17449 leader_election.cc:290] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:09.711531 17621 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.774446 17684 raft_consensus.cc:697] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
W20260709 13:19:09.702663 17688 log.cc:927] Time spent T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:09.706214 17585 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.793315 17666 consensus_queue.cc:1048] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:09.794762 17022 raft_consensus.cc:1240] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Rejecting Update request from peer f75c7dc3c3f24e2e800d40d91f7311f4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:19:09.795254 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:09.809438 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:09.773293 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6eedb2345347888597839f1da5742c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:09.774384 17621 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.685640 17176 raft_consensus.cc:2468] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:09.701609 17682 raft_consensus.cc:515] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.823292 17684 consensus_queue.cc:237] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:09.786080 17585 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:09.824055 17682 leader_election.cc:290] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:09.819165 17028 raft_consensus.cc:3060] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.830804 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:09.831648 17024 raft_consensus.cc:3060] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.842666 17297 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:09.842528 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6eedb2345347888597839f1da5742c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:09.843328 17297 ts_tablet_manager.cc:1403] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.337s	user 0.019s	sys 0.010s
I20260709 13:19:09.843742 17103 raft_consensus.cc:3060] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.687544 17296 tablet_bootstrap.cc:654] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.855293 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:09.856164 17177 raft_consensus.cc:3060] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:09.859373 17621 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:09.865465 17297 raft_consensus.cc:359] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.866381 17297 raft_consensus.cc:385] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.866773 17297 raft_consensus.cc:740] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.879946 16993 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:09.888689 17297 consensus_queue.cc:260] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:09.892470 17297 ts_tablet_manager.cc:1434] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:19:09.893504 17297 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:09.893577 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:09.896895 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 65462.8us
I20260709 13:19:09.903915 17585 raft_consensus.cc:2749] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:09.905375 17142 leader_election.cc:343] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.907423 17575 consensus_queue.cc:1059] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:09.918789 17301 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:09.919361 17301 ts_tablet_manager.cc:1403] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.011s
W20260709 13:19:09.926477 17697 log.cc:927] Time spent T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:09.927070 17298 tablet_bootstrap.cc:492] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:09.927178 17619 raft_consensus.cc:3055] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:09.927783 17619 raft_consensus.cc:740] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:09.928730 17619 consensus_queue.cc:260] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:09.930794 17216 leader_election.cc:304] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:09.908974 17103 raft_consensus.cc:2468] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:09.927848 17298 ts_tablet_manager.cc:1403] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.398s	user 0.028s	sys 0.029s
I20260709 13:19:09.959033 17301 raft_consensus.cc:359] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.960342 17301 raft_consensus.cc:385] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.960760 17301 raft_consensus.cc:740] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.962893 17301 consensus_queue.cc:260] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:09.935964 17449 raft_consensus.cc:2804] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:09.932679 17177 raft_consensus.cc:2468] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:09.962566 17619 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.979579 17216 leader_election.cc:304] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:09.979609 17301 ts_tablet_manager.cc:1434] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 13:19:09.986034 17687 raft_consensus.cc:2804] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:09.987571 17301 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:09.988019 17068 leader_election.cc:304] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:09.983623 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:09.989814 17304 raft_consensus.cc:2804] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.006490 17304 raft_consensus.cc:697] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:10.007472 17304 consensus_queue.cc:237] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.005833 17297 tablet_bootstrap.cc:654] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.990146 17687 raft_consensus.cc:697] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:10.014309 17687 consensus_queue.cc:237] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:10.014595 17140 leader_election.cc:343] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:10.020303 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:10.020180 17140 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:10.022677 17625 raft_consensus.cc:2749] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.033907 17298 raft_consensus.cc:359] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.036180 17298 raft_consensus.cc:385] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.037338 17298 raft_consensus.cc:740] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.038029 17298 consensus_queue.cc:260] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.040511 17298 ts_tablet_manager.cc:1434] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 13:19:10.044011 17449 raft_consensus.cc:697] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:10.050927 17296 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:10.051576 17296 ts_tablet_manager.cc:1403] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.434s	user 0.027s	sys 0.048s
I20260709 13:19:10.052438 17449 consensus_queue.cc:237] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.066550 17296 raft_consensus.cc:359] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.067719 17296 raft_consensus.cc:385] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.068080 17296 raft_consensus.cc:740] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.069065 17296 consensus_queue.cc:260] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.076507 17625 raft_consensus.cc:493] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.077047 17625 raft_consensus.cc:515] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.079289 17625 leader_election.cc:290] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:10.083004 17296 ts_tablet_manager.cc:1434] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 13:19:10.084163 17296 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111: Bootstrap starting.
I20260709 13:19:10.088317 17297 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:10.088904 17297 ts_tablet_manager.cc:1403] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.007s
I20260709 13:19:10.091048 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:10.091830 17247 raft_consensus.cc:2468] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:10.091827 17297 raft_consensus.cc:359] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.093444 17297 raft_consensus.cc:385] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.093743 17297 raft_consensus.cc:740] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.094547 17301 tablet_bootstrap.cc:654] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.094527 17297 consensus_queue.cc:260] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.096535 17140 leader_election.cc:304] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:10.097599 17297 ts_tablet_manager.cc:1434] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:10.098878 17297 tablet_bootstrap.cc:492] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:10.109764 17297 tablet_bootstrap.cc:654] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.110294 17708 raft_consensus.cc:2804] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.110831 17708 raft_consensus.cc:493] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.111218 17708 raft_consensus.cc:3060] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.112951 17024 raft_consensus.cc:2468] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:10.127846 17301 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:10.128437 17301 ts_tablet_manager.cc:1403] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.002s
I20260709 13:19:10.128168 17708 raft_consensus.cc:515] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.130565 17708 leader_election.cc:290] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:10.131999 17028 raft_consensus.cc:2468] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:10.132699 17296 tablet_bootstrap.cc:654] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.147300 17301 raft_consensus.cc:359] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.148010 17301 raft_consensus.cc:385] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.148283 17301 raft_consensus.cc:740] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.149034 17301 consensus_queue.cc:260] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.150632 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:10.151280 17247 raft_consensus.cc:3060] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.151692 17301 ts_tablet_manager.cc:1434] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:19:10.152762 17301 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:10.163187 17301 tablet_bootstrap.cc:654] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.168495 17296 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111: No bootstrap required, opened a new log
I20260709 13:19:10.168733 17297 tablet_bootstrap.cc:492] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:10.169014 17296 ts_tablet_manager.cc:1403] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.011s
I20260709 13:19:10.169270 17297 ts_tablet_manager.cc:1403] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.013s
I20260709 13:19:10.171769 17296 raft_consensus.cc:359] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.172389 17296 raft_consensus.cc:385] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.172631 17296 raft_consensus.cc:740] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.173308 17296 consensus_queue.cc:260] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.174912 17296 ts_tablet_manager.cc:1434] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:10.176420 17247 raft_consensus.cc:2468] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:10.177906 17140 leader_election.cc:304] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:10.179080 17708 raft_consensus.cc:2804] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.186681 17297 raft_consensus.cc:359] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.187513 17297 raft_consensus.cc:385] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.187803 17297 raft_consensus.cc:740] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.188423 17297 consensus_queue.cc:260] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.191134 17708 raft_consensus.cc:697] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:10.193326 17708 consensus_queue.cc:237] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.199311 17297 ts_tablet_manager.cc:1434] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:19:10.202375 17297 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:10.202729 17301 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:10.203370 17301 ts_tablet_manager.cc:1403] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.005s
I20260709 13:19:10.211423 17297 tablet_bootstrap.cc:654] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.215915 17298 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:10.224390 17324 raft_consensus.cc:493] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.224956 17324 raft_consensus.cc:515] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.226912 17324 leader_election.cc:290] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:10.234658 17297 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:10.236382 17297 ts_tablet_manager.cc:1403] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.013s
I20260709 13:19:10.373782 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:10.381954 17142 leader_election.cc:343] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.404626 17717 raft_consensus.cc:493] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.405295 17682 raft_consensus.cc:493] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.405921 17717 raft_consensus.cc:515] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.407061 17682 raft_consensus.cc:515] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.410265 17717 leader_election.cc:290] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:10.410802 17682 leader_election.cc:290] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:10.411880 17682 raft_consensus.cc:493] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.412906 17682 raft_consensus.cc:515] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:10.416463 17682 leader_election.cc:290] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:10.451414 17172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:10.452567 17172 raft_consensus.cc:2468] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:10.466889 17298 tablet_bootstrap.cc:700] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent opening tablet: real 0.245s	user 0.007s	sys 0.001s
I20260709 13:19:10.468276 17298 tablet_bootstrap.cc:654] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.468698 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:10.482658 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:10.483686 17100 raft_consensus.cc:2468] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:10.494829 17624 raft_consensus.cc:493] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.495916 17624 raft_consensus.cc:515] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.487421 17248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:10.503736 17101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:10.504765 17101 raft_consensus.cc:2468] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 0.
I20260709 13:19:10.507289 17624 leader_election.cc:290] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:10.514174 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
W20260709 13:19:10.519100 17142 leader_election.cc:343] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.505950 17682 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.511790 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:10.542755 17100 raft_consensus.cc:3060] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.560245 17298 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:10.563656 17298 ts_tablet_manager.cc:1403] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.348s	user 0.021s	sys 0.003s
I20260709 13:19:10.570140 17298 raft_consensus.cc:359] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:10.570761 17023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:10.571163 17298 raft_consensus.cc:385] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.571667 17298 raft_consensus.cc:740] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.576880 17068 leader_election.cc:304] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:10.578800 17620 raft_consensus.cc:2804] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.579306 17620 raft_consensus.cc:493] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.579711 17620 raft_consensus.cc:3060] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.582896 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:10.584095 17245 raft_consensus.cc:2393] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 896fb6e3b27e4874a469245a7b103111 in this term.
I20260709 13:19:10.572896 17298 consensus_queue.cc:260] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:10.593025 17619 raft_consensus.cc:493] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.593587 17619 raft_consensus.cc:515] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:10.594976 17666 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.595845 17666 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.600951 17666 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:10.604236 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:10.577787 17682 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.606096 17098 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:10.607695 17682 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:10.619240 17171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:10.620042 17171 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:10.616616 17619 leader_election.cc:290] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:10.621121 17142 leader_election.cc:304] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:10.625492 16993 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:10.623449 17625 raft_consensus.cc:2804] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.627453 17625 raft_consensus.cc:493] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.627882 17625 raft_consensus.cc:3060] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.628762 17298 ts_tablet_manager.cc:1434] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.005s
I20260709 13:19:10.634689 17022 raft_consensus.cc:3060] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.634902 17693 raft_consensus.cc:2804] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.635418 17693 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.635785 17693 raft_consensus.cc:3060] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.634749 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:10.639844 17297 raft_consensus.cc:359] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:10.640488 17297 raft_consensus.cc:385] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.640724 17297 raft_consensus.cc:740] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.641364 17297 consensus_queue.cc:260] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:10.212586 17301 raft_consensus.cc:359] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.643558 17301 raft_consensus.cc:385] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.643831 17301 raft_consensus.cc:740] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.644553 17301 consensus_queue.cc:260] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.649876 17301 ts_tablet_manager.cc:1434] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.443s	user 0.011s	sys 0.003s
I20260709 13:19:10.651842 17301 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:10.660580 17066 leader_election.cc:304] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:10.660688 17511 consensus_queue.cc:1048] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.663862 17297 ts_tablet_manager.cc:1434] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.427s	user 0.008s	sys 0.003s
I20260709 13:19:10.669207 17297 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8: Bootstrap starting.
I20260709 13:19:10.669310 17301 tablet_bootstrap.cc:654] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:10.679108 17068 leader_election.cc:343] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.681183 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:10.680858 17100 raft_consensus.cc:2468] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:10.689603 17685 raft_consensus.cc:2749] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.691015 17625 raft_consensus.cc:515] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.693543 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b01575d8b45646519b3c341e62c407f9" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:10.694327 17298 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:10.694741 17177 raft_consensus.cc:2393] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:10.697973 16993 leader_election.cc:304] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:10.699972 17507 raft_consensus.cc:2749] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.711498 17177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:10.712316 17177 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 0.
I20260709 13:19:10.714609 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:10.718067 17022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0eff3471854a72a1357beeb5723b41" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:10.729810 17298 tablet_bootstrap.cc:654] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.731916 17098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0eff3471854a72a1357beeb5723b41" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:10.732774 17098 raft_consensus.cc:2468] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
W20260709 13:19:10.737329 17142 leader_election.cc:343] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.693604 17625 leader_election.cc:290] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:10.741439 17140 leader_election.cc:343] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.742028 17140 leader_election.cc:304] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:10.743005 17101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:10.746488 17324 raft_consensus.cc:2749] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.751658 17297 tablet_bootstrap.cc:654] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.758574 17693 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.760581 17028 raft_consensus.cc:2393] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:10.765878 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:10.766501 17103 raft_consensus.cc:3060] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.733815 17620 raft_consensus.cc:515] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.773622 17101 raft_consensus.cc:2393] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 1: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:10.775457 17171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:10.776182 17171 raft_consensus.cc:3060] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.778218 17620 leader_election.cc:290] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:10.778944 17693 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:10.781085 17103 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:10.786693 16993 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:10.790774 17693 raft_consensus.cc:2804] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.801239 17693 raft_consensus.cc:697] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:10.802372 17693 consensus_queue.cc:237] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.788473 17619 consensus_queue.cc:1048] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:19:10.814957 17301 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:10.820604 17301 ts_tablet_manager.cc:1403] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.169s	user 0.009s	sys 0.031s
I20260709 13:19:10.830003 16922 catalog_manager.cc:5697] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.827975 17068 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:10.818300 17171 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:10.835425 17718 raft_consensus.cc:2764] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:19:10.843855 17685 consensus_queue.cc:1048] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.853809 17678 consensus_queue.cc:1048] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.855516 17301 raft_consensus.cc:359] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.856901 17301 raft_consensus.cc:385] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.848158 17708 consensus_queue.cc:1048] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.850096 17142 leader_election.cc:304] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:10.858850 17324 raft_consensus.cc:2749] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.836417 17620 consensus_queue.cc:1048] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:19:10.850673 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:10.851020 17297 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8: No bootstrap required, opened a new log
I20260709 13:19:10.866689 17297 ts_tablet_manager.cc:1403] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8: Time spent bootstrapping tablet: real 0.202s	user 0.026s	sys 0.031s
I20260709 13:19:10.857443 17301 raft_consensus.cc:740] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.880187 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:10.877244 17301 consensus_queue.cc:260] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:10.881181 17174 raft_consensus.cc:2393] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 1: Already voted for candidate 896fb6e3b27e4874a469245a7b103111 in this term.
I20260709 13:19:10.885149 17028 raft_consensus.cc:3060] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.898662 16926 catalog_manager.cc:5697] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.908797 17216 leader_election.cc:304] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:10.909901 17449 raft_consensus.cc:2804] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.919201 17449 raft_consensus.cc:493] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.919605 17449 raft_consensus.cc:3060] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.915354 17619 consensus_queue.cc:1048] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:10.931854 17514 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.944998 17514 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:10.947407 17514 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:10.949498 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:10.949808 17174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:10.950894 17174 raft_consensus.cc:2468] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:10.952327 16993 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:10.953886 17507 raft_consensus.cc:2804] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.954352 17507 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.954739 17507 raft_consensus.cc:3060] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.960615 17301 ts_tablet_manager.cc:1434] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.003s
I20260709 13:19:10.962594 17301 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:10.964821 17619 consensus_queue.cc:1048] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.966888 17619 consensus_queue.cc:1048] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:10.968904 17216 leader_election.cc:343] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.976886 17298 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:10.977638 17298 ts_tablet_manager.cc:1403] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.300s	user 0.020s	sys 0.018s
I20260709 13:19:10.975015 17297 raft_consensus.cc:359] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:10.985203 17297 raft_consensus.cc:385] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.985631 17297 raft_consensus.cc:740] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.003244 17028 raft_consensus.cc:2468] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:11.006745 17297 consensus_queue.cc:260] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.009542 17297 ts_tablet_manager.cc:1434] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8: Time spent starting tablet: real 0.143s	user 0.003s	sys 0.006s
I20260709 13:19:11.011904 17708 consensus_queue.cc:1048] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:11.038203 17298 raft_consensus.cc:359] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:11.041894 17298 raft_consensus.cc:385] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.042447 17298 raft_consensus.cc:740] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.046976 17298 consensus_queue.cc:260] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:11.150840 17507 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
W20260709 13:19:11.057389 16991 leader_election.cc:343] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:11.159858 17731 log.cc:927] Time spent T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248: Append to log took a long time: real 0.104s	user 0.000s	sys 0.005s
I20260709 13:19:11.170940 17682 raft_consensus.cc:493] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.207882 17298 ts_tablet_manager.cc:1434] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.230s	user 0.023s	sys 0.037s
I20260709 13:19:11.193259 17685 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f75c7dc3c3f24e2e800d40d91f7311f4)
W20260709 13:19:11.199635 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 150850us
W20260709 13:19:11.173170 16991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 200680us
I20260709 13:19:11.201712 17682 raft_consensus.cc:515] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.230268 17068 leader_election.cc:304] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:11.234535 17301 tablet_bootstrap.cc:654] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.207594 17449 raft_consensus.cc:515] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.252722 17718 raft_consensus.cc:2804] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:11.265717 17723 log.cc:927] Time spent T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Append to log took a long time: real 0.190s	user 0.000s	sys 0.003s
I20260709 13:19:11.276196 17298 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:11.224327 17685 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:11.275619 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 54423.2us
W20260709 13:19:11.279620 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 44131.4us
I20260709 13:19:11.278374 17718 raft_consensus.cc:697] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:11.290683 17718 consensus_queue.cc:237] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:11.292763 17682 leader_election.cc:290] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:11.289837 17449 leader_election.cc:290] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:11.301242 17124 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7780 after lost signal to thread 9150
I20260709 13:19:11.297420 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:11.345894 17737 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.346558 17737 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:11.348945 17737 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
W20260709 13:19:11.349386 17732 log.cc:927] Time spent T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:19:11.349987 17298 tablet_bootstrap.cc:654] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.351586 17507 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
W20260709 13:19:11.344708 17124 debug-util.cc:398] Leaking SignalData structure 0x7b08001312c0 after lost signal to thread 16960
W20260709 13:19:11.361743 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 82246.3us
W20260709 13:19:11.390391 17736 log.cc:927] Time spent T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:19:11.393694 17068 leader_election.cc:343] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.398608 17025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:11.399672 17025 raft_consensus.cc:2393] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f75c7dc3c3f24e2e800d40d91f7311f4 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:11.400358 17024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0eff3471854a72a1357beeb5723b41" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:11.404372 17685 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:11.413267 17741 consensus_queue.cc:1048] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:11.414583 17124 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9180 after lost signal to thread 17052
W20260709 13:19:11.416252 17124 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9960 after lost signal to thread 17127
I20260709 13:19:11.416091 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0eff3471854a72a1357beeb5723b41" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:11.416782 17102 raft_consensus.cc:3060] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:11.417578 17124 debug-util.cc:398] Leaking SignalData structure 0x7b0800129760 after lost signal to thread 17201
I20260709 13:19:11.421525 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
W20260709 13:19:11.425770 17124 debug-util.cc:398] Leaking SignalData structure 0x7b08000cdec0 after lost signal to thread 17275
I20260709 13:19:11.425988 17245 raft_consensus.cc:3060] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.414630 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:11.439189 17025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:11.440198 17025 raft_consensus.cc:2393] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 2: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
W20260709 13:19:11.441699 17066 leader_election.cc:343] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.442266 17066 leader_election.cc:304] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:11.445534 17243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:11.446493 17243 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:11.447476 17620 raft_consensus.cc:2749] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.479955 17102 raft_consensus.cc:2468] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
W20260709 13:19:11.484243 17216 leader_election.cc:343] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:11.485966 17066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 44317.8us
I20260709 13:19:11.499343 17301 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:11.500025 17301 ts_tablet_manager.cc:1403] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.538s	user 0.016s	sys 0.041s
I20260709 13:19:11.505079 17666 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.506685 17514 consensus_queue.cc:1048] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.470667 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:11.509557 17173 raft_consensus.cc:3060] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.510924 17301 raft_consensus.cc:359] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.512285 17301 raft_consensus.cc:385] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.505690 17666 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.522980 17301 raft_consensus.cc:740] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.542869 17301 consensus_queue.cc:260] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.542690 17216 leader_election.cc:304] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:11.549930 17666 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:11.550832 17687 raft_consensus.cc:2804] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.551489 17687 raft_consensus.cc:697] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:11.552397 17687 consensus_queue.cc:237] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.553193 17245 raft_consensus.cc:2468] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:11.556172 17173 raft_consensus.cc:2468] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:11.557720 17301 ts_tablet_manager.cc:1434] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:19:11.561381 16991 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:11.566517 17585 raft_consensus.cc:2804] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.567073 17585 raft_consensus.cc:697] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:11.567530 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:11.568526 17097 raft_consensus.cc:2410] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:19:11.567948 17585 consensus_queue.cc:237] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:11.570833 17742 raft_consensus.cc:493] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.571427 17742 raft_consensus.cc:515] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.572994 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:11.574103 17247 raft_consensus.cc:2410] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:19:11.576800 16993 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:11.577931 17742 leader_election.cc:290] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:11.582909 17693 raft_consensus.cc:2749] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.584075 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0eff3471854a72a1357beeb5723b41" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:11.602339 17100 raft_consensus.cc:2393] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16794c032a6645e2b267583ad59c9572 in current term 1: Already voted for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in this term.
I20260709 13:19:11.584968 17169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:11.585273 17298 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:11.590667 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0eff3471854a72a1357beeb5723b41" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:11.597615 16924 catalog_manager.cc:5697] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.592958 17066 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:11.604126 17298 ts_tablet_manager.cc:1403] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.338s	user 0.020s	sys 0.007s
I20260709 13:19:11.649709 17298 raft_consensus.cc:359] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.650995 17298 raft_consensus.cc:385] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.651573 17298 raft_consensus.cc:740] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.603623 17301 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:11.608449 17678 raft_consensus.cc:2804] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:11.637686 16923 catalog_manager.cc:5697] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.654896 16923 catalog_manager.cc:5697] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.653301 17678 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f75c7dc3c3f24e2e800d40d91f7311f4)
I20260709 13:19:11.620702 16993 leader_election.cc:304] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:11.604072 17169 raft_consensus.cc:2393] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f75c7dc3c3f24e2e800d40d91f7311f4 in current term 1: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:11.659163 17678 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:11.665807 16993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 45191.8us
I20260709 13:19:11.669807 17507 raft_consensus.cc:3060] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.683941 17298 consensus_queue.cc:260] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.687076 17507 raft_consensus.cc:2749] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.707110 17298 ts_tablet_manager.cc:1434] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:19:11.708663 17298 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4: Bootstrap starting.
I20260709 13:19:11.678202 17678 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.710888 17678 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:11.717272 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:11.718327 17028 raft_consensus.cc:2393] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 2: Already voted for candidate 16794c032a6645e2b267583ad59c9572 in this term.
I20260709 13:19:11.719147 17216 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:11.720149 17740 raft_consensus.cc:2749] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.720468 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:11.732805 17301 tablet_bootstrap.cc:654] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.741194 17245 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:11.742551 17066 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:11.742823 16924 catalog_manager.cc:5697] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } }
I20260709 13:19:11.743850 17678 raft_consensus.cc:2804] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:11.751725 17678 raft_consensus.cc:697] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:11.752584 17678 consensus_queue.cc:237] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:11.745184 16973 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:11.769663 17620 consensus_queue.cc:1048] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.785323 17298 tablet_bootstrap.cc:654] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.785897 16926 catalog_manager.cc:5697] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.846953 17682 consensus_queue.cc:1048] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.866101 16923 catalog_manager.cc:5697] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.887960 16926 catalog_manager.cc:5697] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.902436 17301 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:11.902999 17301 ts_tablet_manager.cc:1403] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.304s	user 0.036s	sys 0.020s
I20260709 13:19:11.905397 17301 raft_consensus.cc:359] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.905965 17301 raft_consensus.cc:385] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.906206 17301 raft_consensus.cc:740] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.922865 17301 consensus_queue.cc:260] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:11.928532 17298 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4: No bootstrap required, opened a new log
I20260709 13:19:11.929265 17298 ts_tablet_manager.cc:1403] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent bootstrapping tablet: real 0.221s	user 0.009s	sys 0.005s
I20260709 13:19:11.932927 17298 raft_consensus.cc:359] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:11.933620 17298 raft_consensus.cc:385] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.933892 17298 raft_consensus.cc:740] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.935420 17301 ts_tablet_manager.cc:1434] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:19:11.940737 17301 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:11.946633 17298 consensus_queue.cc:260] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:11.948328 17298 ts_tablet_manager.cc:1434] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:19:11.941121 16922 catalog_manager.cc:5697] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.951048 17301 tablet_bootstrap.cc:654] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.955402 17507 consensus_queue.cc:1048] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.004428 17746 consensus_queue.cc:1048] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.016865 17301 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: No bootstrap required, opened a new log
I20260709 13:19:12.021163 17301 ts_tablet_manager.cc:1403] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.010s
I20260709 13:19:12.025736 17301 raft_consensus.cc:359] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:12.026526 17301 raft_consensus.cc:385] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.026841 17301 raft_consensus.cc:740] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.027554 17301 consensus_queue.cc:260] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:12.029168 17301 ts_tablet_manager.cc:1434] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.002s
I20260709 13:19:12.083819 17703 consensus_queue.cc:1048] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.111343 17740 consensus_queue.cc:1048] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.156158 17703 raft_consensus.cc:493] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.156777 17703 raft_consensus.cc:515] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:12.158772 17028 raft_consensus.cc:1275] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:12.159296 17703 leader_election.cc:290] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:12.161002 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:12.161118 17682 consensus_queue.cc:1048] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:12.161761 17097 raft_consensus.cc:2468] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:12.163245 17216 leader_election.cc:304] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:12.164184 17703 raft_consensus.cc:2804] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.164834 17703 raft_consensus.cc:493] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.165211 17703 raft_consensus.cc:3060] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.168351 17028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572" is_pre_election: true
I20260709 13:19:12.169603 17028 raft_consensus.cc:2468] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 0.
I20260709 13:19:12.177944 17247 raft_consensus.cc:1275] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:12.180264 17678 consensus_queue.cc:1048] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:12.175009 17703 raft_consensus.cc:515] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:12.219285 17703 leader_election.cc:290] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:12.218210 17026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16794c032a6645e2b267583ad59c9572"
I20260709 13:19:12.220356 17026 raft_consensus.cc:3060] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.226436 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:12.227154 17097 raft_consensus.cc:3060] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.235212 17097 raft_consensus.cc:2468] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:12.249593 17026 raft_consensus.cc:2468] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:12.251502 17216 leader_election.cc:304] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:12.253400 17703 raft_consensus.cc:2804] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.253983 17703 raft_consensus.cc:697] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:12.255249 17703 consensus_queue.cc:237] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:12.273037 16926 catalog_manager.cc:5697] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 1 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.328258 17507 raft_consensus.cc:493] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.328874 17507 raft_consensus.cc:515] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:12.332240 17507 leader_election.cc:290] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:12.332496 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:12.333065 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:12.333250 17170 raft_consensus.cc:2468] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:12.333773 17247 raft_consensus.cc:2468] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 0.
I20260709 13:19:12.334568 16993 leader_election.cc:304] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:12.335415 17507 raft_consensus.cc:2804] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.335860 17507 raft_consensus.cc:493] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.336184 17507 raft_consensus.cc:3060] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.345317 17507 raft_consensus.cc:515] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:12.347446 17507 leader_election.cc:290] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:12.348194 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:12.348608 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:12.348908 17170 raft_consensus.cc:3060] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.349268 17247 raft_consensus.cc:3060] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.363101 17247 raft_consensus.cc:2468] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:12.364283 16991 leader_election.cc:304] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:12.365005 17507 raft_consensus.cc:2804] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.365643 17507 raft_consensus.cc:697] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:12.366427 17170 raft_consensus.cc:2468] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 1.
I20260709 13:19:12.366641 17507 consensus_queue.cc:237] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:12.384630 16926 catalog_manager.cc:5697] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.727137 17739 consensus_queue.cc:1048] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.751370 17703 consensus_queue.cc:1048] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.842103 17507 consensus_queue.cc:1048] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.858780 17346 consensus_queue.cc:1048] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.701918  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
I20260709 13:19:13.761238  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:13.762363  9147 tablet_replica.cc:333] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.763195  9147 raft_consensus.cc:2243] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.764302  9147 raft_consensus.cc:2272] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.767886  9147 tablet_replica.cc:333] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.773461  9147 raft_consensus.cc:2243] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.774276  9147 raft_consensus.cc:2272] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.777182  9147 tablet_replica.cc:333] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.778170  9147 raft_consensus.cc:2243] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.778920  9147 raft_consensus.cc:2272] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.786809  9147 tablet_replica.cc:333] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.787719  9147 raft_consensus.cc:2243] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.788866  9147 raft_consensus.cc:2272] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.791689  9147 tablet_replica.cc:333] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.792562  9147 raft_consensus.cc:2243] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.793524  9147 raft_consensus.cc:2272] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.796075  9147 tablet_replica.cc:333] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
W20260709 13:19:13.796617 17142 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:13.796988  9147 raft_consensus.cc:2243] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.797775  9147 raft_consensus.cc:2272] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.802136  9147 tablet_replica.cc:333] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.803364  9147 raft_consensus.cc:2243] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.804242  9147 raft_consensus.cc:2272] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.808375  9147 tablet_replica.cc:333] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.825083  9147 raft_consensus.cc:2243] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.845562  9147 raft_consensus.cc:2272] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.864611 17216 consensus_peers.cc:597] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.888847  9147 tablet_replica.cc:333] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.893005  9147 raft_consensus.cc:2243] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.894115  9147 raft_consensus.cc:2272] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.895684 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 99107.7us
W20260709 13:19:13.907198 17068 consensus_peers.cc:597] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.906615 17216 consensus_peers.cc:597] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.908878 17216 consensus_peers.cc:597] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.909687 17216 consensus_peers.cc:597] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.916013  9147 tablet_replica.cc:333] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.917748  9147 raft_consensus.cc:2243] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:13.918919 17142 consensus_peers.cc:597] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.926501  9147 raft_consensus.cc:2272] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.932113 17068 consensus_peers.cc:597] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.934703 17068 consensus_peers.cc:597] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.941020  9147 tablet_replica.cc:333] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
W20260709 13:19:13.944016 17142 consensus_peers.cc:597] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.945030 17142 consensus_peers.cc:597] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.945781 17142 consensus_peers.cc:597] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.945163  9147 raft_consensus.cc:2243] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:13.946264 17068 consensus_peers.cc:597] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.946764  9147 raft_consensus.cc:2272] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.948014 17142 consensus_peers.cc:597] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.950865  9147 tablet_replica.cc:333] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.951915  9147 raft_consensus.cc:2243] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:13.952211 17068 consensus_peers.cc:597] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.952915 17068 consensus_peers.cc:597] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.953034  9147 raft_consensus.cc:2272] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.955824  9147 tablet_replica.cc:333] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.956568  9147 raft_consensus.cc:2243] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.957531  9147 raft_consensus.cc:2272] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.959885  9147 tablet_replica.cc:333] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.960544  9147 raft_consensus.cc:2243] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.961529  9147 raft_consensus.cc:2272] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.967314  9147 tablet_replica.cc:333] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.968228  9147 raft_consensus.cc:2243] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.969429  9147 raft_consensus.cc:2272] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.973107  9147 tablet_replica.cc:333] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.974103  9147 raft_consensus.cc:2243] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.975284  9147 raft_consensus.cc:2272] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.979079  9147 tablet_replica.cc:333] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.980077  9147 raft_consensus.cc:2243] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:13.980907 17068 consensus_peers.cc:597] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.981386  9147 raft_consensus.cc:2272] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.984557 17142 consensus_peers.cc:597] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.985077  9147 tablet_replica.cc:333] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.986130  9147 raft_consensus.cc:2243] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.987268  9147 raft_consensus.cc:2272] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.990038  9147 tablet_replica.cc:333] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.991062  9147 raft_consensus.cc:2243] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.992256  9147 raft_consensus.cc:2272] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.995453  9147 tablet_replica.cc:333] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:13.996294  9147 raft_consensus.cc:2243] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.996882  9147 raft_consensus.cc:2272] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.999619  9147 tablet_replica.cc:333] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.000461  9147 raft_consensus.cc:2243] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.001518  9147 raft_consensus.cc:2272] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.003769  9147 tablet_replica.cc:333] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.004459  9147 raft_consensus.cc:2243] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.004979  9147 raft_consensus.cc:2272] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.007786  9147 tablet_replica.cc:333] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.008656  9147 raft_consensus.cc:2243] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.009260  9147 raft_consensus.cc:2272] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.011723 17216 consensus_peers.cc:597] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.011804  9147 tablet_replica.cc:333] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.013659  9147 raft_consensus.cc:2243] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.014153  9147 raft_consensus.cc:2272] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.016248  9147 tablet_replica.cc:333] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
W20260709 13:19:14.017359 17068 consensus_peers.cc:597] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.017390  9147 raft_consensus.cc:2243] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.018952  9147 raft_consensus.cc:2272] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.022193  9147 tablet_replica.cc:333] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.023023  9147 raft_consensus.cc:2243] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.024093  9147 raft_consensus.cc:2272] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.026714 17216 consensus_peers.cc:597] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.027320  9147 tablet_replica.cc:333] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.028784  9147 raft_consensus.cc:2243] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.029383  9147 raft_consensus.cc:2272] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.031785  9147 tablet_replica.cc:333] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.032450  9147 raft_consensus.cc:2243] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.033339  9147 raft_consensus.cc:2272] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.035918  9147 tablet_replica.cc:333] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.036520  9147 raft_consensus.cc:2243] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.037026  9147 raft_consensus.cc:2272] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.039217  9147 tablet_replica.cc:333] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.039798  9147 raft_consensus.cc:2243] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.040261  9147 raft_consensus.cc:2272] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.042400  9147 tablet_replica.cc:333] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.043146  9147 raft_consensus.cc:2243] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.044230  9147 raft_consensus.cc:2272] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.047214  9147 tablet_replica.cc:333] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.047889  9147 raft_consensus.cc:2243] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.048377  9147 raft_consensus.cc:2272] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.050609  9147 tablet_replica.cc:333] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.051347  9147 raft_consensus.cc:2243] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.052347  9147 raft_consensus.cc:2272] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.054937  9147 tablet_replica.cc:333] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.055483  9147 raft_consensus.cc:2243] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.056304  9147 raft_consensus.cc:2272] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.058452  9147 tablet_replica.cc:333] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.059187  9147 raft_consensus.cc:2243] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.059654  9147 raft_consensus.cc:2272] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.061800  9147 tablet_replica.cc:333] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.062397  9147 raft_consensus.cc:2243] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.062867  9147 raft_consensus.cc:2272] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.065562  9147 tablet_replica.cc:333] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.066229  9147 raft_consensus.cc:2243] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.066802  9147 raft_consensus.cc:2272] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.068400 17216 consensus_peers.cc:597] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.069190  9147 tablet_replica.cc:333] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.069828  9147 raft_consensus.cc:2243] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.070334  9147 raft_consensus.cc:2272] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.072305  9147 tablet_replica.cc:333] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.072906  9147 raft_consensus.cc:2243] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.073757  9147 raft_consensus.cc:2272] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.075906  9147 tablet_replica.cc:333] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.076483  9147 raft_consensus.cc:2243] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.076988  9147 raft_consensus.cc:2272] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.079232  9147 tablet_replica.cc:333] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.079762  9147 raft_consensus.cc:2243] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.080214  9147 raft_consensus.cc:2272] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.082460  9147 tablet_replica.cc:333] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.083040  9147 raft_consensus.cc:2243] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.083923  9147 raft_consensus.cc:2272] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.086117  9147 tablet_replica.cc:333] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.086809  9147 raft_consensus.cc:2243] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.087616  9147 raft_consensus.cc:2272] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.090694  9147 tablet_replica.cc:333] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.091427  9147 raft_consensus.cc:2243] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.092049  9147 raft_consensus.cc:2272] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.092058 17216 consensus_peers.cc:597] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.094411  9147 tablet_replica.cc:333] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: stopping tablet replica
I20260709 13:19:14.095028  9147 raft_consensus.cc:2243] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.095520  9147 raft_consensus.cc:2272] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.163270 17142 consensus_peers.cc:597] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.164479 17142 connection.cc:573] client connection to 127.8.238.193:46481 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:19:14.172771 17142 consensus_peers.cc:597] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.176986 17068 consensus_peers.cc:597] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.191601  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
W20260709 13:19:14.193733 17216 consensus_peers.cc:597] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.276516 17142 consensus_peers.cc:597] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.311342  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:14.335544 17807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:14.341776 17808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:14.462321  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:14.466410 17810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:14.469424  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:14.469806  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:14.470391  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603154470365 us; error 0 us; skew 500 ppm
I20260709 13:19:14.473237  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:14.519227  9147 webserver.cc:533] Webserver started at http://127.8.238.193:34707/ using document root <none> and password file <none>
I20260709 13:19:14.520149  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:14.520526  9147 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:14.532325  9147 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:19:14.544490 17816 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:14.545482  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:19:14.545920  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "16794c032a6645e2b267583ad59c9572"
format_stamp: "Formatted at 2026-07-09 13:19:00 on dist-test-slave-ml7r"
I20260709 13:19:14.546473  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:14.567293  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:14.569201  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:14.571372  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:14.578766 17823 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:19:14.802724 17802 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:14.803288 17802 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:14.805598 17802 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:14.810168 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
W20260709 13:19:14.816349 17142 leader_election.cc:336] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:14.816905 17142 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:14.818120 17802 raft_consensus.cc:2749] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:14.898066 17678 raft_consensus.cc:493] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:14.898641 17678 raft_consensus.cc:515] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:14.900547 17678 leader_election.cc:290] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:14.904853 17678 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:14.905506 17678 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:14.906606 17068 leader_election.cc:336] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:14.908381 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:14.907785 17678 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:14.911871 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:14.915802 17068 leader_election.cc:304] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:14.916663 17678 raft_consensus.cc:2749] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:14.921216 17068 leader_election.cc:336] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:14.921737 17068 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:14.922497 17678 raft_consensus.cc:2749] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:14.930557 17678 raft_consensus.cc:493] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:14.931110 17678 raft_consensus.cc:515] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:14.933523 17678 leader_election.cc:290] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:14.934219 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
W20260709 13:19:14.943977 17068 leader_election.cc:336] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:14.944554 17068 leader_election.cc:304] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:14.945379 17801 raft_consensus.cc:2749] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:14.969967  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:19:14.970441  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.393s	user 0.012s	sys 0.000s
I20260709 13:19:14.970844  9147 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:19:14.996482 17823 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:15.029004 17825 raft_consensus.cc:493] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.031618 17825 raft_consensus.cc:515] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.034435 17825 leader_election.cc:290] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.044365 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.047569 17802 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.048188 17802 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.050562 17813 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.051417 17813 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.054690 17813 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.056810 17813 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.057510 17802 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
W20260709 13:19:15.056942 17142 leader_election.cc:336] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.057729 17813 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.060173 17813 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.064365 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.065065 17173 raft_consensus.cc:2468] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:15.066366 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:15.066620 17802 raft_consensus.cc:493] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.067274 17802 raft_consensus.cc:515] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.069756 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
W20260709 13:19:15.079192 17142 leader_election.cc:336] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:15.080268 17216 leader_election.cc:336] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.080832 17216 leader_election.cc:304] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:15.081048 17823 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:15.081564 17825 raft_consensus.cc:2749] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.082253 17823 tablet_bootstrap.cc:492] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:15.083160 17823 ts_tablet_manager.cc:1403] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.012s
I20260709 13:19:15.083220 17140 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:15.084445 17803 raft_consensus.cc:2749] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.084520 17216 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.085328 17825 raft_consensus.cc:2804] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.085711 17825 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.086050 17825 raft_consensus.cc:3060] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.086367 17823 raft_consensus.cc:359] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.087278 17823 raft_consensus.cc:740] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.090159 17823 consensus_queue.cc:260] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.090852 17803 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.091619 17803 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.093822 17803 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.095465 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.095629 17825 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.087834 17802 leader_election.cc:290] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.097981 17825 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.099931 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.100227 17142 leader_election.cc:304] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
W20260709 13:19:15.102031 17216 leader_election.cc:336] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.104279 17823 ts_tablet_manager.cc:1434] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 13:19:15.109913 17823 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:15.108814 17216 leader_election.cc:336] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.112279 17216 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.111732 17802 raft_consensus.cc:2749] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.117650 17813 raft_consensus.cc:2749] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.125761 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:15.126569 17173 raft_consensus.cc:3060] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.134681 17802 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.135406 17802 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.137189 17173 raft_consensus.cc:2468] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 2.
I20260709 13:19:15.137787 17802 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.141996 17823 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:15.142583 17142 leader_election.cc:336] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.145114 17142 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.143675 17823 tablet_bootstrap.cc:492] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:15.147799 17823 ts_tablet_manager.cc:1403] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.007s
I20260709 13:19:15.148526 17803 raft_consensus.cc:2749] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.149742 17678 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.150309 17678 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.151435 17216 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.152387 17678 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.155040 17823 raft_consensus.cc:359] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.156836 17823 raft_consensus.cc:740] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
W20260709 13:19:15.159895 17068 leader_election.cc:336] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.161278 17803 raft_consensus.cc:493] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.161947 17803 raft_consensus.cc:515] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.157958 17823 consensus_queue.cc:260] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.164624 17823 ts_tablet_manager.cc:1434] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:19:15.165089 17803 leader_election.cc:290] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.165514 17823 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:15.166855 17813 raft_consensus.cc:2804] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.166960 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.167726 17097 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.167605 17813 raft_consensus.cc:697] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:15.169509 17813 consensus_queue.cc:237] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
W20260709 13:19:15.186904 17216 leader_election.cc:336] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.187085 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:15.191697 17678 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.193331 17678 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.190934 17142 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:15.195595 17678 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.196234 17802 raft_consensus.cc:2804] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.196666 17802 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.197180 17802 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.198113 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:15.198894 17247 raft_consensus.cc:2468] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:15.200789 17066 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.202562 17801 raft_consensus.cc:2804] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.202957 17801 raft_consensus.cc:493] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.203270 17801 raft_consensus.cc:3060] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.196645 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.204680 17173 raft_consensus.cc:2468] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:15.205353 17825 raft_consensus.cc:493] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.205931 17825 raft_consensus.cc:515] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.208285 17825 leader_election.cc:290] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.213019 17802 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.221769 17801 raft_consensus.cc:515] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:15.227705 17142 leader_election.cc:336] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.229616 17802 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:15.226285 17068 leader_election.cc:336] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.232654 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.233403 17097 raft_consensus.cc:2468] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:15.236470 17247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31daec548cf48f6bedf21556ead46f6" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:15.237048 17247 raft_consensus.cc:3060] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.245420 17247 raft_consensus.cc:2468] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:15.247823 17823 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:15.246985 17066 leader_election.cc:304] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.252808 17678 raft_consensus.cc:2804] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.252177 16923 catalog_manager.cc:5697] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.253355 17678 raft_consensus.cc:697] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:15.254153 17678 consensus_queue.cc:237] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.257098 17813 raft_consensus.cc:493] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.257754 17813 raft_consensus.cc:515] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.259938 17813 leader_election.cc:290] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.259955 17216 leader_election.cc:304] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.261519 17813 raft_consensus.cc:2804] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:19:15.261811 17142 leader_election.cc:336] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.261921 17813 raft_consensus.cc:493] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.264343 17801 leader_election.cc:290] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.276206 17813 raft_consensus.cc:3060] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.277354 17801 raft_consensus.cc:493] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.278041 17801 raft_consensus.cc:515] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.280828 17801 leader_election.cc:290] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.276116 17142 leader_election.cc:304] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:15.277501 17803 raft_consensus.cc:493] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.267570 17802 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.294754 17803 raft_consensus.cc:515] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.294945 17802 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.297247 17803 leader_election.cc:290] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.250996 17068 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.299116 17803 raft_consensus.cc:2749] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.270748 17825 raft_consensus.cc:493] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.284190 17790 raft_consensus.cc:493] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.300164 17825 raft_consensus.cc:515] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.300369 17790 raft_consensus.cc:515] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.302481 17825 leader_election.cc:290] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.302848 17790 leader_election.cc:290] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.286455 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.287966 17813 raft_consensus.cc:515] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:15.304071 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 53175.1us
I20260709 13:19:15.305177 17813 leader_election.cc:290] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.288321 17835 raft_consensus.cc:493] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.305935 17835 raft_consensus.cc:515] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.307056 17097 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
W20260709 13:19:15.306262 17142 leader_election.cc:336] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:15.288031 17216 leader_election.cc:336] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.291924 17831 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.294018 17823 tablet_bootstrap.cc:492] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:15.310040 17831 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.297873 17802 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.310784 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.311487 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.311456 17100 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.312108 17097 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.316008 17068 leader_election.cc:336] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.314469 17823 ts_tablet_manager.cc:1403] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.011s
I20260709 13:19:15.313185 16922 catalog_manager.cc:5697] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.319445 17831 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.319998 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
W20260709 13:19:15.320365 17068 leader_election.cc:336] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.320676 17173 raft_consensus.cc:2468] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
W20260709 13:19:15.321234 17142 leader_election.cc:336] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.314059 17836 raft_consensus.cc:2804] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.326332 17836 raft_consensus.cc:493] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.326799 17836 raft_consensus.cc:3060] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.327836 17835 leader_election.cc:290] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
W20260709 13:19:15.325781 17142 leader_election.cc:336] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.328488 17243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:15.329264 17243 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:15.332199 17066 leader_election.cc:304] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.334409 17835 raft_consensus.cc:493] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.335052 17835 raft_consensus.cc:515] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.336134 17097 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.334658 17837 raft_consensus.cc:2804] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.337393 17837 raft_consensus.cc:493] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.337774 17837 raft_consensus.cc:3060] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.338601 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.339176 17142 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.341677 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.342389 17173 raft_consensus.cc:2468] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:15.340591 17823 raft_consensus.cc:359] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.343560 17708 raft_consensus.cc:2804] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.343711 17823 raft_consensus.cc:740] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.344020 17708 raft_consensus.cc:493] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.344357 17708 raft_consensus.cc:3060] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.344508 17823 consensus_queue.cc:260] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.341555 17835 leader_election.cc:290] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.349404 17803 raft_consensus.cc:493] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.349520 17142 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.350112 17803 raft_consensus.cc:515] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.350725 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.352514 17802 raft_consensus.cc:2804] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.354921 17802 raft_consensus.cc:697] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.355923 17802 consensus_queue.cc:237] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.357246 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4749463a5f494207809283ca94150c73" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.357858 17100 raft_consensus.cc:3060] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.358130 17823 ts_tablet_manager.cc:1434] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.003s
I20260709 13:19:15.359033 17823 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:15.360707 17243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:15.361349 17243 raft_consensus.cc:2468] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.362663 17813 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.363001 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:15.363216 17813 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.363658 17249 raft_consensus.cc:2468] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.354130 17803 leader_election.cc:290] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.365409 17813 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.364444 17837 raft_consensus.cc:515] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.369959 17803 raft_consensus.cc:493] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.370204 17837 leader_election.cc:290] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.370643 17803 raft_consensus.cc:515] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.373785 17835 raft_consensus.cc:493] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
W20260709 13:19:15.370386 17068 leader_election.cc:336] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.374449 17835 raft_consensus.cc:515] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:15.375195 17068 leader_election.cc:336] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.372748 17803 leader_election.cc:290] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.354629 17708 raft_consensus.cc:515] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.376792 17835 leader_election.cc:290] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.377641 17173 raft_consensus.cc:2393] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364e853d9ea4df1950346fb170498b8 in current term 2: Already voted for candidate 896fb6e3b27e4874a469245a7b103111 in this term.
I20260709 13:19:15.374097 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "727d16a19f284201998350af3f7ebcdc" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:15.378746 17708 leader_election.cc:290] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:15.379102 17216 leader_election.cc:336] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.379106 17250 raft_consensus.cc:3060] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.372730 17836 raft_consensus.cc:515] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.384799 17836 leader_election.cc:290] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.380652 17068 leader_election.cc:304] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.392652 17835 raft_consensus.cc:2804] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.393116 17835 raft_consensus.cc:493] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.393224 17831 raft_consensus.cc:493] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.393575 17835 raft_consensus.cc:3060] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.394164 17831 raft_consensus.cc:515] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.399189 17831 leader_election.cc:290] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
W20260709 13:19:15.399333 17068 leader_election.cc:336] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.402415 17100 raft_consensus.cc:2468] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 2.
W20260709 13:19:15.409839 17068 leader_election.cc:336] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.411819 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "468c1b5e86fc4f40995e64ce4cfe446a" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:15.412689 17175 raft_consensus.cc:3060] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.414292 17176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.403556 17216 leader_election.cc:304] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.416168 17216 leader_election.cc:304] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.416867 17813 raft_consensus.cc:2804] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.404491 17803 raft_consensus.cc:493] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.404781 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.406528 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.409322 17250 raft_consensus.cc:2468] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:15.418915 17790 raft_consensus.cc:2764] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:19:15.417865 17803 raft_consensus.cc:515] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.419871 17173 raft_consensus.cc:2468] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 1.
I20260709 13:19:15.422585 17066 leader_election.cc:304] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.422750 17803 leader_election.cc:290] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.423826 17836 raft_consensus.cc:2804] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.424415 17836 raft_consensus.cc:697] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:15.424242 17841 raft_consensus.cc:493] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.425671 17835 raft_consensus.cc:515] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.425874 17841 raft_consensus.cc:515] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:15.427096 17142 leader_election.cc:336] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.426270 17836 consensus_queue.cc:237] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.431751 17216 leader_election.cc:304] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.432497 17825 raft_consensus.cc:2804] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.432797 17140 leader_election.cc:304] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.428128 17841 leader_election.cc:290] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.433667 17841 raft_consensus.cc:2804] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.434028 17841 raft_consensus.cc:493] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.434383 17841 raft_consensus.cc:3060] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.424898 17068 leader_election.cc:336] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.428413 17813 raft_consensus.cc:697] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:15.438721 17813 consensus_queue.cc:237] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.440986 17802 raft_consensus.cc:493] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.441571 17802 raft_consensus.cc:515] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:15.442844 17142 leader_election.cc:336] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.427893 17835 leader_election.cc:290] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
W20260709 13:19:15.443665 17068 leader_election.cc:336] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.428556 17175 raft_consensus.cc:2468] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:15.444620 17140 leader_election.cc:304] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
W20260709 13:19:15.444978 17142 leader_election.cc:336] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.445870 17803 raft_consensus.cc:2804] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.446288 17803 raft_consensus.cc:493] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.446671 17803 raft_consensus.cc:3060] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.432909 17825 raft_consensus.cc:493] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.447537 17825 raft_consensus.cc:3060] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.448907 17142 leader_election.cc:336] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:15.449587 17142 leader_election.cc:336] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.451589 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.452339 17100 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 2.
I20260709 13:19:15.454860 17802 leader_election.cc:290] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.455080 17803 raft_consensus.cc:515] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.457675 17803 leader_election.cc:290] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
W20260709 13:19:15.459259 17216 leader_election.cc:336] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.459779 17216 leader_election.cc:304] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:15.460511 17790 raft_consensus.cc:2749] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:15.460930 17216 leader_election.cc:336] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:15.461686 17216 leader_election.cc:336] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.461789 17068 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:15.462674 17835 raft_consensus.cc:3060] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.464962 16926 catalog_manager.cc:5697] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.467002 17823 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:15.467280 17142 leader_election.cc:336] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.459923 17825 raft_consensus.cc:515] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.470228 17835 raft_consensus.cc:2749] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.475878 17823 tablet_bootstrap.cc:492] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:15.487042 17823 ts_tablet_manager.cc:1403] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.006s
I20260709 13:19:15.487950 17841 raft_consensus.cc:515] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.489849 17823 raft_consensus.cc:359] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.490618 17823 raft_consensus.cc:740] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.480432 17831 raft_consensus.cc:493] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.480453 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94f0c007bb449daa0dfd34bdf4222c" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:15.492447 17250 raft_consensus.cc:3060] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.485824 17068 leader_election.cc:304] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:15.494051 17068 leader_election.cc:304] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.492153 17831 raft_consensus.cc:515] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.496208 17831 leader_election.cc:290] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
W20260709 13:19:15.471352 17142 leader_election.cc:336] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.491521 17823 consensus_queue.cc:260] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.499233 17823 ts_tablet_manager.cc:1434] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:19:15.500051 17836 raft_consensus.cc:2749] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.500111 17823 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:15.500726 17831 raft_consensus.cc:2804] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.501139 17831 raft_consensus.cc:493] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.501538 17831 raft_consensus.cc:3060] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.502715 17250 raft_consensus.cc:2468] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.477198 17825 leader_election.cc:290] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.504611 17068 leader_election.cc:304] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.506701 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd80cd71cb14d5ba099ab44ff0a69ba" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:15.508553 17216 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
W20260709 13:19:15.509474 17142 leader_election.cc:336] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.509743 17175 raft_consensus.cc:3060] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.510603 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.511232 17100 raft_consensus.cc:2468] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.512064 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bb77fb0c0749f09d8c4bd783a3aa4b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.512423 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.491506 17841 leader_election.cc:290] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.516099 17831 raft_consensus.cc:515] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.517336 17097 raft_consensus.cc:2393] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 896fb6e3b27e4874a469245a7b103111 in current term 2: Already voted for candidate 1364e853d9ea4df1950346fb170498b8 in this term.
I20260709 13:19:15.518026 17175 raft_consensus.cc:2468] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 2.
I20260709 13:19:15.519136 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.519697 17831 leader_election.cc:290] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:15.519845 17099 raft_consensus.cc:2468] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.524331 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.524842 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06adc55b95e4338b38e9323041f9eb7" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:15.525031 17100 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.525686 17175 raft_consensus.cc:3060] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.509768 17835 raft_consensus.cc:2804] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.526113 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.527009 17835 raft_consensus.cc:697] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:15.528508 17835 consensus_queue.cc:237] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.529520 17825 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.533278 17825 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.536253 17825 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.544864 17825 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:15.545576 17825 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.546177 17825 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:15.546936 17142 leader_election.cc:304] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.548354 17841 raft_consensus.cc:2804] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.548754 17841 raft_consensus.cc:493] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.549072 17841 raft_consensus.cc:3060] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.532145 17102 raft_consensus.cc:2468] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.554275 17803 raft_consensus.cc:493] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.532245 17175 raft_consensus.cc:2468] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:15.554912 17803 raft_consensus.cc:515] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:15.554350 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 45884us
I20260709 13:19:15.557098 17803 leader_election.cc:290] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:15.558980 17216 leader_election.cc:336] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.557585 17841 raft_consensus.cc:515] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.561594 17142 leader_election.cc:304] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.565644 17841 leader_election.cc:290] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.566264 17841 raft_consensus.cc:3060] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.567711 17142 leader_election.cc:304] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.568085 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2155d9ece65f41eabe4ffb9dfd1671c3" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:15.569515 17140 leader_election.cc:304] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.570652 17708 raft_consensus.cc:2804] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.571007 17708 raft_consensus.cc:493] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.571331 17708 raft_consensus.cc:3060] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.572069 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:15.572769 17173 raft_consensus.cc:2468] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 1.
I20260709 13:19:15.575539 17803 raft_consensus.cc:2804] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.577018 17803 raft_consensus.cc:697] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.577641 17825 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:15.577912 17803 consensus_queue.cc:237] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.578843 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dbd048d2c24d53bb50081b63f1625b" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
W20260709 13:19:15.579753 17142 leader_election.cc:336] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.583431 17708 raft_consensus.cc:515] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.596472 17708 leader_election.cc:290] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:15.598886 17142 leader_election.cc:336] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.591176 17216 leader_election.cc:304] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.601148 17813 raft_consensus.cc:2804] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.601702 17813 raft_consensus.cc:697] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:15.602663 17813 consensus_queue.cc:237] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.603838 17250 raft_consensus.cc:3060] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.604357 17068 leader_election.cc:336] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.604887 17068 leader_election.cc:304] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
W20260709 13:19:15.605203 17142 leader_election.cc:336] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.609681 17825 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.610448 17835 raft_consensus.cc:2749] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.611670 17216 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.612282  9147 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:19:15.614408  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.644s	user 0.312s	sys 0.000s
I20260709 13:19:15.614651 17825 raft_consensus.cc:2804] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.615324 17825 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.618119 17825 raft_consensus.cc:3060] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.624125 17250 raft_consensus.cc:2468] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.627887 17142 leader_election.cc:304] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.628993 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d4b49dd94d4fa5bb066af8bd56d6e0" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.629324 17802 raft_consensus.cc:2804] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.629956 17099 raft_consensus.cc:3060] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.629980 17802 raft_consensus.cc:493] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.631187 17802 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.626850 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:15.634348 17102 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 1.
I20260709 13:19:15.639245 17142 leader_election.cc:304] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.640493 17708 raft_consensus.cc:2804] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.640987 17708 raft_consensus.cc:697] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.641805 17708 consensus_queue.cc:237] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.644830 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f214fc5aac4e8d82b544d227421217" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
W20260709 13:19:15.617466 17216 leader_election.cc:336] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.645617 17097 raft_consensus.cc:3060] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.655476 17097 raft_consensus.cc:2468] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.656693 17823 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:15.657877 17823 tablet_bootstrap.cc:492] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:15.663147 17173 raft_consensus.cc:1275] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.663651 16926 catalog_manager.cc:5697] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.665211 17823 ts_tablet_manager.cc:1403] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.165s	user 0.027s	sys 0.033s
I20260709 13:19:15.673532 17823 raft_consensus.cc:359] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.670148 17825 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.645092 17099 raft_consensus.cc:2468] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.675014 17250 raft_consensus.cc:1275] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.677896 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.678579 17140 leader_election.cc:304] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.683122 17103 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:15.688611 17836 consensus_queue.cc:1048] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:15.679754 17823 raft_consensus.cc:740] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.676550 16922 catalog_manager.cc:5697] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.690708 17823 consensus_queue.cc:260] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.692847 17823 ts_tablet_manager.cc:1434] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:19:15.696570 17103 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 3.
W20260709 13:19:15.679594 17216 leader_election.cc:336] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.698681 17803 raft_consensus.cc:2804] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.699357 17803 raft_consensus.cc:697] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.700347 17803 consensus_queue.cc:237] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.697470 17823 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:15.659446 17068 leader_election.cc:304] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 
W20260709 13:19:15.706857 17068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 47507.9us
I20260709 13:19:15.707865 17837 raft_consensus.cc:2804] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.708463 17837 raft_consensus.cc:697] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:15.709460 17837 consensus_queue.cc:237] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.624662 17841 raft_consensus.cc:2749] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.712136 17216 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:15.682123 17825 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:15.713517 17813 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:15.714294 17813 raft_consensus.cc:697] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:15.711359 17802 raft_consensus.cc:515] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.715184 17813 consensus_queue.cc:237] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
W20260709 13:19:15.725821 17142 leader_election.cc:336] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.734061 17790 consensus_queue.cc:1048] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:15.736336 17175 raft_consensus.cc:2468] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:15.745270 16922 catalog_manager.cc:5697] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.747072 16922 catalog_manager.cc:5697] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.747368 16926 catalog_manager.cc:5697] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.774662 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111"
W20260709 13:19:15.775482 17068 leader_election.cc:336] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.776762 17142 leader_election.cc:304] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
W20260709 13:19:15.774250 17216 leader_election.cc:336] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.778154 17708 raft_consensus.cc:2804] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:15.778638 17708 raft_consensus.cc:493] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:15.779039 17708 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.775487 17175 raft_consensus.cc:3060] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.789284 17068 leader_election.cc:336] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:15.789595 17216 leader_election.cc:336] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.789853 17068 leader_election.cc:304] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8; no voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:15.791570 17831 raft_consensus.cc:2749] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:15.792785 17068 leader_election.cc:336] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.795152 17802 leader_election.cc:290] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:15.799752 17068 leader_election.cc:304] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.800750 17837 raft_consensus.cc:2804] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.801645 17837 raft_consensus.cc:697] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:15.803234 17837 consensus_queue.cc:237] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:15.809432 17068 consensus_peers.cc:597] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.813680 17142 leader_election.cc:304] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
W20260709 13:19:15.814998 17216 consensus_peers.cc:597] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.839150 17840 raft_consensus.cc:2804] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.839815 17840 raft_consensus.cc:697] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.840611 16922 catalog_manager.cc:5697] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.840667 17840 consensus_queue.cc:237] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.842769 16922 catalog_manager.cc:5697] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 2 to 3, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 3 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:15.858790 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 43849.1us
I20260709 13:19:15.870223 17142 leader_election.cc:304] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.874536 17803 raft_consensus.cc:2804] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.875245 17803 raft_consensus.cc:697] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.876579 17803 consensus_queue.cc:237] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.833685 17708 raft_consensus.cc:515] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.885324 17175 raft_consensus.cc:2468] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 2.
I20260709 13:19:15.888134 17708 leader_election.cc:290] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Requested vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:15.896284 17216 consensus_peers.cc:597] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.900641 17216 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.901672 16922 catalog_manager.cc:5697] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.902820 17813 raft_consensus.cc:2804] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.903403 17813 raft_consensus.cc:697] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:15.903596 16922 catalog_manager.cc:5697] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.904265 17813 consensus_queue.cc:237] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:15.905382 17103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.906085 17103 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.911561 17860 log.cc:927] Time spent T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: Append to log took a long time: real 0.088s	user 0.000s	sys 0.009s
I20260709 13:19:15.913447 16926 catalog_manager.cc:5697] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.920090 17103 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.927929 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "896fb6e3b27e4874a469245a7b103111" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:15.928826 17099 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:15.931567 17142 consensus_peers.cc:597] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.934167 17142 leader_election.cc:304] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
W20260709 13:19:15.942633 17142 leader_election.cc:336] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:15.944371 17803 raft_consensus.cc:2804] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.944989 17803 raft_consensus.cc:697] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.948191 17099 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896fb6e3b27e4874a469245a7b103111 in term 2.
I20260709 13:19:15.953480 17142 leader_election.cc:304] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111; no voters: 16794c032a6645e2b267583ad59c9572
I20260709 13:19:15.954360 17708 raft_consensus.cc:2804] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:15.955299 17708 raft_consensus.cc:697] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Leader. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:15.960027 17708 consensus_queue.cc:237] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.964413 17099 raft_consensus.cc:1275] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:15.945919 17803 consensus_queue.cc:237] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:15.966378 17813 consensus_queue.cc:1048] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:19:15.975524 16922 catalog_manager.cc:5697] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 2 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.983371 16926 catalog_manager.cc:5697] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.985249 16926 catalog_manager.cc:5697] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.990760 17823 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:15.993213 17068 consensus_peers.cc:597] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.004509 17823 tablet_bootstrap.cc:492] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.005491 17823 ts_tablet_manager.cc:1403] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.310s	user 0.013s	sys 0.011s
W20260709 13:19:16.005615 17216 consensus_peers.cc:597] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.012563 17245 raft_consensus.cc:1275] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.013741 17103 raft_consensus.cc:1275] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.019208 17803 consensus_queue.cc:1048] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:16.008167 17823 raft_consensus.cc:359] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:16.025020 17823 raft_consensus.cc:740] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.024761 17802 consensus_queue.cc:1048] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.025966 17823 consensus_queue.cc:260] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:16.033241 17823 ts_tablet_manager.cc:1434] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:19:16.037540 17823 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:16.057112 16922 catalog_manager.cc:5697] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.061506 16922 catalog_manager.cc:5697] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 reported cstate change: term changed from 1 to 2, leader changed from 16794c032a6645e2b267583ad59c9572 (127.8.238.193) to 896fb6e3b27e4874a469245a7b103111 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "896fb6e3b27e4874a469245a7b103111" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.074007 17142 consensus_peers.cc:597] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.082533 17173 raft_consensus.cc:1275] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.091064 17245 raft_consensus.cc:1275] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.093091 17837 consensus_queue.cc:1048] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.094110 17173 raft_consensus.cc:1275] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.103343 17831 consensus_queue.cc:1048] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:16.104313 17103 raft_consensus.cc:1275] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.107640 17813 consensus_queue.cc:1048] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.115446 17708 consensus_queue.cc:1048] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:16.124154 17142 consensus_peers.cc:597] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.125792 17068 consensus_peers.cc:597] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.172156 17216 consensus_peers.cc:597] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.173295 17250 raft_consensus.cc:1275] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.183933 17802 consensus_queue.cc:1048] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:16.187429 17068 consensus_peers.cc:597] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.208464 17068 consensus_peers.cc:597] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.213557 17823 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.217617 17823 tablet_bootstrap.cc:492] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.218356 17823 ts_tablet_manager.cc:1403] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.184s	user 0.028s	sys 0.000s
W20260709 13:19:16.220429 17142 consensus_peers.cc:597] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.224434 17823 raft_consensus.cc:359] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.226770 17823 raft_consensus.cc:740] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.227758 17823 consensus_queue.cc:260] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.230985 17823 ts_tablet_manager.cc:1434] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:19:16.232972 17823 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:16.234813 17068 consensus_peers.cc:597] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.248334 17068 consensus_peers.cc:597] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.250079 17142 consensus_peers.cc:597] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.253172 17216 consensus_peers.cc:597] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.265866 17068 consensus_peers.cc:597] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.268993 17100 raft_consensus.cc:1275] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.270639 17802 consensus_queue.cc:1048] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:16.316126 17175 raft_consensus.cc:1275] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:16.322427 17068 consensus_peers.cc:597] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.326846 17142 consensus_peers.cc:597] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.327629 17142 consensus_peers.cc:597] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.333585 17100 raft_consensus.cc:1275] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:19:16.334189 17142 consensus_peers.cc:597] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.337595 17831 consensus_queue.cc:1048] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.341006 17823 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.341532 17827 raft_consensus.cc:493] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.342072 17823 tablet_bootstrap.cc:492] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.342931 17823 ts_tablet_manager.cc:1403] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.023s
I20260709 13:19:16.342866 17800 consensus_queue.cc:1048] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.342163 17827 raft_consensus.cc:515] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
W20260709 13:19:16.346760 17216 consensus_peers.cc:597] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.353575 17173 raft_consensus.cc:1275] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.360383 17827 leader_election.cc:290] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
W20260709 13:19:16.363173 17142 consensus_peers.cc:597] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.345698 17823 raft_consensus.cc:359] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.373267 17823 raft_consensus.cc:740] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.375092 17823 consensus_queue.cc:260] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.379545 17100 raft_consensus.cc:1275] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.379813 17099 raft_consensus.cc:1275] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.384485 17823 ts_tablet_manager.cc:1434] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:19:16.390302 17823 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:16.393646 17068 consensus_peers.cc:597] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.396020 17173 raft_consensus.cc:1275] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.396799 17803 consensus_queue.cc:1048] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.398021 17841 consensus_queue.cc:1048] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.418201 17835 consensus_queue.cc:1048] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:16.444144 17142 consensus_peers.cc:597] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.481060 17813 consensus_queue.cc:1048] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:19:16.493301 17142 consensus_peers.cc:597] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.494071 17142 consensus_peers.cc:597] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.503309 17142 consensus_peers.cc:597] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.523355 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 44162.1us
I20260709 13:19:16.553354 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
W20260709 13:19:16.559404 17142 consensus_peers.cc:597] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.563328 17068 consensus_peers.cc:597] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.564162 17068 consensus_peers.cc:597] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.564723 17068 consensus_peers.cc:597] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.579493 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 43665.2us
W20260709 13:19:16.585227 17216 consensus_peers.cc:597] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.597898 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af101ab31e994b5b9c841d81524c4e1b" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:16.599792 17817 leader_election.cc:304] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:16.606491 17827 raft_consensus.cc:2749] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:16.610960 17216 consensus_peers.cc:597] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.619042 17216 consensus_peers.cc:597] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.620128 17216 consensus_peers.cc:597] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.637810 17102 raft_consensus.cc:1275] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 896fb6e3b27e4874a469245a7b103111: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:16.638751 17823 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.642980 17823 tablet_bootstrap.cc:492] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.644735 17823 ts_tablet_manager.cc:1403] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.255s	user 0.026s	sys 0.020s
I20260709 13:19:16.649928 17823 raft_consensus.cc:359] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:16.660287 17142 consensus_peers.cc:597] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.660876 17823 raft_consensus.cc:740] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.662629 17920 consensus_queue.cc:1048] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.664137 17823 consensus_queue.cc:260] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
W20260709 13:19:16.677006 17216 consensus_peers.cc:597] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.680507 17823 ts_tablet_manager.cc:1434] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
W20260709 13:19:16.687309 17142 consensus_peers.cc:597] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.714526 17823 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:16.716151 17216 consensus_peers.cc:597] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.778103 17823 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.790802 17823 tablet_bootstrap.cc:492] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.791572 17823 ts_tablet_manager.cc:1403] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.000s
I20260709 13:19:16.794495 17823 raft_consensus.cc:359] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.795253 17823 raft_consensus.cc:740] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.802326 17823 consensus_queue.cc:260] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.805984 17823 ts_tablet_manager.cc:1434] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:19:16.806924 17823 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:16.819834 17216 consensus_peers.cc:597] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.821537 17827 raft_consensus.cc:493] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.822167 17827 raft_consensus.cc:515] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:16.826406 17827 leader_election.cc:290] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:16.827086 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:16.829353 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b2b5c741884596ad46b33b32c725d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:16.831218 17819 leader_election.cc:304] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:16.832180 17827 raft_consensus.cc:2749] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:16.846283 17823 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.848884 17823 tablet_bootstrap.cc:492] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.849906 17823 ts_tablet_manager.cc:1403] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.005s
I20260709 13:19:16.853513 17823 raft_consensus.cc:359] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.854874 17827 raft_consensus.cc:493] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.855641 17827 raft_consensus.cc:515] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:16.859910  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:46481
I20260709 13:19:16.860525 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12efab3d68e44ec697cc29a3695960e4" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:16.861001 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12efab3d68e44ec697cc29a3695960e4" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:16.860071 17953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:46481 every 8 connection(s)
I20260709 13:19:16.866303 17819 leader_election.cc:304] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:16.868644 17827 leader_election.cc:290] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:16.877200 17827 raft_consensus.cc:2749] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:16.854444 17823 raft_consensus.cc:740] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.882757 17823 consensus_queue.cc:260] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.887527 17823 ts_tablet_manager.cc:1434] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:19:16.888610 17823 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:16.931195 17823 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.933121 17823 tablet_bootstrap.cc:492] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.933892 17823 ts_tablet_manager.cc:1403] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.026s
W20260709 13:19:16.936542 17819 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 70432.7us
I20260709 13:19:16.936743 17823 raft_consensus.cc:359] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:16.937795 17823 raft_consensus.cc:740] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.938840 17823 consensus_queue.cc:260] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:16.941233 17823 ts_tablet_manager.cc:1434] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:16.942317 17823 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:16.971921 17954 heartbeater.cc:344] Connected to a master server at 127.8.238.254:34437
I20260709 13:19:16.972400 17954 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:16.973392 17954 heartbeater.cc:507] Master 127.8.238.254:34437 requested a full tablet report, sending...
I20260709 13:19:16.979185 17925 raft_consensus.cc:3060] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:16.989339 17068 consensus_peers.cc:597] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:16.992199 17823 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:16.993305 17823 tablet_bootstrap.cc:492] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:16.993994 17823 ts_tablet_manager.cc:1403] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.002s
I20260709 13:19:16.996088 16926 ts_manager.cc:194] Re-registered known tserver with Master: 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481)
I20260709 13:19:16.997375 17823 raft_consensus.cc:359] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:16.998517 17823 raft_consensus.cc:740] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.999504 17823 consensus_queue.cc:260] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.002290 17823 ts_tablet_manager.cc:1434] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:17.003307 17823 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.057356 17956 raft_consensus.cc:493] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.058187 17956 raft_consensus.cc:515] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.062391 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ac42568104f29ba5df81bb07d7683" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" is_pre_election: true
I20260709 13:19:17.072258 17925 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:17.075861 17823 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.080422 17823 tablet_bootstrap.cc:492] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.081240 17823 ts_tablet_manager.cc:1403] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.032s
I20260709 13:19:17.083992 17823 raft_consensus.cc:359] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.084770 17823 raft_consensus.cc:740] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.070619 17956 leader_election.cc:290] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:17.086833 16926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37266
I20260709 13:19:17.087682 17823 consensus_queue.cc:260] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.092454 17954 heartbeater.cc:499] Master 127.8.238.254:34437 was elected leader, sending a full tablet report...
I20260709 13:19:17.093888 17823 ts_tablet_manager.cc:1434] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:19:17.094846 17823 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.129367 17823 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.130563 17823 tablet_bootstrap.cc:492] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.131347 17823 ts_tablet_manager.cc:1403] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.009s
I20260709 13:19:17.135290 17925 raft_consensus.cc:3060] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.135113 17823 raft_consensus.cc:359] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.136099 17823 raft_consensus.cc:740] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.137349 17823 consensus_queue.cc:260] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.139767 17823 ts_tablet_manager.cc:1434] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:17.140626 17823 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.153342 17956 raft_consensus.cc:493] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.154034 17956 raft_consensus.cc:515] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.156349 17956 leader_election.cc:290] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:17.158461 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "896fb6e3b27e4874a469245a7b103111" is_pre_election: true
I20260709 13:19:17.183795 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "570ac42568104f29ba5df81bb07d7683" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:17.185762 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f937b33484e46e090f4544fe372a5a9" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1364e853d9ea4df1950346fb170498b8" is_pre_election: true
I20260709 13:19:17.188280 17819 leader_election.cc:304] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:17.190651 17956 raft_consensus.cc:2749] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:17.190135 17819 leader_election.cc:304] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16794c032a6645e2b267583ad59c9572; no voters: 1364e853d9ea4df1950346fb170498b8, 896fb6e3b27e4874a469245a7b103111
I20260709 13:19:17.193105 17956 raft_consensus.cc:2749] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:17.203769 17823 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.205001 17823 tablet_bootstrap.cc:492] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.205777 17823 ts_tablet_manager.cc:1403] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.035s
I20260709 13:19:17.208197 17823 raft_consensus.cc:359] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.208904 17823 raft_consensus.cc:740] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.209595 17823 consensus_queue.cc:260] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.211483 17823 ts_tablet_manager.cc:1434] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:19:17.212253 17823 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.228200 17823 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.229177 17823 tablet_bootstrap.cc:492] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.229846 17823 ts_tablet_manager.cc:1403] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:19:17.232497 17823 raft_consensus.cc:359] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.233211 17823 raft_consensus.cc:740] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.233836 17823 consensus_queue.cc:260] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.235690 17823 ts_tablet_manager.cc:1434] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:19:17.236773 17823 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.286039 17823 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.288147 17823 tablet_bootstrap.cc:492] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.288925 17823 ts_tablet_manager.cc:1403] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.008s
I20260709 13:19:17.291857 17823 raft_consensus.cc:359] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.292606 17823 raft_consensus.cc:740] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.296854 17823 consensus_queue.cc:260] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.299024 17823 ts_tablet_manager.cc:1434] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:17.299947 17823 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.332744 17823 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.333762 17823 tablet_bootstrap.cc:492] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.334498 17823 ts_tablet_manager.cc:1403] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.010s
I20260709 13:19:17.337448 17823 raft_consensus.cc:359] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.338464 17823 raft_consensus.cc:740] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.339131 17823 consensus_queue.cc:260] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.341692 17823 ts_tablet_manager.cc:1434] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:17.345901 17823 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.368506 17924 raft_consensus.cc:3060] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.390057 17925 raft_consensus.cc:3060] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.477458 17823 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.478546 17823 tablet_bootstrap.cc:492] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.479620 17924 raft_consensus.cc:3060] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.494683 17823 ts_tablet_manager.cc:1403] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.149s	user 0.053s	sys 0.017s
I20260709 13:19:17.497619 17823 raft_consensus.cc:359] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.498338 17823 raft_consensus.cc:740] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.499145 17823 consensus_queue.cc:260] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.500887 17823 ts_tablet_manager.cc:1434] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:17.501777 17823 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.521682 17823 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.522699 17823 tablet_bootstrap.cc:492] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.527412 17925 raft_consensus.cc:3060] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.530047 17823 ts_tablet_manager.cc:1403] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 13:19:17.532929 17823 raft_consensus.cc:359] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.533699 17823 raft_consensus.cc:740] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.534593 17823 consensus_queue.cc:260] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:17.536837 17823 ts_tablet_manager.cc:1434] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:17.537691 17823 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.581210 17823 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.582360 17823 tablet_bootstrap.cc:492] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.583312 17823 ts_tablet_manager.cc:1403] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.006s
I20260709 13:19:17.586146 17823 raft_consensus.cc:359] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:17.586819 17823 raft_consensus.cc:740] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.587486 17823 consensus_queue.cc:260] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:17.593614 17823 ts_tablet_manager.cc:1434] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:17.594542 17823 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.621361 17823 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.622400 17823 tablet_bootstrap.cc:492] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.626372 17823 ts_tablet_manager.cc:1403] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.007s
I20260709 13:19:17.629304 17823 raft_consensus.cc:359] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.630357 17823 raft_consensus.cc:740] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.631680 17823 consensus_queue.cc:260] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.639297 17823 ts_tablet_manager.cc:1434] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:17.640172 17823 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.667434 17823 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.668563 17823 tablet_bootstrap.cc:492] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.669330 17823 ts_tablet_manager.cc:1403] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 13:19:17.672135 17823 raft_consensus.cc:359] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.673074 17823 raft_consensus.cc:740] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.673869 17823 consensus_queue.cc:260] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.676759 17823 ts_tablet_manager.cc:1434] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:19:17.680891 17823 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.716661 17823 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.720036 17823 tablet_bootstrap.cc:492] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.720880 17823 ts_tablet_manager.cc:1403] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.005s
I20260709 13:19:17.723395 17823 raft_consensus.cc:359] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.724026 17823 raft_consensus.cc:740] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.724763 17823 consensus_queue.cc:260] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:17.726780 17823 ts_tablet_manager.cc:1434] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:17.730274 17823 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.763676 17927 raft_consensus.cc:3060] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.859848 17823 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.860894 17823 tablet_bootstrap.cc:492] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.861585 17823 ts_tablet_manager.cc:1403] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.132s	user 0.058s	sys 0.061s
I20260709 13:19:17.864108 17823 raft_consensus.cc:359] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.864813 17823 raft_consensus.cc:740] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.865535 17823 consensus_queue.cc:260] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.867645 17823 ts_tablet_manager.cc:1434] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:17.868530 17823 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.931679 17927 raft_consensus.cc:3060] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.954353 17823 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.955430 17823 tablet_bootstrap.cc:492] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:17.956128 17823 ts_tablet_manager.cc:1403] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.088s	user 0.039s	sys 0.033s
I20260709 13:19:17.959039 17823 raft_consensus.cc:359] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.959776 17823 raft_consensus.cc:740] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.960669 17823 consensus_queue.cc:260] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:17.963323 17823 ts_tablet_manager.cc:1434] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:19:17.966792 17823 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:17.971736 17927 raft_consensus.cc:3060] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.003628 17823 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.004627 17823 tablet_bootstrap.cc:492] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.005275 17823 ts_tablet_manager.cc:1403] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.003s
I20260709 13:19:18.007776 17823 raft_consensus.cc:359] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.008452 17823 raft_consensus.cc:740] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.009096 17823 consensus_queue.cc:260] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.011126 17823 ts_tablet_manager.cc:1434] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:19:18.011921 17823 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.025646 17823 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.026563 17823 tablet_bootstrap.cc:492] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.027213 17823 ts_tablet_manager.cc:1403] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:19:18.029276 17823 raft_consensus.cc:359] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.029857 17823 raft_consensus.cc:740] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.030625 17823 consensus_queue.cc:260] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.032773 17823 ts_tablet_manager.cc:1434] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:18.033360 17927 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.034559 17823 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.089972 17823 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.090852 17823 tablet_bootstrap.cc:492] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.091465 17823 ts_tablet_manager.cc:1403] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.033s
I20260709 13:19:18.093987 17823 raft_consensus.cc:359] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.094745 17823 raft_consensus.cc:740] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.095490 17823 consensus_queue.cc:260] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.097698 17823 ts_tablet_manager.cc:1434] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:18.098546 17823 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.149950 17823 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.151103 17823 tablet_bootstrap.cc:492] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.151875 17823 ts_tablet_manager.cc:1403] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.002s
I20260709 13:19:18.154673 17823 raft_consensus.cc:359] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.155439 17823 raft_consensus.cc:740] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.156109 17823 consensus_queue.cc:260] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.158667 17823 ts_tablet_manager.cc:1434] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:18.161124 17823 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.174568 17927 raft_consensus.cc:3060] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.177989 17823 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.179107 17823 tablet_bootstrap.cc:492] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.179805 17823 ts_tablet_manager.cc:1403] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 13:19:18.182380 17823 raft_consensus.cc:359] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.183069 17823 raft_consensus.cc:740] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.183846 17823 consensus_queue.cc:260] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.185853 17823 ts_tablet_manager.cc:1434] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:18.223428 17823 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.243498 17927 raft_consensus.cc:3060] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:18.295102 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 45813.2us
W20260709 13:19:18.309958 17216 consensus_peers.cc:597] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.333894 17142 consensus_peers.cc:597] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.334139 17823 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.335510 17823 tablet_bootstrap.cc:492] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.336213 17823 ts_tablet_manager.cc:1403] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.012s
I20260709 13:19:18.338783 17823 raft_consensus.cc:359] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.339488 17823 raft_consensus.cc:740] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.340341 17823 consensus_queue.cc:260] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.342727 17823 ts_tablet_manager.cc:1434] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:18.343619 17823 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.363040 17823 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.364017 17823 tablet_bootstrap.cc:492] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.364729 17823 ts_tablet_manager.cc:1403] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:19:18.367144 17823 raft_consensus.cc:359] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.367846 17823 raft_consensus.cc:740] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.368554 17823 consensus_queue.cc:260] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.371038 17823 ts_tablet_manager.cc:1434] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:18.372975 17823 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.409085 17823 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.410185 17823 tablet_bootstrap.cc:492] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.410985 17823 ts_tablet_manager.cc:1403] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.012s
I20260709 13:19:18.413908 17823 raft_consensus.cc:359] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.414738 17823 raft_consensus.cc:740] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.415511 17823 consensus_queue.cc:260] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.417908 17823 ts_tablet_manager.cc:1434] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:18.419225 17823 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.437332 17823 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.438124 17823 tablet_bootstrap.cc:492] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.438858 17823 ts_tablet_manager.cc:1403] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 13:19:18.441040 17823 raft_consensus.cc:359] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.441607 17823 raft_consensus.cc:740] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.442278 17823 consensus_queue.cc:260] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.443858 17823 ts_tablet_manager.cc:1434] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:18.444633 17823 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.465623 17823 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.466706 17823 tablet_bootstrap.cc:492] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.467414 17823 ts_tablet_manager.cc:1403] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:19:18.470062 17823 raft_consensus.cc:359] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.470782 17823 raft_consensus.cc:740] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.471431 17823 consensus_queue.cc:260] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.473541 17823 ts_tablet_manager.cc:1434] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:19:18.474543 17823 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.535028 17823 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.536099 17823 tablet_bootstrap.cc:492] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.536810 17823 ts_tablet_manager.cc:1403] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.000s
I20260709 13:19:18.540123 17823 raft_consensus.cc:359] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.540870 17823 raft_consensus.cc:740] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.541563 17823 consensus_queue.cc:260] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.543562 17823 ts_tablet_manager.cc:1434] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:18.544422 17823 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:18.586522 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.195:36971, user_credentials={real_user=slave}} blocked reactor thread for 97665.9us
I20260709 13:19:18.664191 17823 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.668823 17823 tablet_bootstrap.cc:492] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.669620 17823 ts_tablet_manager.cc:1403] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.009s
I20260709 13:19:18.675663 17823 raft_consensus.cc:359] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.676780 17823 raft_consensus.cc:740] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.679816 17823 consensus_queue.cc:260] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } }
I20260709 13:19:18.681770 17823 ts_tablet_manager.cc:1434] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:19:18.696857 17823 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:18.737509 17142 consensus_peers.cc:597] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.739447 17927 raft_consensus.cc:3060] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:18.791929 17142 consensus_peers.cc:597] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.835817 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 118409us
I20260709 13:19:18.844502 17823 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.845589 17823 tablet_bootstrap.cc:492] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.846323 17823 ts_tablet_manager.cc:1403] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.008s
I20260709 13:19:18.848938 17823 raft_consensus.cc:359] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.849715 17823 raft_consensus.cc:740] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.850675 17823 consensus_queue.cc:260] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:18.852913 17823 ts_tablet_manager.cc:1434] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:18.853785 17823 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.890359 17922 raft_consensus.cc:3060] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.893476 17823 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.894697 17823 tablet_bootstrap.cc:492] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.895553 17823 ts_tablet_manager.cc:1403] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.014s
I20260709 13:19:18.898344 17823 raft_consensus.cc:359] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.899201 17823 raft_consensus.cc:740] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.900159 17823 consensus_queue.cc:260] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.902464 17823 ts_tablet_manager.cc:1434] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:19:18.903451 17823 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:18.934991 17823 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:18.936347 17823 tablet_bootstrap.cc:492] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:18.937209 17823 ts_tablet_manager.cc:1403] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.008s
I20260709 13:19:18.940456 17823 raft_consensus.cc:359] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.941344 17823 raft_consensus.cc:740] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
W20260709 13:19:18.943336 17068 consensus_peers.cc:597] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:18.942198 17823 consensus_queue.cc:260] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:18.946110 17823 ts_tablet_manager.cc:1434] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:19:18.947157 17823 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
W20260709 13:19:18.951334 17140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 54697.3us
I20260709 13:19:19.004575 17823 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.005647 17823 tablet_bootstrap.cc:492] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:19.006487 17823 ts_tablet_manager.cc:1403] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.022s
I20260709 13:19:19.008430 17823 raft_consensus.cc:359] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:19.008991 17823 raft_consensus.cc:740] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.009708 17823 consensus_queue.cc:260] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:19.011339 17823 ts_tablet_manager.cc:1434] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:19.012486 17823 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:19.027920 17823 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.028880 17823 tablet_bootstrap.cc:492] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:19.029592 17823 ts_tablet_manager.cc:1403] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.007s
I20260709 13:19:19.032280 17823 raft_consensus.cc:359] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:19.032956 17823 raft_consensus.cc:740] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.033815 17823 consensus_queue.cc:260] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:19.036060 17823 ts_tablet_manager.cc:1434] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:19:19.037606 17823 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Bootstrap starting.
I20260709 13:19:19.055982 17823 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:19.057785 17823 tablet_bootstrap.cc:492] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Bootstrap complete.
I20260709 13:19:19.058558 17823 ts_tablet_manager.cc:1403] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:19:19.060964 17823 raft_consensus.cc:359] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:19.061587 17823 raft_consensus.cc:740] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.062299 17823 consensus_queue.cc:260] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:19.064548 17823 ts_tablet_manager.cc:1434] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:19.178133 17922 raft_consensus.cc:3060] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.226388 17922 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.327044 17925 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:20.636910 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 54237.7us
W20260709 13:19:21.257833 17216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.193:46481, user_credentials={real_user=slave}} blocked reactor thread for 58512.1us
I20260709 13:19:26.907783  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:26.961328 17175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:26.962216 17175 raft_consensus.cc:606] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Received request to transfer leadership to TS 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:26.970530 18054 raft_consensus.cc:993] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:26.971179 18052 raft_consensus.cc:1081] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Signalling peer 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:26.973160 17099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:59036
I20260709 13:19:26.973870 17099 raft_consensus.cc:493] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:26.975458 17099 raft_consensus.cc:3060] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.978123 17097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:26.978837 17097 raft_consensus.cc:606] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:26.983515 17175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "855427fe4a17404c80344adfff8a420d"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:26.984072 17175 raft_consensus.cc:606] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Received request to transfer leadership to TS 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:26.985200 17099 raft_consensus.cc:515] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:26.986749 17097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:26.987381 17097 raft_consensus.cc:606] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:26.989071 17099 leader_election.cc:290] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:26.989444 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:26.990053 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1443c01c216f42078dc34c1c904e9bfa" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:26.990715 17175 raft_consensus.cc:3055] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:26.991072 17175 raft_consensus.cc:740] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:26.992065 17175 consensus_queue.cc:260] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:26.993237 17175 raft_consensus.cc:3060] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.990300 17250 raft_consensus.cc:3060] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.998886 17099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:26.999565 17099 raft_consensus.cc:606] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:27.001015 17250 raft_consensus.cc:2468] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:27.002435 17066 leader_election.cc:304] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:27.003391 18056 raft_consensus.cc:2804] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.003896 18056 raft_consensus.cc:697] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:27.004904 18056 consensus_queue.cc:237] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.016036 17175 raft_consensus.cc:2468] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:27.023084 16926 catalog_manager.cc:5697] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.028280 17250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238"
dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
mode: GRACEFUL
new_leader_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:34146
I20260709 13:19:27.028960 17250 raft_consensus.cc:606] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Received request to transfer leadership to TS 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:27.030028 18053 raft_consensus.cc:993] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:27.030663 18056 raft_consensus.cc:1081] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:27.031338  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:27.033684  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:27.035636 17922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:19:27.036293 17922 raft_consensus.cc:493] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.036701 17922 raft_consensus.cc:3060] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.051556 18053 raft_consensus.cc:993] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:27.052175 18053 raft_consensus.cc:1081] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:27.055588 17924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:19:27.056322 17924 raft_consensus.cc:493] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.056979 17924 raft_consensus.cc:3060] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.059301 17922 raft_consensus.cc:515] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:27.062109 17922 leader_election.cc:290] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:27.063091 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:27.063743 17099 raft_consensus.cc:3055] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:27.064025 17099 raft_consensus.cc:740] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:27.064850 17099 consensus_queue.cc:260] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:27.066196 17099 raft_consensus.cc:3060] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.071589 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ea321625d744dc9ec9ad41bd84079a" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:27.072784 18054 raft_consensus.cc:993] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:27.073339 18054 raft_consensus.cc:1081] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Signalling peer 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:27.073748 17175 raft_consensus.cc:3060] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.076380 17097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "855427fe4a17404c80344adfff8a420d"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:59036
I20260709 13:19:27.076990 17097 raft_consensus.cc:493] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.077327 17097 raft_consensus.cc:3060] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.085197 17097 raft_consensus.cc:515] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.086894 17924 raft_consensus.cc:515] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:27.095800 17097 leader_election.cc:290] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:27.095808 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:27.096496 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:27.097160 17250 raft_consensus.cc:3060] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.089764 17099 raft_consensus.cc:2468] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:27.096562 17100 raft_consensus.cc:3055] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:27.097893 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41adc375fb524f19b4a65524c5f78041" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:27.098146 17100 raft_consensus.cc:740] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:27.098620 17173 raft_consensus.cc:3060] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.099213 17100 consensus_queue.cc:260] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:27.100272 17170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "855427fe4a17404c80344adfff8a420d" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:27.100600 17100 raft_consensus.cc:3060] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.100971 17170 raft_consensus.cc:3055] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:27.101328 17170 raft_consensus.cc:740] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:27.101441 17924 leader_election.cc:290] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:27.104827 17819 leader_election.cc:304] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:27.093091 17175 raft_consensus.cc:2468] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:27.102216 17170 consensus_queue.cc:260] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.109073 17173 raft_consensus.cc:2468] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:27.108475 17170 raft_consensus.cc:3060] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.111032 17100 raft_consensus.cc:2468] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:27.114020 17250 raft_consensus.cc:2468] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:27.115438 17066 leader_election.cc:304] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:27.116869 18056 raft_consensus.cc:2804] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.117507 18056 raft_consensus.cc:697] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:27.119007 17170 raft_consensus.cc:2468] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:27.118970 18056 consensus_queue.cc:237] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.123740 18070 raft_consensus.cc:2804] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.125253 17819 leader_election.cc:304] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, 896fb6e3b27e4874a469245a7b103111; no voters: 
I20260709 13:19:27.130981 18071 raft_consensus.cc:2804] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.133554 18071 raft_consensus.cc:697] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:27.134521 18071 consensus_queue.cc:237] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:27.135273 18070 raft_consensus.cc:697] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:27.136385 18070 consensus_queue.cc:237] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:27.147542 16926 catalog_manager.cc:5697] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.149674 16922 catalog_manager.cc:5697] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.169697 16926 catalog_manager.cc:5697] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.176014 18056 raft_consensus.cc:993] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:27.176590 18053 raft_consensus.cc:1081] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:27.178263 17924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:19:27.178833 17924 raft_consensus.cc:493] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.179136 17924 raft_consensus.cc:3060] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.185123 17924 raft_consensus.cc:515] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:27.188218 17924 leader_election.cc:290] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:27.189031 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:27.189678 17245 raft_consensus.cc:3060] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.191974 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d22686aaba74b978f567f111d0cee28" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:27.192619 17099 raft_consensus.cc:3055] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:27.193935 17099 raft_consensus.cc:740] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:27.194902 17099 consensus_queue.cc:260] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:27.196085 17099 raft_consensus.cc:3060] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.199182 17245 raft_consensus.cc:2468] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:27.200438 17817 leader_election.cc:304] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:27.201260 18070 raft_consensus.cc:2804] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.202059 17099 raft_consensus.cc:2468] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:27.201758 18070 raft_consensus.cc:697] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:27.203660 18070 consensus_queue.cc:237] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:27.212915 16926 catalog_manager.cc:5697] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.394130 17173 raft_consensus.cc:1275] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.395828 18053 consensus_queue.cc:1048] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.430202 17245 raft_consensus.cc:1275] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.432636 18056 consensus_queue.cc:1048] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.483592 18058 raft_consensus.cc:993] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: : Instructing follower 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:27.484544 18058 raft_consensus.cc:1081] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Signalling peer 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:27.486368 17097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:59028
I20260709 13:19:27.486933 17097 raft_consensus.cc:493] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.487372 17097 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.494189 17097 raft_consensus.cc:515] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.496671 17097 leader_election.cc:290] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:27.497289 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:27.497979 17245 raft_consensus.cc:3055] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:27.498319 17245 raft_consensus.cc:740] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:27.499132 17245 consensus_queue.cc:260] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.500427 17245 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.497289 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:27.503904 17173 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.507578 17245 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:27.508680 17066 leader_election.cc:304] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:27.509763 18053 raft_consensus.cc:2804] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.510367 18053 raft_consensus.cc:697] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:27.511240 18053 consensus_queue.cc:237] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:27.517544 17173 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 2.
I20260709 13:19:27.522473 16926 catalog_manager.cc:5697] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 1 to 2, leader changed from f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.603907 17097 raft_consensus.cc:1275] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.605749 18070 consensus_queue.cc:1048] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.616010 17173 raft_consensus.cc:1275] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.617470 18079 consensus_queue.cc:1048] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:27.624040 17099 raft_consensus.cc:1275] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.626652 18073 consensus_queue.cc:1048] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:27.630023 17250 raft_consensus.cc:1275] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.634512 18080 consensus_queue.cc:1048] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:27.643953 17097 raft_consensus.cc:1275] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.646836 17245 raft_consensus.cc:1275] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.658087 18071 consensus_queue.cc:1048] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:27.666795 18071 consensus_queue.cc:1048] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:27.680977 17173 raft_consensus.cc:1275] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:27.810540 18075 log.cc:927] Time spent T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572: Append to log took a long time: real 0.082s	user 0.000s	sys 0.007s
W20260709 13:19:27.818806 17140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.196:35033, user_credentials={real_user=slave}} blocked reactor thread for 84415.6us
I20260709 13:19:27.844467 18095 consensus_queue.cc:1048] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:27.854873 17142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:38593, user_credentials={real_user=slave}} blocked reactor thread for 143075us
I20260709 13:19:27.926712 17175 raft_consensus.cc:1275] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.933751 18070 consensus_queue.cc:1048] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:28.035349  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:28.045578 17175 raft_consensus.cc:1275] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.047083 18053 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:28.059849 17250 raft_consensus.cc:1275] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.066570 18066 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:28.097705  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:28.136588 17175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:28.137125 17175 raft_consensus.cc:606] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:28.139714 17175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:28.140218 17175 raft_consensus.cc:606] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:28.142642 17245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31001da831bd4090a480461096b888c5"
dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:34146
I20260709 13:19:28.143160 17245 raft_consensus.cc:606] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:28.145771 17100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "359d72c1f10442b9819867ccdde73870"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:28.146306 17100 raft_consensus.cc:606] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:28.148873 17100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:28.149380 17100 raft_consensus.cc:606] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:28.152319 17102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:28.152889 17102 raft_consensus.cc:606] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Received request to transfer leadership to TS f75c7dc3c3f24e2e800d40d91f7311f4
I20260709 13:19:28.154191  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:28.155319  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:28.160300 18053 raft_consensus.cc:993] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.160826 18066 raft_consensus.cc:1081] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.162403 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "359d72c1f10442b9819867ccdde73870"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:19:28.162922 17927 raft_consensus.cc:493] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.163218 17927 raft_consensus.cc:3060] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.168506 17927 raft_consensus.cc:515] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.170342 17927 leader_election.cc:290] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:28.171001 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:28.171649 17102 raft_consensus.cc:3055] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:28.171908 17102 raft_consensus.cc:740] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:28.172645 17102 consensus_queue.cc:260] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.173781 17102 raft_consensus.cc:3060] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.179365 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359d72c1f10442b9819867ccdde73870" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:28.180217 17175 raft_consensus.cc:3060] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.182029 17102 raft_consensus.cc:2468] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:28.189647 17819 leader_election.cc:304] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:28.190620 18098 raft_consensus.cc:2804] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:28.191105 18098 raft_consensus.cc:697] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:28.191937 18098 consensus_queue.cc:237] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.198202 17175 raft_consensus.cc:2468] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:28.202709 16922 catalog_manager.cc:5697] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.375550 18053 raft_consensus.cc:993] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.376067 18066 raft_consensus.cc:1081] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.377918 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:19:28.379125 17927 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.379829 17927 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.385599 17927 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:28.388057 17245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:28.388731 17245 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.390199 17927 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:28.390411 17102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd013d3d29734959949861700ba2f0bf" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:28.391752 17102 raft_consensus.cc:3055] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:28.392122 17102 raft_consensus.cc:740] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:28.393551 17102 consensus_queue.cc:260] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:28.395927 17245 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:28.397049 17102 raft_consensus.cc:3060] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.398092 17817 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:28.398970 18098 raft_consensus.cc:2804] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:28.399466 18098 raft_consensus.cc:697] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:28.400286 18098 consensus_queue.cc:237] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:28.403388 17102 raft_consensus.cc:2468] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:28.411628 16922 catalog_manager.cc:5697] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 2 to 3, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.414193 18102 raft_consensus.cc:993] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.414852 18102 raft_consensus.cc:1081] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.416962 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31001da831bd4090a480461096b888c5"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50316
I20260709 13:19:28.417515 17927 raft_consensus.cc:493] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.417932 17927 raft_consensus.cc:3060] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.421579 18099 raft_consensus.cc:993] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.422308 18099 raft_consensus.cc:1081] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.425405 17927 raft_consensus.cc:515] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:28.427561 17927 leader_election.cc:290] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:28.430398 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:28.440985 17250 raft_consensus.cc:3055] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:28.441377 17250 raft_consensus.cc:740] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:28.442154 17250 consensus_queue.cc:260] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:28.446770 17922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:19:28.447475 17922 raft_consensus.cc:493] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.447849 17922 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.460019 17250 raft_consensus.cc:3060] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.460659 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31001da831bd4090a480461096b888c5" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:28.461319 17100 raft_consensus.cc:3060] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.462672 18103 raft_consensus.cc:993] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.461412 17922 raft_consensus.cc:515] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.463284 18059 raft_consensus.cc:1081] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:28.473344 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:19:28.473906 17927 raft_consensus.cc:493] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.474352 17927 raft_consensus.cc:3060] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.476963 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:28.477581 17099 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.475078 17100 raft_consensus.cc:2468] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:28.478813 17922 leader_election.cc:290] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:28.484093 17099 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:28.485185 17927 raft_consensus.cc:515] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.486209 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca94b47708e4c198ba2a3f085f3e6f7" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:28.486821 17175 raft_consensus.cc:3055] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:28.487073 17175 raft_consensus.cc:740] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:28.487367 17927 leader_election.cc:290] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:28.487891 17175 consensus_queue.cc:260] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.489090 17175 raft_consensus.cc:3060] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.492590 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:28.493268 17173 raft_consensus.cc:3055] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:28.493566 17173 raft_consensus.cc:740] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:28.493605 17819 leader_election.cc:304] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:28.494472 17173 consensus_queue.cc:260] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.495882 17173 raft_consensus.cc:3060] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.497032 18071 raft_consensus.cc:2804] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:28.497578 18071 raft_consensus.cc:697] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:28.498497 18071 consensus_queue.cc:237] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:28.504812 17819 leader_election.cc:304] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:28.511794 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13b09204a1f749018e4e1531e3410d0d" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:28.518258 17099 raft_consensus.cc:3060] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:28.521817 17250 raft_consensus.cc:2468] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:28.513373 17173 raft_consensus.cc:2468] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:28.516315 17175 raft_consensus.cc:2468] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:28.525199 18071 raft_consensus.cc:2804] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:28.525621 17099 raft_consensus.cc:2468] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:28.525869 18071 raft_consensus.cc:697] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:28.526957 17819 leader_election.cc:304] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:28.526973 18071 consensus_queue.cc:237] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.528028 18098 raft_consensus.cc:2804] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:28.528970 18098 raft_consensus.cc:697] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:28.529978 18098 consensus_queue.cc:237] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:28.538071 18079 raft_consensus.cc:993] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: : Instructing follower f75c7dc3c3f24e2e800d40d91f7311f4 to start an election
I20260709 13:19:28.538894 18079 raft_consensus.cc:1081] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Signalling peer f75c7dc3c3f24e2e800d40d91f7311f4 to start an election
I20260709 13:19:28.541002 17245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238"
dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
 from {username='slave'} at 127.0.0.1:60866
I20260709 13:19:28.541570 17245 raft_consensus.cc:493] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:28.541951 17245 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.549317 17245 raft_consensus.cc:515] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:28.551923 16922 catalog_manager.cc:5697] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.554941 17099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:28.554194 17245 leader_election.cc:290] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:28.555572 17099 raft_consensus.cc:3055] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:28.555907 17099 raft_consensus.cc:740] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:28.556609 17099 consensus_queue.cc:260] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:28.553707 16922 catalog_manager.cc:5697] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 2 to 3, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.557857 17099 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.557754 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:28.558568 17173 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.567521 17099 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 3.
I20260709 13:19:28.567978 17173 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f75c7dc3c3f24e2e800d40d91f7311f4 in term 3.
I20260709 13:19:28.569461 17216 leader_election.cc:304] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 896fb6e3b27e4874a469245a7b103111, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:28.571223 18100 raft_consensus.cc:2804] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:28.571771 18100 raft_consensus.cc:697] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Becoming Leader. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:28.572602 18100 consensus_queue.cc:237] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:28.586869 16926 catalog_manager.cc:5697] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:28.592715 16922 catalog_manager.cc:5697] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 reported cstate change: term changed from 2 to 3, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196). New cstate: current_term: 3 leader_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:28.609328 17173 raft_consensus.cc:1275] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.610926 18071 consensus_queue.cc:1048] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:28.627112 17100 raft_consensus.cc:1275] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.628952 18071 consensus_queue.cc:1048] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:28.807348 17100 raft_consensus.cc:1275] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:28.808800 18071 consensus_queue.cc:1048] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:28.827154 17245 raft_consensus.cc:1275] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:28.829331 18098 consensus_queue.cc:1048] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:28.961800 17099 raft_consensus.cc:1275] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.963346 18098 consensus_queue.cc:1048] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:28.973706 17245 raft_consensus.cc:1275] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.978474 18070 consensus_queue.cc:1048] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:29.048245 17099 raft_consensus.cc:1275] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.049682 18070 consensus_queue.cc:1048] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.062366 17175 raft_consensus.cc:1275] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.070873 18070 consensus_queue.cc:1048] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.090699 17173 raft_consensus.cc:1275] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.091403 17100 raft_consensus.cc:1275] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Refusing update from remote peer f75c7dc3c3f24e2e800d40d91f7311f4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.093374 18100 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.094913 18097 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.126888 17100 raft_consensus.cc:1275] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:29.128576 18070 consensus_queue.cc:1048] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:29.132894 17175 raft_consensus.cc:1275] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:29.134714 18070 consensus_queue.cc:1048] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:29.156142  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:29.204965  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:29.258170 17175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:29.258808 17175 raft_consensus.cc:606] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:29.269022 17245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f6eedb2345347888597839f1da5742c"
dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:34146
I20260709 13:19:29.269632 17245 raft_consensus.cc:606] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:29.274573 17245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c"
dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:34146
I20260709 13:19:29.275251 17245 raft_consensus.cc:606] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:29.280670 17175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:29.281293 17175 raft_consensus.cc:606] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:29.291093 17173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747"
dest_uuid: "896fb6e3b27e4874a469245a7b103111"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:37056
I20260709 13:19:29.291743 17173 raft_consensus.cc:606] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:29.293129  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:29.295186  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:29.308882 18134 raft_consensus.cc:993] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.309468 18059 raft_consensus.cc:1081] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.311548 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:19:29.312148 17927 raft_consensus.cc:493] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.312533 17927 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.318687 17927 raft_consensus.cc:515] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.320365 17927 leader_election.cc:290] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:29.321151 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:29.321656 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ba94e0be5f4a638535c8d9bb9211d3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:29.321822 17100 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.322332 17173 raft_consensus.cc:3055] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:29.322674 17173 raft_consensus.cc:740] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:29.323436 17173 consensus_queue.cc:260] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.324689 17173 raft_consensus.cc:3060] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.328606 17100 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:29.329895 17819 leader_election.cc:304] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:29.330500 17173 raft_consensus.cc:2468] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:29.330736 18098 raft_consensus.cc:2804] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:29.331336 18098 raft_consensus.cc:697] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:29.332192 18098 consensus_queue.cc:237] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.340528 18059 raft_consensus.cc:993] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.340982 18134 raft_consensus.cc:1081] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.342548 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:19:29.342267 16926 catalog_manager.cc:5697] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 2 to 3, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.343047 17927 raft_consensus.cc:493] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.343436 17927 raft_consensus.cc:3060] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.348917 17927 raft_consensus.cc:515] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.351183 17927 leader_election.cc:290] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:29.351874 17100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:29.352545 17100 raft_consensus.cc:3060] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.352752 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40787f6c37c4588b30b9cac2233c0a3" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:29.353346 17173 raft_consensus.cc:3055] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:29.353637 17173 raft_consensus.cc:740] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:29.354460 17173 consensus_queue.cc:260] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.355708 17173 raft_consensus.cc:3060] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.359669 17100 raft_consensus.cc:2468] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:29.361032 17819 leader_election.cc:304] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:29.362145 18098 raft_consensus.cc:2804] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:29.362707 18098 raft_consensus.cc:697] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:29.363607 18098 consensus_queue.cc:237] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.363830 17173 raft_consensus.cc:2468] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:29.372448 16926 catalog_manager.cc:5697] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.483258 18097 raft_consensus.cc:993] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.483701 18100 raft_consensus.cc:1081] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.485261 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50316
I20260709 13:19:29.485755 17927 raft_consensus.cc:493] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.486094 17927 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.491503 17927 raft_consensus.cc:515] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:29.493285 17927 leader_election.cc:290] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 4 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:29.494032 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:29.494264 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ebac26a00d94bbda935011611c3311c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:29.494735 17249 raft_consensus.cc:3055] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:29.494908 17097 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.495102 17249 raft_consensus.cc:740] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:29.496081 17249 consensus_queue.cc:260] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:29.497028 17249 raft_consensus.cc:3060] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.500978 17097 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 4.
I20260709 13:19:29.502308 17819 leader_election.cc:304] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:29.503221 18098 raft_consensus.cc:2804] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:29.503677 18098 raft_consensus.cc:697] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 4 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:29.504166 17249 raft_consensus.cc:2468] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 4.
I20260709 13:19:29.504552 18098 consensus_queue.cc:237] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:29.517081 16926 catalog_manager.cc:5697] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 3 to 4, leader changed from f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 4 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.585173 18134 raft_consensus.cc:993] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.585745 18059 raft_consensus.cc:1081] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.587373 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50304
I20260709 13:19:29.587975 17927 raft_consensus.cc:493] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.588263 17927 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.593256 17927 raft_consensus.cc:515] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.595242 17927 leader_election.cc:290] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Requested vote from peers 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593), 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971)
I20260709 13:19:29.595978 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:29.596637 17097 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.597101 17173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7434c84892a4b8ba1c3985992fa5747" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:29.597709 17173 raft_consensus.cc:3055] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:29.598012 17173 raft_consensus.cc:740] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 896fb6e3b27e4874a469245a7b103111, State: Running, Role: LEADER
I20260709 13:19:29.598783 17173 consensus_queue.cc:260] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.600024 17173 raft_consensus.cc:3060] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.603677 17097 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:29.605057 17819 leader_election.cc:304] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:29.605885 18098 raft_consensus.cc:2804] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:29.606380 18098 raft_consensus.cc:697] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:29.606915 17173 raft_consensus.cc:2468] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 3.
I20260709 13:19:29.607308 18098 consensus_queue.cc:237] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } }
I20260709 13:19:29.616571 16926 catalog_manager.cc:5697] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 2 to 3, leader changed from 896fb6e3b27e4874a469245a7b103111 (127.8.238.195) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 3 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.684322 18097 raft_consensus.cc:993] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.684805 18100 raft_consensus.cc:1081] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:29.686408 17927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f6eedb2345347888597839f1da5742c"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50316
I20260709 13:19:29.686897 17927 raft_consensus.cc:493] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:29.687191 17927 raft_consensus.cc:3060] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.692278 17927 raft_consensus.cc:515] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:29.693720 17927 leader_election.cc:290] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:29.694521 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6eedb2345347888597839f1da5742c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:29.694816 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6eedb2345347888597839f1da5742c" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:29.695186 17249 raft_consensus.cc:3055] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:29.695336 17097 raft_consensus.cc:3060] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.695524 17249 raft_consensus.cc:740] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:29.696434 17249 consensus_queue.cc:260] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:29.697664 17249 raft_consensus.cc:3060] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.704867 17249 raft_consensus.cc:2468] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:29.704964 17097 raft_consensus.cc:2468] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:29.705917 17817 leader_election.cc:304] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16794c032a6645e2b267583ad59c9572, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:29.706743 18098 raft_consensus.cc:2804] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:29.707110 18098 raft_consensus.cc:697] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:29.707885 18098 consensus_queue.cc:237] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:29.717101 16926 catalog_manager.cc:5697] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.718384 17173 raft_consensus.cc:1275] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.719719 18098 consensus_queue.cc:1048] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.737679 17097 raft_consensus.cc:1275] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:29.740386 18071 consensus_queue.cc:1048] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.883756 17097 raft_consensus.cc:1275] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:29.885383 18098 consensus_queue.cc:1048] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:29.896013 17173 raft_consensus.cc:1275] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:29.897421 18071 consensus_queue.cc:1048] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:29.908492 17249 raft_consensus.cc:1275] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:29.910516 18098 consensus_queue.cc:1048] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.916241 17100 raft_consensus.cc:1275] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:29.920042 18098 consensus_queue.cc:1048] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:30.088452 17173 raft_consensus.cc:1275] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:30.089789 18098 consensus_queue.cc:1048] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:30.099985 17097 raft_consensus.cc:1275] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:30.102054 18070 consensus_queue.cc:1048] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:30.183007 17249 raft_consensus.cc:1275] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.184839 18098 consensus_queue.cc:1048] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.195551 17097 raft_consensus.cc:1275] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:30.201161 18071 consensus_queue.cc:1048] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:30.296054  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:30.351135  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:30.392431 17249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238"
dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
mode: GRACEFUL
new_leader_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:34146
I20260709 13:19:30.393118 17249 raft_consensus.cc:606] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Received request to transfer leadership to TS 1364e853d9ea4df1950346fb170498b8
I20260709 13:19:30.394349  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:30.395668  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:30.438867 18097 raft_consensus.cc:993] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: : Instructing follower 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:30.439383 18100 raft_consensus.cc:1081] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Signalling peer 1364e853d9ea4df1950346fb170498b8 to start an election
I20260709 13:19:30.440760 17100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
 from {username='slave'} at 127.0.0.1:59028
I20260709 13:19:30.441244 17100 raft_consensus.cc:493] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.441540 17100 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.446079 17100 raft_consensus.cc:515] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:30.447723 17100 leader_election.cc:290] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 4 election: Requested vote from peers 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971), f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033)
I20260709 13:19:30.449039 17249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:30.449714 17249 raft_consensus.cc:3055] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:30.450502 17175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5acc03bc88b41babf7cfbdf04fe0238" candidate_uuid: "1364e853d9ea4df1950346fb170498b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "896fb6e3b27e4874a469245a7b103111"
I20260709 13:19:30.451113 17175 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.449976 17249 raft_consensus.cc:740] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f75c7dc3c3f24e2e800d40d91f7311f4, State: Running, Role: LEADER
I20260709 13:19:30.453503 17249 consensus_queue.cc:260] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:30.454809 17249 raft_consensus.cc:3060] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.462626 17249 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 4.
I20260709 13:19:30.463719 17066 leader_election.cc:304] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 
I20260709 13:19:30.464406 18142 raft_consensus.cc:2804] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:30.464980 18142 raft_consensus.cc:697] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 4 LEADER]: Becoming Leader. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:30.464936 17175 raft_consensus.cc:2468] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364e853d9ea4df1950346fb170498b8 in term 4.
I20260709 13:19:30.466068 18142 consensus_queue.cc:237] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } }
I20260709 13:19:30.476159 16922 catalog_manager.cc:5697] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 reported cstate change: term changed from 3 to 4, leader changed from f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196) to 1364e853d9ea4df1950346fb170498b8 (127.8.238.194). New cstate: current_term: 4 leader_uuid: "1364e853d9ea4df1950346fb170498b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.885850 17173 raft_consensus.cc:1275] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 4 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:30.887945 18142 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "896fb6e3b27e4874a469245a7b103111" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:30.906711 17250 raft_consensus.cc:1275] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Refusing update from remote peer 1364e853d9ea4df1950346fb170498b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:30.908450 18163 consensus_queue.cc:1048] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:31.397007  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:31.444166  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:31.486817 17097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4"
dest_uuid: "1364e853d9ea4df1950346fb170498b8"
mode: GRACEFUL
new_leader_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:41432
I20260709 13:19:31.487649 17097 raft_consensus.cc:606] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Received request to transfer leadership to TS 16794c032a6645e2b267583ad59c9572
I20260709 13:19:31.490134  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:31.491456  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:31.711370 18170 raft_consensus.cc:993] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: : Instructing follower 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:31.712055 18142 raft_consensus.cc:1081] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Signalling peer 16794c032a6645e2b267583ad59c9572 to start an election
I20260709 13:19:31.713826 17926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4"
dest_uuid: "16794c032a6645e2b267583ad59c9572"
 from {username='slave'} at 127.0.0.1:50318
I20260709 13:19:31.714665 17926 raft_consensus.cc:493] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.715181 17926 raft_consensus.cc:3060] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.723614 17926 raft_consensus.cc:515] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:31.726382 17926 leader_election.cc:290] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Requested vote from peers f75c7dc3c3f24e2e800d40d91f7311f4 (127.8.238.196:35033), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:31.727038 17097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364e853d9ea4df1950346fb170498b8"
I20260709 13:19:31.727807 17097 raft_consensus.cc:3055] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:31.728178 17097 raft_consensus.cc:740] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364e853d9ea4df1950346fb170498b8, State: Running, Role: LEADER
I20260709 13:19:31.726783 17250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a0c88c5fa240e5a0cc957f5569c1f4" candidate_uuid: "16794c032a6645e2b267583ad59c9572" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4"
I20260709 13:19:31.728941 17250 raft_consensus.cc:3060] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.729015 17097 consensus_queue.cc:260] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:31.730369 17097 raft_consensus.cc:3060] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.737178 17097 raft_consensus.cc:2468] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:31.738317 17250 raft_consensus.cc:2468] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16794c032a6645e2b267583ad59c9572 in term 2.
I20260709 13:19:31.738621 17819 leader_election.cc:304] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572; no voters: 
I20260709 13:19:31.739714 18098 raft_consensus.cc:2804] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:31.740173 18098 raft_consensus.cc:697] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Becoming Leader. State: Replica: 16794c032a6645e2b267583ad59c9572, State: Running, Role: LEADER
I20260709 13:19:31.741158 18098 consensus_queue.cc:237] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:31.755440 16923 catalog_manager.cc:5697] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 reported cstate change: term changed from 1 to 2, leader changed from 1364e853d9ea4df1950346fb170498b8 (127.8.238.194) to 16794c032a6645e2b267583ad59c9572 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "16794c032a6645e2b267583ad59c9572" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.183771 17100 raft_consensus.cc:1275] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.187361 18070 consensus_queue.cc:1048] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:32.207866 17250 raft_consensus.cc:1275] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Refusing update from remote peer 16794c032a6645e2b267583ad59c9572: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.210222 18070 consensus_queue.cc:1048] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.492377  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:32.537405  9147 tablet_server.cc:179] TabletServer@127.8.238.193:46481 shutting down...
W20260709 13:19:32.543751 17142 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 253 similar messages]
W20260709 13:19:32.554697 17142 consensus_peers.cc:597] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.559993 17216 consensus_peers.cc:597] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.568797 17216 consensus_peers.cc:597] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.572597 17216 consensus_peers.cc:597] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.588809 17216 consensus_peers.cc:597] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.595162 17142 consensus_peers.cc:597] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.596151 17142 consensus_peers.cc:597] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.598623  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:32.600178  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.601076  9147 raft_consensus.cc:2243] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.602048  9147 raft_consensus.cc:2272] T e7434c84892a4b8ba1c3985992fa5747 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.602346 17142 consensus_peers.cc:597] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.605050  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.605835  9147 raft_consensus.cc:2243] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.606783  9147 raft_consensus.cc:2272] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.610184  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.611234  9147 raft_consensus.cc:2243] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:32.611613 17142 consensus_peers.cc:597] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.611840  9147 raft_consensus.cc:2272] T 17b25597e8e2479b9bf69918cf1c0a02 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.615399  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.616386  9147 raft_consensus.cc:2243] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.617544  9147 raft_consensus.cc:2272] T 13b09204a1f749018e4e1531e3410d0d P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.620276  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.621290  9147 raft_consensus.cc:2243] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.622457  9147 raft_consensus.cc:2272] T 6f6eedb2345347888597839f1da5742c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.623159 17068 consensus_peers.cc:597] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.624863  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.625674  9147 raft_consensus.cc:2243] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.626178  9147 raft_consensus.cc:2272] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.628701  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.629451  9147 raft_consensus.cc:2243] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.630367  9147 raft_consensus.cc:2272] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.633510  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.634478  9147 raft_consensus.cc:2243] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.635576  9147 raft_consensus.cc:2272] T cd013d3d29734959949861700ba2f0bf P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.638684  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.639542  9147 raft_consensus.cc:2243] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.640594  9147 raft_consensus.cc:2272] T 41adc375fb524f19b4a65524c5f78041 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.641283 17216 consensus_peers.cc:597] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.642045 17142 consensus_peers.cc:597] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.644006  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.645952  9147 raft_consensus.cc:2243] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:32.646306 17142 consensus_peers.cc:597] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.646584  9147 raft_consensus.cc:2272] T 75097aacc2fe4fd6be138902792ad16f P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.649017  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.649869  9147 raft_consensus.cc:2243] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.650871  9147 raft_consensus.cc:2272] T b8ea321625d744dc9ec9ad41bd84079a P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.653194  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.653806  9147 raft_consensus.cc:2243] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.654278  9147 raft_consensus.cc:2272] T b01575d8b45646519b3c341e62c407f9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.656466  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.657111  9147 raft_consensus.cc:2243] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.657605  9147 raft_consensus.cc:2272] T 727d16a19f284201998350af3f7ebcdc P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.660707  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.661497  9147 raft_consensus.cc:2243] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.661972  9147 raft_consensus.cc:2272] T 468c1b5e86fc4f40995e64ce4cfe446a P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.664398  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.664964  9147 raft_consensus.cc:2243] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.665349  9147 raft_consensus.cc:2272] T be5cb5807ca8471bab64797de2f9919b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.667658  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.668222  9147 raft_consensus.cc:2243] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.668668  9147 raft_consensus.cc:2272] T c4f214fc5aac4e8d82b544d227421217 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.671613  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.672441  9147 raft_consensus.cc:2243] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.672993  9147 raft_consensus.cc:2272] T 098e645055dd449c91b9fe4481f66aa6 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.675884  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.676496  9147 raft_consensus.cc:2243] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.677011  9147 raft_consensus.cc:2272] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.679658  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.680274  9147 raft_consensus.cc:2243] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.680794  9147 raft_consensus.cc:2272] T 5a94f0c007bb449daa0dfd34bdf4222c P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.683284  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.683943  9147 raft_consensus.cc:2243] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.684430  9147 raft_consensus.cc:2272] T a1d7f3735ebc41f691fbce7d2c33ab12 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.687089  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.687911  9147 raft_consensus.cc:2243] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.688476  9147 raft_consensus.cc:2272] T e31daec548cf48f6bedf21556ead46f6 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.690119 17142 consensus_peers.cc:597] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.691700  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.692703  9147 raft_consensus.cc:2243] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.693334  9147 raft_consensus.cc:2272] T 4749463a5f494207809283ca94150c73 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.695060 17068 consensus_peers.cc:597] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.696736  9147 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:32.697306 17142 consensus_peers.cc:597] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.697881  9147 raft_consensus.cc:2243] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.698486  9147 raft_consensus.cc:2272] T 74f5191b11fd41debf2fb4c4422f4b8a P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.701632  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.702574  9147 raft_consensus.cc:2243] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.703189  9147 raft_consensus.cc:2272] T 85ab0391bda54325b10799d23b44b332 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.705906  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.706714  9147 raft_consensus.cc:2243] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.707296  9147 raft_consensus.cc:2272] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.709968  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.710652  9147 raft_consensus.cc:2243] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.711560  9147 raft_consensus.cc:2272] T 9ebac26a00d94bbda935011611c3311c P 16794c032a6645e2b267583ad59c9572 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.713601  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.714169  9147 raft_consensus.cc:2243] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.714746  9147 raft_consensus.cc:2272] T 86b2b5c741884596ad46b33b32c725d3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.716949  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.717701  9147 raft_consensus.cc:2243] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.718186  9147 raft_consensus.cc:2272] T 4c69155bc1714330b50c63899c8400fb P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.721189  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.721997  9147 raft_consensus.cc:2243] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.722461  9147 raft_consensus.cc:2272] T bd0eff3471854a72a1357beeb5723b41 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.724650  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.725242  9147 raft_consensus.cc:2243] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.725618  9147 raft_consensus.cc:2272] T 7f937b33484e46e090f4544fe372a5a9 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.728124  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.728897  9147 raft_consensus.cc:2243] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.730012  9147 raft_consensus.cc:2272] T 359d72c1f10442b9819867ccdde73870 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.732288  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.732803  9147 raft_consensus.cc:2243] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.733711  9147 raft_consensus.cc:2272] T 8d22686aaba74b978f567f111d0cee28 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.735874  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.736359  9147 raft_consensus.cc:2243] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.737208  9147 raft_consensus.cc:2272] T c40787f6c37c4588b30b9cac2233c0a3 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.739372  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.740187  9147 raft_consensus.cc:2243] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.740741  9147 raft_consensus.cc:2272] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.743541  9147 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:32.743882 17216 consensus_peers.cc:597] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.744452  9147 raft_consensus.cc:2243] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.745270  9147 raft_consensus.cc:2272] T 08dbd048d2c24d53bb50081b63f1625b P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.748390 17068 consensus_peers.cc:597] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.748672  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.749589  9147 raft_consensus.cc:2243] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.750813  9147 raft_consensus.cc:2272] T 31001da831bd4090a480461096b888c5 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.753520 17068 consensus_peers.cc:597] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.754067  9147 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:32.754685 17142 consensus_peers.cc:597] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.754820  9147 raft_consensus.cc:2243] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.755482  9147 raft_consensus.cc:2272] T f06adc55b95e4338b38e9323041f9eb7 P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.757709  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.758394  9147 raft_consensus.cc:2243] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.758952  9147 raft_consensus.cc:2272] T 50c639a326f04d8d8eed7bd41bc8df2b P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.761224  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.761839  9147 raft_consensus.cc:2243] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.762337  9147 raft_consensus.cc:2272] T e7ff634467f042329ddeb7a8af515f56 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.764581  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.765151  9147 raft_consensus.cc:2243] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:32.766012  9147 raft_consensus.cc:2272] T 00ba94e0be5f4a638535c8d9bb9211d3 P 16794c032a6645e2b267583ad59c9572 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.768379  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.768895  9147 raft_consensus.cc:2243] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.769356  9147 raft_consensus.cc:2272] T dcf71c3afe414daeb032d872c3c949c3 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.772238  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.772974  9147 raft_consensus.cc:2243] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.773496  9147 raft_consensus.cc:2272] T 12efab3d68e44ec697cc29a3695960e4 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.774710 17216 consensus_peers.cc:597] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.776664  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.777446  9147 raft_consensus.cc:2243] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.777917  9147 raft_consensus.cc:2272] T 28414584faaa415dab69430bf5735027 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.780736  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:32.781458  9147 raft_consensus.cc:2243] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.782011  9147 raft_consensus.cc:2272] T 570ac42568104f29ba5df81bb07d7683 P 16794c032a6645e2b267583ad59c9572 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:32.785269  9147 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:32.785364 17216 consensus_peers.cc:597] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.785923  9147 raft_consensus.cc:2243] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:32.786628  9147 raft_consensus.cc:2272] T af101ab31e994b5b9c841d81524c4e1b P 16794c032a6645e2b267583ad59c9572 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:32.823657 17142 consensus_peers.cc:597] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.830341 17216 consensus_peers.cc:597] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.852972 17068 consensus_peers.cc:597] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.869656  9147 tablet_server.cc:196] TabletServer@127.8.238.193:46481 shutdown complete.
W20260709 13:19:32.896823 17216 consensus_peers.cc:597] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.902925 17216 consensus_peers.cc:597] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.916564 17068 consensus_peers.cc:597] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.969810 17068 consensus_peers.cc:597] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:32.980919 17068 consensus_peers.cc:597] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.982191  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
W20260709 13:19:33.021557 17142 consensus_peers.cc:597] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 -> Peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Couldn't send request to peer 16794c032a6645e2b267583ad59c9572. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.034708  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:33.035910  9147 tablet_replica.cc:333] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.036865  9147 raft_consensus.cc:2243] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.037562  9147 raft_consensus.cc:2272] T 31001da831bd4090a480461096b888c5 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.040838  9147 tablet_replica.cc:333] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.041795  9147 raft_consensus.cc:2243] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.042482  9147 raft_consensus.cc:2272] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.045976  9147 tablet_replica.cc:333] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.046968  9147 raft_consensus.cc:2243] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.047735  9147 raft_consensus.cc:2272] T 6f6eedb2345347888597839f1da5742c P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.051641  9147 tablet_replica.cc:333] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.052544  9147 raft_consensus.cc:2243] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.053189  9147 raft_consensus.cc:2272] T b8ea321625d744dc9ec9ad41bd84079a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.056107  9147 tablet_replica.cc:333] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.056989  9147 raft_consensus.cc:2243] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.057969  9147 raft_consensus.cc:2272] T cdb7c15929434ca0a9f7925722859adf P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.060986  9147 tablet_replica.cc:333] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.061780  9147 raft_consensus.cc:2243] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.062940  9147 raft_consensus.cc:2272] T 468c1b5e86fc4f40995e64ce4cfe446a P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.065490 17216 consensus_peers.cc:597] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.066159  9147 tablet_replica.cc:333] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.067190  9147 raft_consensus.cc:2243] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.068312  9147 raft_consensus.cc:2272] T 1443c01c216f42078dc34c1c904e9bfa P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.071184  9147 tablet_replica.cc:333] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.071995  9147 raft_consensus.cc:2243] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.072590  9147 raft_consensus.cc:2272] T 8712f3f0952b48d5b34d644bdfdc263d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.072813 17216 consensus_peers.cc:597] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.075443  9147 tablet_replica.cc:333] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.076427  9147 raft_consensus.cc:2243] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.077085  9147 raft_consensus.cc:2272] T 13b09204a1f749018e4e1531e3410d0d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.080212  9147 tablet_replica.cc:333] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.081120  9147 raft_consensus.cc:2243] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.082317  9147 raft_consensus.cc:2272] T f06adc55b95e4338b38e9323041f9eb7 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.085078  9147 tablet_replica.cc:333] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.085855  9147 raft_consensus.cc:2243] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.086521  9147 raft_consensus.cc:2272] T 570ac42568104f29ba5df81bb07d7683 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.089483  9147 tablet_replica.cc:333] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.090107  9147 raft_consensus.cc:2243] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.090740  9147 raft_consensus.cc:2272] T 4749463a5f494207809283ca94150c73 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.094678  9147 tablet_replica.cc:333] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.095631  9147 raft_consensus.cc:2243] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.096104  9147 raft_consensus.cc:2272] T 3a8311e3adec426caac0f0b50057d6d7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.098593  9147 tablet_replica.cc:333] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.099215  9147 raft_consensus.cc:2243] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.100126  9147 raft_consensus.cc:2272] T be5cb5807ca8471bab64797de2f9919b P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.102908  9147 tablet_replica.cc:333] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
W20260709 13:19:33.103295 17216 consensus_peers.cc:597] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.103679  9147 raft_consensus.cc:2243] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.104828  9147 raft_consensus.cc:2272] T 618435fe625b47de9afd290384ff676e P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.107831  9147 tablet_replica.cc:333] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.108618  9147 raft_consensus.cc:2243] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.109227  9147 raft_consensus.cc:2272] T c4f214fc5aac4e8d82b544d227421217 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.111781  9147 tablet_replica.cc:333] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.112365  9147 raft_consensus.cc:2243] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.113229  9147 raft_consensus.cc:2272] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.115576  9147 tablet_replica.cc:333] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.116310  9147 raft_consensus.cc:2243] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.116788  9147 raft_consensus.cc:2272] T 9ebac26a00d94bbda935011611c3311c P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.120280  9147 tablet_replica.cc:333] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.121474  9147 raft_consensus.cc:2243] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.122283  9147 raft_consensus.cc:2272] T 6d87f62879274a0ab4ec5951b7fe01a7 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.123379 17216 consensus_peers.cc:597] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.126312  9147 tablet_replica.cc:333] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.127635  9147 raft_consensus.cc:2243] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.129163  9147 raft_consensus.cc:2272] T 855427fe4a17404c80344adfff8a420d P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.132233  9147 tablet_replica.cc:333] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.133265  9147 raft_consensus.cc:2243] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.134095  9147 raft_consensus.cc:2272] T cd013d3d29734959949861700ba2f0bf P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.137362  9147 tablet_replica.cc:333] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.138399  9147 raft_consensus.cc:2243] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.138963  9147 raft_consensus.cc:2272] T 41a0c88c5fa240e5a0cc957f5569c1f4 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.143741  9147 tablet_replica.cc:333] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.144896  9147 raft_consensus.cc:2243] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.145468  9147 raft_consensus.cc:2272] T 1c4ba9ad373e446b82700a8a82294225 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.149434  9147 tablet_replica.cc:333] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.150612  9147 raft_consensus.cc:2243] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.152041  9147 raft_consensus.cc:2272] T f5acc03bc88b41babf7cfbdf04fe0238 P 1364e853d9ea4df1950346fb170498b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.156898  9147 tablet_replica.cc:333] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.157773  9147 raft_consensus.cc:2243] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.158727  9147 raft_consensus.cc:2272] T e31daec548cf48f6bedf21556ead46f6 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.161235  9147 tablet_replica.cc:333] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.161839  9147 raft_consensus.cc:2243] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.162361  9147 raft_consensus.cc:2272] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.165256  9147 tablet_replica.cc:333] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.166018  9147 raft_consensus.cc:2243] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.166654  9147 raft_consensus.cc:2272] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.169828  9147 tablet_replica.cc:333] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.170686  9147 raft_consensus.cc:2243] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.171272  9147 raft_consensus.cc:2272] T 926ebf63b80f401d9c985bd2905a1b65 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.174057  9147 tablet_replica.cc:333] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.174799  9147 raft_consensus.cc:2243] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.175559  9147 raft_consensus.cc:2272] T 727d16a19f284201998350af3f7ebcdc P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.178085  9147 tablet_replica.cc:333] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.178781  9147 raft_consensus.cc:2243] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.179369  9147 raft_consensus.cc:2272] T 8d22686aaba74b978f567f111d0cee28 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.182027  9147 tablet_replica.cc:333] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.182688  9147 raft_consensus.cc:2243] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.183147  9147 raft_consensus.cc:2272] T c40787f6c37c4588b30b9cac2233c0a3 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.185220  9147 tablet_replica.cc:333] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.185791  9147 raft_consensus.cc:2243] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.186283  9147 raft_consensus.cc:2272] T bd0eff3471854a72a1357beeb5723b41 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.188149  9147 tablet_replica.cc:333] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.188737  9147 raft_consensus.cc:2243] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.189540  9147 raft_consensus.cc:2272] T 7f937b33484e46e090f4544fe372a5a9 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.191577  9147 tablet_replica.cc:333] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.192174  9147 raft_consensus.cc:2243] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.192641  9147 raft_consensus.cc:2272] T 359d72c1f10442b9819867ccdde73870 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.194841  9147 tablet_replica.cc:333] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.195436  9147 raft_consensus.cc:2243] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.195904  9147 raft_consensus.cc:2272] T 8397c824876e4947a125624f56c2501d P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.197890  9147 tablet_replica.cc:333] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.198489  9147 raft_consensus.cc:2243] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.198956  9147 raft_consensus.cc:2272] T 41adc375fb524f19b4a65524c5f78041 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.201102  9147 tablet_replica.cc:333] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.201658  9147 raft_consensus.cc:2243] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.202170  9147 raft_consensus.cc:2272] T 74f5191b11fd41debf2fb4c4422f4b8a P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.204600  9147 tablet_replica.cc:333] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.205255  9147 raft_consensus.cc:2243] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.206295  9147 raft_consensus.cc:2272] T 4c69155bc1714330b50c63899c8400fb P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.208418  9147 tablet_replica.cc:333] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.208997  9147 raft_consensus.cc:2243] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.209452  9147 raft_consensus.cc:2272] T e7434c84892a4b8ba1c3985992fa5747 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.211692  9147 tablet_replica.cc:333] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.212204  9147 raft_consensus.cc:2243] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.212967  9147 raft_consensus.cc:2272] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.215114  9147 tablet_replica.cc:333] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.215596  9147 raft_consensus.cc:2243] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.216351  9147 raft_consensus.cc:2272] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.219165  9147 tablet_replica.cc:333] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.219903  9147 raft_consensus.cc:2243] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.220479  9147 raft_consensus.cc:2272] T e7ff634467f042329ddeb7a8af515f56 P 1364e853d9ea4df1950346fb170498b8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.221491 17216 consensus_peers.cc:597] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.222280 17216 consensus_peers.cc:597] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.223161  9147 tablet_replica.cc:333] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.223765  9147 raft_consensus.cc:2243] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.224246  9147 raft_consensus.cc:2272] T 00ba94e0be5f4a638535c8d9bb9211d3 P 1364e853d9ea4df1950346fb170498b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.226507  9147 tablet_replica.cc:333] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8: stopping tablet replica
I20260709 13:19:33.226985  9147 raft_consensus.cc:2243] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.227430  9147 raft_consensus.cc:2272] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 1364e853d9ea4df1950346fb170498b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.239271 17216 consensus_peers.cc:597] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.253499 17216 consensus_peers.cc:597] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.263643 17142 consensus_peers.cc:597] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.312696 17216 consensus_peers.cc:597] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.325377 17142 consensus_peers.cc:597] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.338909 17142 consensus_peers.cc:597] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.352936  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
W20260709 13:19:33.396931 17142 consensus_peers.cc:597] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.425905  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
I20260709 13:19:33.473948  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:33.475040  9147 tablet_replica.cc:333] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.476063  9147 raft_consensus.cc:2243] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.477174  9147 raft_consensus.cc:2272] T cdb7c15929434ca0a9f7925722859adf P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.478979 17142 consensus_peers.cc:597] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.480943  9147 tablet_replica.cc:333] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.481702  9147 raft_consensus.cc:2243] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.482218  9147 raft_consensus.cc:2272] T 1443c01c216f42078dc34c1c904e9bfa P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.484417  9147 tablet_replica.cc:333] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.485092  9147 raft_consensus.cc:2243] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.485579  9147 raft_consensus.cc:2272] T 468c1b5e86fc4f40995e64ce4cfe446a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.488281  9147 tablet_replica.cc:333] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.489131  9147 raft_consensus.cc:2243] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.489706  9147 raft_consensus.cc:2272] T b8ea321625d744dc9ec9ad41bd84079a P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.492883  9147 tablet_replica.cc:333] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.493752  9147 raft_consensus.cc:2243] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:33.494330 17142 consensus_peers.cc:597] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 -> Peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Couldn't send request to peer 1364e853d9ea4df1950346fb170498b8. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.494356  9147 raft_consensus.cc:2272] T 75097aacc2fe4fd6be138902792ad16f P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.497778  9147 tablet_replica.cc:333] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.498714  9147 raft_consensus.cc:2243] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.499251  9147 raft_consensus.cc:2272] T 85ab0391bda54325b10799d23b44b332 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.501456  9147 tablet_replica.cc:333] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.502110  9147 raft_consensus.cc:2243] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.502665  9147 raft_consensus.cc:2272] T b01575d8b45646519b3c341e62c407f9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.504840  9147 tablet_replica.cc:333] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.505512  9147 raft_consensus.cc:2243] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.506433  9147 raft_consensus.cc:2272] T 926ebf63b80f401d9c985bd2905a1b65 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.508528  9147 tablet_replica.cc:333] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.509171  9147 raft_consensus.cc:2243] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.509999  9147 raft_consensus.cc:2272] T 28414584faaa415dab69430bf5735027 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.512564  9147 tablet_replica.cc:333] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.513475  9147 raft_consensus.cc:2243] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.514132  9147 raft_consensus.cc:2272] T 3fd80cd71cb14d5ba099ab44ff0a69ba P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.517172  9147 tablet_replica.cc:333] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.517916  9147 raft_consensus.cc:2243] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.518463  9147 raft_consensus.cc:2272] T 6d87f62879274a0ab4ec5951b7fe01a7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.521100  9147 tablet_replica.cc:333] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.521914  9147 raft_consensus.cc:2243] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.522523  9147 raft_consensus.cc:2272] T 6b8a7e0630e4439ca8abb6c40beeaa0d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.525430  9147 tablet_replica.cc:333] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.526336  9147 raft_consensus.cc:2243] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.526954  9147 raft_consensus.cc:2272] T 0ca94b47708e4c198ba2a3f085f3e6f7 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.529899  9147 tablet_replica.cc:333] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.530627  9147 raft_consensus.cc:2243] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.531284  9147 raft_consensus.cc:2272] T 855427fe4a17404c80344adfff8a420d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.533649  9147 tablet_replica.cc:333] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.534322  9147 raft_consensus.cc:2243] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.535161  9147 raft_consensus.cc:2272] T 1c4ba9ad373e446b82700a8a82294225 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.537616  9147 tablet_replica.cc:333] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.538466  9147 raft_consensus.cc:2243] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.539433  9147 raft_consensus.cc:2272] T 5a94f0c007bb449daa0dfd34bdf4222c P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.541519  9147 tablet_replica.cc:333] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.542110  9147 raft_consensus.cc:2243] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.542984  9147 raft_consensus.cc:2272] T e3d4b49dd94d4fa5bb066af8bd56d6e0 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.544972  9147 tablet_replica.cc:333] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.545524  9147 raft_consensus.cc:2243] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.546016  9147 raft_consensus.cc:2272] T 2155d9ece65f41eabe4ffb9dfd1671c3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.548022  9147 tablet_replica.cc:333] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.548579  9147 raft_consensus.cc:2243] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.549086  9147 raft_consensus.cc:2272] T 13b09204a1f749018e4e1531e3410d0d P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.551765  9147 tablet_replica.cc:333] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.552536  9147 raft_consensus.cc:2243] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.553578  9147 raft_consensus.cc:2272] T 17b25597e8e2479b9bf69918cf1c0a02 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.555711  9147 tablet_replica.cc:333] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.556246  9147 raft_consensus.cc:2243] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.556639  9147 raft_consensus.cc:2272] T 8397c824876e4947a125624f56c2501d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.558717  9147 tablet_replica.cc:333] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.559329  9147 raft_consensus.cc:2243] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.559758  9147 raft_consensus.cc:2272] T 41adc375fb524f19b4a65524c5f78041 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.561712  9147 tablet_replica.cc:333] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.562282  9147 raft_consensus.cc:2243] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.562705  9147 raft_consensus.cc:2272] T c40787f6c37c4588b30b9cac2233c0a3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.564682  9147 tablet_replica.cc:333] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.565182  9147 raft_consensus.cc:2243] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.565570  9147 raft_consensus.cc:2272] T af101ab31e994b5b9c841d81524c4e1b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.567920  9147 tablet_replica.cc:333] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.568660  9147 raft_consensus.cc:2243] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.569203  9147 raft_consensus.cc:2272] T 3a8311e3adec426caac0f0b50057d6d7 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.571617  9147 tablet_replica.cc:333] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.572417  9147 raft_consensus.cc:2243] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.572984  9147 raft_consensus.cc:2272] T 7f937b33484e46e090f4544fe372a5a9 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.573009 17216 consensus_peers.cc:597] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.575242  9147 tablet_replica.cc:333] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.575858  9147 raft_consensus.cc:2243] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.576339  9147 raft_consensus.cc:2272] T 359d72c1f10442b9819867ccdde73870 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.578475  9147 tablet_replica.cc:333] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.579061  9147 raft_consensus.cc:2243] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.579871  9147 raft_consensus.cc:2272] T c4f214fc5aac4e8d82b544d227421217 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.582204  9147 tablet_replica.cc:333] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.582935  9147 raft_consensus.cc:2243] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.583425  9147 raft_consensus.cc:2272] T 618435fe625b47de9afd290384ff676e P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.585979  9147 tablet_replica.cc:333] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.586669  9147 raft_consensus.cc:2243] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.587165  9147 raft_consensus.cc:2272] T f06adc55b95e4338b38e9323041f9eb7 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.589257  9147 tablet_replica.cc:333] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.589823  9147 raft_consensus.cc:2243] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.590785  9147 raft_consensus.cc:2272] T 50c639a326f04d8d8eed7bd41bc8df2b P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.593689  9147 tablet_replica.cc:333] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.594600  9147 raft_consensus.cc:2243] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.595199  9147 raft_consensus.cc:2272] T 86b2b5c741884596ad46b33b32c725d3 P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.598120  9147 tablet_replica.cc:333] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.598904  9147 raft_consensus.cc:2243] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.600056  9147 raft_consensus.cc:2272] T a1d7f3735ebc41f691fbce7d2c33ab12 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.603107  9147 tablet_replica.cc:333] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.603875  9147 raft_consensus.cc:2243] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.604579  9147 raft_consensus.cc:2272] T e7434c84892a4b8ba1c3985992fa5747 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.607679  9147 tablet_replica.cc:333] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.608358  9147 raft_consensus.cc:2243] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.609176  9147 raft_consensus.cc:2272] T 12efab3d68e44ec697cc29a3695960e4 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.612174  9147 tablet_replica.cc:333] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.613034  9147 raft_consensus.cc:2243] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.613633  9147 raft_consensus.cc:2272] T f5acc03bc88b41babf7cfbdf04fe0238 P 896fb6e3b27e4874a469245a7b103111 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.615084 17216 consensus_peers.cc:597] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.616613  9147 tablet_replica.cc:333] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.617525  9147 raft_consensus.cc:2243] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:33.617903 17216 consensus_peers.cc:597] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.618786  9147 raft_consensus.cc:2272] T 8712f3f0952b48d5b34d644bdfdc263d P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.621948  9147 tablet_replica.cc:333] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
W20260709 13:19:33.622776 17216 consensus_peers.cc:597] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.622843  9147 raft_consensus.cc:2243] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.624364  9147 raft_consensus.cc:2272] T 098e645055dd449c91b9fe4481f66aa6 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.627341  9147 tablet_replica.cc:333] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.628136  9147 raft_consensus.cc:2243] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.628799  9147 raft_consensus.cc:2272] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.631398  9147 tablet_replica.cc:333] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.632076  9147 raft_consensus.cc:2243] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.632916  9147 raft_consensus.cc:2272] T dcf71c3afe414daeb032d872c3c949c3 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.635502 17216 consensus_peers.cc:597] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.635660  9147 tablet_replica.cc:333] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.636453  9147 raft_consensus.cc:2243] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.636937  9147 raft_consensus.cc:2272] T 0f2ec9fe6964476aaa1dcb2b717a1660 P 896fb6e3b27e4874a469245a7b103111 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.639078  9147 tablet_replica.cc:333] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.639638  9147 raft_consensus.cc:2243] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.640134  9147 raft_consensus.cc:2272] T 00ba94e0be5f4a638535c8d9bb9211d3 P 896fb6e3b27e4874a469245a7b103111 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.642117  9147 tablet_replica.cc:333] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.642707  9147 raft_consensus.cc:2243] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.643569  9147 raft_consensus.cc:2272] T 41bb77fb0c0749f09d8c4bd783a3aa4b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.645608  9147 tablet_replica.cc:333] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111: stopping tablet replica
I20260709 13:19:33.646098  9147 raft_consensus.cc:2243] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.647030  9147 raft_consensus.cc:2272] T 08dbd048d2c24d53bb50081b63f1625b P 896fb6e3b27e4874a469245a7b103111 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.717027 18188 raft_consensus.cc:493] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:33.717667 18188 raft_consensus.cc:515] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:33.719074  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:19:33.719522 18188 leader_election.cc:290] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
W20260709 13:19:33.727231 17216 leader_election.cc:336] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:33.728327 17216 leader_election.cc:336] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111)
I20260709 13:19:33.728797 17216 leader_election.cc:304] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:33.729528 18188 raft_consensus.cc:2749] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:33.756863 17216 consensus_peers.cc:597] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.801577  9147 tablet_server.cc:179] TabletServer@127.8.238.196:0 shutting down...
I20260709 13:19:33.839433  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:33.840445  9147 tablet_replica.cc:333] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.841336  9147 raft_consensus.cc:2243] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.841964  9147 raft_consensus.cc:2272] T 5a94f0c007bb449daa0dfd34bdf4222c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.842268 17216 consensus_peers.cc:597] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.844264  9147 tablet_replica.cc:333] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.845010  9147 raft_consensus.cc:2243] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.845830  9147 raft_consensus.cc:2272] T bd0eff3471854a72a1357beeb5723b41 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.847788  9147 tablet_replica.cc:333] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.848367  9147 raft_consensus.cc:2243] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.848803  9147 raft_consensus.cc:2272] T cdb7c15929434ca0a9f7925722859adf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.851473  9147 tablet_replica.cc:333] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.852352  9147 raft_consensus.cc:2243] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.853029  9147 raft_consensus.cc:2272] T 6f6eedb2345347888597839f1da5742c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.856128  9147 tablet_replica.cc:333] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.857069  9147 raft_consensus.cc:2243] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.857615  9147 raft_consensus.cc:2272] T 1443c01c216f42078dc34c1c904e9bfa P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.860523  9147 tablet_replica.cc:333] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.861234  9147 raft_consensus.cc:2243] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.862280  9147 raft_consensus.cc:2272] T 6b8a7e0630e4439ca8abb6c40beeaa0d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.864559  9147 tablet_replica.cc:333] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.865188  9147 raft_consensus.cc:2243] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.866086  9147 raft_consensus.cc:2272] T 75097aacc2fe4fd6be138902792ad16f P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.868745  9147 tablet_replica.cc:333] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.869365  9147 raft_consensus.cc:2243] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.870289  9147 raft_consensus.cc:2272] T 570ac42568104f29ba5df81bb07d7683 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.871100 17216 consensus_peers.cc:597] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 -> Peer 896fb6e3b27e4874a469245a7b103111 (127.8.238.195:36971): Couldn't send request to peer 896fb6e3b27e4874a469245a7b103111. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.195:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.871726 18188 raft_consensus.cc:493] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:33.872291 18188 raft_consensus.cc:515] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:33.872867  9147 tablet_replica.cc:333] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.873726  9147 raft_consensus.cc:2243] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.874317  9147 raft_consensus.cc:2272] T 28414584faaa415dab69430bf5735027 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.874483 18188 leader_election.cc:290] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:33.877135  9147 tablet_replica.cc:333] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.877867  9147 raft_consensus.cc:2243] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:19:33.878619 17216 leader_election.cc:336] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
I20260709 13:19:33.878849  9147 raft_consensus.cc:2272] T 4749463a5f494207809283ca94150c73 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.879360 17216 leader_election.cc:336] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111)
I20260709 13:19:33.879748 17216 leader_election.cc:304] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
I20260709 13:19:33.880349 18188 raft_consensus.cc:2749] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:33.881675  9147 tablet_replica.cc:333] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.882369  9147 raft_consensus.cc:2243] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.883121  9147 raft_consensus.cc:2272] T 3fd80cd71cb14d5ba099ab44ff0a69ba P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.884997  9147 tablet_replica.cc:333] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.885489  9147 raft_consensus.cc:2243] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.886298  9147 raft_consensus.cc:2272] T 6d87f62879274a0ab4ec5951b7fe01a7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.888229  9147 tablet_replica.cc:333] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.888839  9147 raft_consensus.cc:2243] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.889328  9147 raft_consensus.cc:2272] T 9ebac26a00d94bbda935011611c3311c P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.891539  9147 tablet_replica.cc:333] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.892179  9147 raft_consensus.cc:2243] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.892658  9147 raft_consensus.cc:2272] T 12efab3d68e44ec697cc29a3695960e4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.894637  9147 tablet_replica.cc:333] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.895200  9147 raft_consensus.cc:2243] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.895646  9147 raft_consensus.cc:2272] T f5acc03bc88b41babf7cfbdf04fe0238 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.897504  9147 tablet_replica.cc:333] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.898072  9147 raft_consensus.cc:2243] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.898576  9147 raft_consensus.cc:2272] T 17b25597e8e2479b9bf69918cf1c0a02 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.900599  9147 tablet_replica.cc:333] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.901197  9147 raft_consensus.cc:2243] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.901650  9147 raft_consensus.cc:2272] T 855427fe4a17404c80344adfff8a420d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.903602  9147 tablet_replica.cc:333] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.904192  9147 raft_consensus.cc:2243] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.904711  9147 raft_consensus.cc:2272] T cd013d3d29734959949861700ba2f0bf P f75c7dc3c3f24e2e800d40d91f7311f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.906718  9147 tablet_replica.cc:333] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.907313  9147 raft_consensus.cc:2243] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.907735  9147 raft_consensus.cc:2272] T 41a0c88c5fa240e5a0cc957f5569c1f4 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.909643  9147 tablet_replica.cc:333] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.910281  9147 raft_consensus.cc:2243] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.910778  9147 raft_consensus.cc:2272] T 1c4ba9ad373e446b82700a8a82294225 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.913015  9147 tablet_replica.cc:333] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.913591  9147 raft_consensus.cc:2243] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.914068  9147 raft_consensus.cc:2272] T 8712f3f0952b48d5b34d644bdfdc263d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.916177  9147 tablet_replica.cc:333] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.916796  9147 raft_consensus.cc:2243] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.917241  9147 raft_consensus.cc:2272] T 098e645055dd449c91b9fe4481f66aa6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.919530  9147 tablet_replica.cc:333] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.920111  9147 raft_consensus.cc:2243] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.920958  9147 raft_consensus.cc:2272] T 85ab0391bda54325b10799d23b44b332 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.923045  9147 tablet_replica.cc:333] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.923631  9147 raft_consensus.cc:2243] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.924430  9147 raft_consensus.cc:2272] T 74f5191b11fd41debf2fb4c4422f4b8a P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.926499  9147 tablet_replica.cc:333] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.927063  9147 raft_consensus.cc:2243] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.927848  9147 raft_consensus.cc:2272] T 86b2b5c741884596ad46b33b32c725d3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.929978  9147 tablet_replica.cc:333] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.930608  9147 raft_consensus.cc:2243] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.931061  9147 raft_consensus.cc:2272] T 4c69155bc1714330b50c63899c8400fb P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.933396  9147 tablet_replica.cc:333] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.934007  9147 raft_consensus.cc:2243] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.934525  9147 raft_consensus.cc:2272] T 50c639a326f04d8d8eed7bd41bc8df2b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.936518  9147 tablet_replica.cc:333] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.937071  9147 raft_consensus.cc:2243] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.937537  9147 raft_consensus.cc:2272] T e31daec548cf48f6bedf21556ead46f6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.939688  9147 tablet_replica.cc:333] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.940256  9147 raft_consensus.cc:2243] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.940683  9147 raft_consensus.cc:2272] T a1d7f3735ebc41f691fbce7d2c33ab12 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.942579  9147 tablet_replica.cc:333] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.943104  9147 raft_consensus.cc:2243] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.943579  9147 raft_consensus.cc:2272] T 3d563c9ac0f54e16bdf8c304a05b0ee6 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.945614  9147 tablet_replica.cc:333] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.946156  9147 raft_consensus.cc:2243] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.946677  9147 raft_consensus.cc:2272] T dcf71c3afe414daeb032d872c3c949c3 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.948647  9147 tablet_replica.cc:333] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.949177  9147 raft_consensus.cc:2243] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.950030  9147 raft_consensus.cc:2272] T e7ff634467f042329ddeb7a8af515f56 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.952072  9147 tablet_replica.cc:333] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.952732  9147 raft_consensus.cc:2243] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.952585 18188 raft_consensus.cc:493] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 16794c032a6645e2b267583ad59c9572)
I20260709 13:19:33.953380  9147 raft_consensus.cc:2272] T 0f2ec9fe6964476aaa1dcb2b717a1660 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.953342 18188 raft_consensus.cc:515] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f75c7dc3c3f24e2e800d40d91f7311f4" member_type: VOTER last_known_addr { host: "127.8.238.196" port: 35033 } } peers { permanent_uuid: "16794c032a6645e2b267583ad59c9572" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 46481 } } peers { permanent_uuid: "1364e853d9ea4df1950346fb170498b8" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 38593 } }
I20260709 13:19:33.955272 18188 leader_election.cc:290] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481), 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593)
I20260709 13:19:33.956095  9147 tablet_replica.cc:333] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.956900  9147 raft_consensus.cc:2243] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.957574  9147 raft_consensus.cc:2272] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.959414 17216 leader_election.cc:336] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 16794c032a6645e2b267583ad59c9572 (127.8.238.193:46481): Network error: Client connection negotiation failed: client connection to 127.8.238.193:46481: connect: Connection refused (error 111)
W20260709 13:19:33.960168 17216 leader_election.cc:336] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1364e853d9ea4df1950346fb170498b8 (127.8.238.194:38593): Network error: Client connection negotiation failed: client connection to 127.8.238.194:38593: connect: Connection refused (error 111)
I20260709 13:19:33.960336  9147 tablet_replica.cc:333] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.960559 17216 leader_election.cc:304] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f75c7dc3c3f24e2e800d40d91f7311f4; no voters: 1364e853d9ea4df1950346fb170498b8, 16794c032a6645e2b267583ad59c9572
W20260709 13:19:33.961153 17216 raft_consensus.cc:2686] T 31001da831bd4090a480461096b888c5 P f75c7dc3c3f24e2e800d40d91f7311f4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:33.961189  9147 raft_consensus.cc:2243] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.961899  9147 raft_consensus.cc:2272] T 08dbd048d2c24d53bb50081b63f1625b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.963825  9147 tablet_replica.cc:333] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.964305  9147 raft_consensus.cc:2243] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.964665  9147 raft_consensus.cc:2272] T 8d22686aaba74b978f567f111d0cee28 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.966761  9147 tablet_replica.cc:333] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.967489  9147 raft_consensus.cc:2243] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.968309  9147 raft_consensus.cc:2272] T 8397c824876e4947a125624f56c2501d P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.970393  9147 tablet_replica.cc:333] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.971133  9147 raft_consensus.cc:2243] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.972060  9147 raft_consensus.cc:2272] T b01575d8b45646519b3c341e62c407f9 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.973909  9147 tablet_replica.cc:333] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.974462  9147 raft_consensus.cc:2243] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.974860  9147 raft_consensus.cc:2272] T 926ebf63b80f401d9c985bd2905a1b65 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.976814  9147 tablet_replica.cc:333] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.977265  9147 raft_consensus.cc:2243] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.977617  9147 raft_consensus.cc:2272] T 727d16a19f284201998350af3f7ebcdc P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.979400  9147 tablet_replica.cc:333] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.979872  9147 raft_consensus.cc:2243] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.980595  9147 raft_consensus.cc:2272] T af101ab31e994b5b9c841d81524c4e1b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.982431  9147 tablet_replica.cc:333] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.982854  9147 raft_consensus.cc:2243] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.983556  9147 raft_consensus.cc:2272] T 3a8311e3adec426caac0f0b50057d6d7 P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.985473  9147 tablet_replica.cc:333] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.985915  9147 raft_consensus.cc:2243] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.986405  9147 raft_consensus.cc:2272] T be5cb5807ca8471bab64797de2f9919b P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.988229  9147 tablet_replica.cc:333] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4: stopping tablet replica
I20260709 13:19:33.988637  9147 raft_consensus.cc:2243] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.988994  9147 raft_consensus.cc:2272] T 618435fe625b47de9afd290384ff676e P f75c7dc3c3f24e2e800d40d91f7311f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.055107  9147 tablet_server.cc:196] TabletServer@127.8.238.196:0 shutdown complete.
I20260709 13:19:34.118522  9147 master.cc:562] Master@127.8.238.254:34437 shutting down...
I20260709 13:19:34.143325  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.143908  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.144268  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P 93aeba2e37ba4851be7f4a4571bf4248: stopping tablet replica
I20260709 13:19:34.166193  9147 master.cc:584] Master@127.8.238.254:34437 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33621 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:19:34.272545  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:41099
I20260709 13:19:34.273689  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:34.279672 18195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:34.279842 18196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:34.280289 18198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:34.280941  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:34.282142  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:34.282411  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:34.282584  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603174282551 us; error 0 us; skew 500 ppm
I20260709 13:19:34.283140  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:34.285590  9147 webserver.cc:533] Webserver started at http://127.8.238.254:43415/ using document root <none> and password file <none>
I20260709 13:19:34.286118  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:34.286684  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:34.286988  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:34.288162  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "93959618b27d4bc98ba4d07a97c66041"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.292695  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:19:34.296178 18203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.296953  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:34.297294  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "93959618b27d4bc98ba4d07a97c66041"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.297740  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:34.312860  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:34.314167  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:34.354398  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:41099
I20260709 13:19:34.354497 18254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:41099 every 8 connection(s)
I20260709 13:19:34.358449 18255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.372391 18255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041: Bootstrap starting.
I20260709 13:19:34.377328 18255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:34.381711 18255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041: No bootstrap required, opened a new log
I20260709 13:19:34.384011 18255 raft_consensus.cc:359] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93959618b27d4bc98ba4d07a97c66041" member_type: VOTER }
I20260709 13:19:34.384420 18255 raft_consensus.cc:385] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:34.384603 18255 raft_consensus.cc:740] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93959618b27d4bc98ba4d07a97c66041, State: Initialized, Role: FOLLOWER
I20260709 13:19:34.385107 18255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93959618b27d4bc98ba4d07a97c66041" member_type: VOTER }
I20260709 13:19:34.385510 18255 raft_consensus.cc:399] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:34.385694 18255 raft_consensus.cc:493] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:34.385897 18255 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:34.390969 18255 raft_consensus.cc:515] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93959618b27d4bc98ba4d07a97c66041" member_type: VOTER }
I20260709 13:19:34.391501 18255 leader_election.cc:304] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93959618b27d4bc98ba4d07a97c66041; no voters: 
I20260709 13:19:34.392602 18255 leader_election.cc:290] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:34.392980 18258 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:34.394392 18258 raft_consensus.cc:697] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 1 LEADER]: Becoming Leader. State: Replica: 93959618b27d4bc98ba4d07a97c66041, State: Running, Role: LEADER
I20260709 13:19:34.395169 18258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93959618b27d4bc98ba4d07a97c66041" member_type: VOTER }
I20260709 13:19:34.395763 18255 sys_catalog.cc:565] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:34.400871 18260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93959618b27d4bc98ba4d07a97c66041. Latest consensus state: current_term: 1 leader_uuid: "93959618b27d4bc98ba4d07a97c66041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93959618b27d4bc98ba4d07a97c66041" member_type: VOTER } }
I20260709 13:19:34.401055 18259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93959618b27d4bc98ba4d07a97c66041" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93959618b27d4bc98ba4d07a97c66041" member_type: VOTER } }
I20260709 13:19:34.401969 18260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:34.402048 18259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:34.405524 18266 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:34.413641 18266 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:34.414849  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:34.423249 18266 catalog_manager.cc:1383] Generated new cluster ID: 6bd787fb78764925a995b3e262a222c8
I20260709 13:19:34.423555 18266 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:34.442951 18266 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:34.444268 18266 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:34.457844 18266 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041: Generated new TSK 0
I20260709 13:19:34.458527 18266 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:34.481494  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:34.488168 18276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:34.489027 18277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:34.490404 18279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:34.493568  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:34.494621  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:34.494817  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:34.494937  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603174494926 us; error 0 us; skew 500 ppm
I20260709 13:19:34.495426  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:34.497977  9147 webserver.cc:533] Webserver started at http://127.8.238.193:46057/ using document root <none> and password file <none>
I20260709 13:19:34.498514  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:34.498684  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:34.498907  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:34.499993  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "0b5cb61759da4b6c973379bd76a09480"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.504630  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:34.508085 18284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.508917  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:34.509270  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "0b5cb61759da4b6c973379bd76a09480"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.509624  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:34.521539  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:34.522938  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:34.524539  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:34.527000  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:34.527277  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.527549  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:34.527745  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.570536  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:36047
I20260709 13:19:34.570636 18346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:36047 every 8 connection(s)
I20260709 13:19:34.575829  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:34.584794 18351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:34.585198 18352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:34.591219 18347 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41099
I20260709 13:19:34.591786 18347 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:34.592890 18347 heartbeater.cc:507] Master 127.8.238.254:41099 requested a full tablet report, sending...
I20260709 13:19:34.595630 18220 ts_manager.cc:194] Registered new tserver with Master: 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047)
I20260709 13:19:34.598585 18220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35690
W20260709 13:19:34.599083 18354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:34.599743  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:34.601522  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:34.601809  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:34.601998  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603174601982 us; error 0 us; skew 500 ppm
I20260709 13:19:34.602587  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:34.604918  9147 webserver.cc:533] Webserver started at http://127.8.238.194:33455/ using document root <none> and password file <none>
I20260709 13:19:34.605368  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:34.605525  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:34.605835  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:34.607254  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "e09a79422e704bf78421f51f15b1f7bd"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.611881  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:19:34.615476 18359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.616307  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:34.616753  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "e09a79422e704bf78421f51f15b1f7bd"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.617219  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:34.638389  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:34.639644  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:34.641196  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:34.643592  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:34.643811  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.644061  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:34.644222  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.685693  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:34595
I20260709 13:19:34.685809 18421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:34595 every 8 connection(s)
I20260709 13:19:34.690786  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:34.697412 18425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:34.699812 18426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:34.701831  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:34.702280 18428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:34.703575  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:34.703831  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:34.704041  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603174704022 us; error 0 us; skew 500 ppm
I20260709 13:19:34.704676  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:34.704753 18422 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41099
I20260709 13:19:34.705147 18422 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:34.706162 18422 heartbeater.cc:507] Master 127.8.238.254:41099 requested a full tablet report, sending...
I20260709 13:19:34.707652  9147 webserver.cc:533] Webserver started at http://127.8.238.195:35655/ using document root <none> and password file <none>
I20260709 13:19:34.708240  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:34.708451  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:34.708514 18220 ts_manager.cc:194] Registered new tserver with Master: e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:34.708715  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:34.710039 18220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35698
I20260709 13:19:34.710062  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "3be76f1574b94f7bacfdb34a9608bffe"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.715288  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:34.718868 18433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.719792  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:34.720129  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "3be76f1574b94f7bacfdb34a9608bffe"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:34.720448  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:34.738493  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:34.739696  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:34.741174  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:34.743616  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:34.743863  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.744119  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:34.744292  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:34.786616  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:39083
I20260709 13:19:34.786702 18495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:39083 every 8 connection(s)
I20260709 13:19:34.801116 18496 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41099
I20260709 13:19:34.801579 18496 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:34.802368 18496 heartbeater.cc:507] Master 127.8.238.254:41099 requested a full tablet report, sending...
I20260709 13:19:34.804268 18220 ts_manager.cc:194] Registered new tserver with Master: 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:34.804693  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014748824s
I20260709 13:19:34.805670 18220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35706
I20260709 13:19:34.831311 18220 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35708:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:34.834331 18220 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:34.917934 18386 tablet_service.cc:1511] Processing CreateTablet for tablet 38048382cb4f496eb9a99f12507fc0e4 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:34.919589 18386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38048382cb4f496eb9a99f12507fc0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.919201 18387 tablet_service.cc:1511] Processing CreateTablet for tablet 412d3e75afeb4bd89dd2535f94de9348 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:34.921557 18387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d3e75afeb4bd89dd2535f94de9348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.921964 18383 tablet_service.cc:1511] Processing CreateTablet for tablet 7494b1c1d04a4b5f88ad35f55cef7dca (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:34.923651 18383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7494b1c1d04a4b5f88ad35f55cef7dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.921859 18384 tablet_service.cc:1511] Processing CreateTablet for tablet a88b108232984c39808091ebfd593d96 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:34.925173 18382 tablet_service.cc:1511] Processing CreateTablet for tablet 4482694754dc4beea49ddb55c7eb0e4e (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:34.925619 18384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88b108232984c39808091ebfd593d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.927071 18385 tablet_service.cc:1511] Processing CreateTablet for tablet 8102ebfff7204a4e8194f2317a78bce6 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:34.928191 18382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4482694754dc4beea49ddb55c7eb0e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.931452 18461 tablet_service.cc:1511] Processing CreateTablet for tablet 412d3e75afeb4bd89dd2535f94de9348 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:34.933045 18461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d3e75afeb4bd89dd2535f94de9348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.934619 18385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8102ebfff7204a4e8194f2317a78bce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.935499 18460 tablet_service.cc:1511] Processing CreateTablet for tablet 38048382cb4f496eb9a99f12507fc0e4 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:34.937171 18460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38048382cb4f496eb9a99f12507fc0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.939499 18459 tablet_service.cc:1511] Processing CreateTablet for tablet 8102ebfff7204a4e8194f2317a78bce6 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:34.941082 18459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8102ebfff7204a4e8194f2317a78bce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.943485 18458 tablet_service.cc:1511] Processing CreateTablet for tablet a88b108232984c39808091ebfd593d96 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:34.945009 18458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88b108232984c39808091ebfd593d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.947001 18457 tablet_service.cc:1511] Processing CreateTablet for tablet 7494b1c1d04a4b5f88ad35f55cef7dca (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:34.947156 18378 tablet_service.cc:1511] Processing CreateTablet for tablet ed1dd4cf91314e3fae31adfe759c88d7 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:34.947903 18456 tablet_service.cc:1511] Processing CreateTablet for tablet 4482694754dc4beea49ddb55c7eb0e4e (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:34.948638 18378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1dd4cf91314e3fae31adfe759c88d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.949579 18379 tablet_service.cc:1511] Processing CreateTablet for tablet c578f6e91b1d4e58aaf311a9b44e7995 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:34.950349 18380 tablet_service.cc:1511] Processing CreateTablet for tablet 22ffedf663e245809ad6654a30fad813 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:34.951109 18379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c578f6e91b1d4e58aaf311a9b44e7995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.952675 18381 tablet_service.cc:1511] Processing CreateTablet for tablet 683d3003003e4691a429683e921e244c (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:34.955947 18456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4482694754dc4beea49ddb55c7eb0e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.958626 18457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7494b1c1d04a4b5f88ad35f55cef7dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.960076 18455 tablet_service.cc:1511] Processing CreateTablet for tablet 683d3003003e4691a429683e921e244c (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:34.961675 18455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683d3003003e4691a429683e921e244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.954115 18381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683d3003003e4691a429683e921e244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.969350 18380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ffedf663e245809ad6654a30fad813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.980662 18454 tablet_service.cc:1511] Processing CreateTablet for tablet 22ffedf663e245809ad6654a30fad813 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:34.982156 18454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ffedf663e245809ad6654a30fad813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.995600 18452 tablet_service.cc:1511] Processing CreateTablet for tablet ed1dd4cf91314e3fae31adfe759c88d7 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:34.997188 18452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1dd4cf91314e3fae31adfe759c88d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.993876 18453 tablet_service.cc:1511] Processing CreateTablet for tablet c578f6e91b1d4e58aaf311a9b44e7995 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:35.001940 18453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c578f6e91b1d4e58aaf311a9b44e7995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.019248 18312 tablet_service.cc:1511] Processing CreateTablet for tablet 412d3e75afeb4bd89dd2535f94de9348 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:35.021515 18312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412d3e75afeb4bd89dd2535f94de9348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.024121 18311 tablet_service.cc:1511] Processing CreateTablet for tablet 38048382cb4f496eb9a99f12507fc0e4 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:35.028048 18310 tablet_service.cc:1511] Processing CreateTablet for tablet 8102ebfff7204a4e8194f2317a78bce6 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:35.031726 18309 tablet_service.cc:1511] Processing CreateTablet for tablet a88b108232984c39808091ebfd593d96 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:35.041618 18308 tablet_service.cc:1511] Processing CreateTablet for tablet 7494b1c1d04a4b5f88ad35f55cef7dca (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:35.044289 18311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38048382cb4f496eb9a99f12507fc0e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.045419 18308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7494b1c1d04a4b5f88ad35f55cef7dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.047523 18304 tablet_service.cc:1511] Processing CreateTablet for tablet c578f6e91b1d4e58aaf311a9b44e7995 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:35.048645 18310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8102ebfff7204a4e8194f2317a78bce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.045637 18305 tablet_service.cc:1511] Processing CreateTablet for tablet 22ffedf663e245809ad6654a30fad813 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:35.049827 18305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ffedf663e245809ad6654a30fad813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.050570 18309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88b108232984c39808091ebfd593d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.047757 18303 tablet_service.cc:1511] Processing CreateTablet for tablet ed1dd4cf91314e3fae31adfe759c88d7 (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:35.057155 18303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed1dd4cf91314e3fae31adfe759c88d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.039394 18306 tablet_service.cc:1511] Processing CreateTablet for tablet 683d3003003e4691a429683e921e244c (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:35.035889 18307 tablet_service.cc:1511] Processing CreateTablet for tablet 4482694754dc4beea49ddb55c7eb0e4e (DEFAULT_TABLE table=test-workload [id=15e8b56c29124809aa39641710c7fc64]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:35.062628 18304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c578f6e91b1d4e58aaf311a9b44e7995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.068536 18307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4482694754dc4beea49ddb55c7eb0e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.070688 18306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683d3003003e4691a429683e921e244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.089301 18511 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.140556 18512 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.155817 18511 tablet_bootstrap.cc:654] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.211469 18512 tablet_bootstrap.cc:654] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.244086 18513 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.247642 18511 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.248227 18511 ts_tablet_manager.cc:1403] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.159s	user 0.037s	sys 0.047s
I20260709 13:19:35.251910 18511 raft_consensus.cc:359] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.252812 18511 raft_consensus.cc:385] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.252970 18512 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.253230 18511 raft_consensus.cc:740] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.253645 18512 ts_tablet_manager.cc:1403] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.012s
I20260709 13:19:35.254079 18511 consensus_queue.cc:260] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.256811 18512 raft_consensus.cc:359] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.257686 18512 raft_consensus.cc:385] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.257990 18512 raft_consensus.cc:740] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.258910 18512 consensus_queue.cc:260] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.259711 18513 tablet_bootstrap.cc:654] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.264427 18422 heartbeater.cc:499] Master 127.8.238.254:41099 was elected leader, sending a full tablet report...
I20260709 13:19:35.264642 18511 ts_tablet_manager.cc:1434] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.012s
I20260709 13:19:35.265784 18511 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.272310 18511 tablet_bootstrap.cc:654] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.282166 18513 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.286454 18513 ts_tablet_manager.cc:1403] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.000s
I20260709 13:19:35.291206 18517 raft_consensus.cc:493] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.292032 18512 ts_tablet_manager.cc:1434] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.038s	user 0.019s	sys 0.019s
I20260709 13:19:35.291815 18517 raft_consensus.cc:515] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.294324 18517 leader_election.cc:290] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:35.295084 18496 heartbeater.cc:499] Master 127.8.238.254:41099 was elected leader, sending a full tablet report...
I20260709 13:19:35.303978 18513 raft_consensus.cc:359] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.304898 18513 raft_consensus.cc:385] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.305214 18513 raft_consensus.cc:740] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.305287 18511 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.305747 18512 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.305984 18511 ts_tablet_manager.cc:1403] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.016s
I20260709 13:19:35.313545 18511 raft_consensus.cc:359] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.306057 18513 consensus_queue.cc:260] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.314484 18511 raft_consensus.cc:385] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.316107 18511 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.317123 18511 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.319118 18512 tablet_bootstrap.cc:654] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.319645 18511 ts_tablet_manager.cc:1434] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:35.320948 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:35.322492 18511 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
W20260709 13:19:35.323103 18436 leader_election.cc:343] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.326287 18397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.327723 18347 heartbeater.cc:499] Master 127.8.238.254:41099 was elected leader, sending a full tablet report...
W20260709 13:19:35.328002 18436 leader_election.cc:343] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.328594 18436 leader_election.cc:304] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe; no voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:35.329627 18519 raft_consensus.cc:2749] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:35.331578 18512 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.332093 18511 tablet_bootstrap.cc:654] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.332202 18512 ts_tablet_manager.cc:1403] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:19:35.336093 18512 raft_consensus.cc:359] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.337208 18512 raft_consensus.cc:385] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.337453 18516 raft_consensus.cc:493] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.337648 18512 raft_consensus.cc:740] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.338138 18516 raft_consensus.cc:515] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.339072 18512 consensus_queue.cc:260] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.342263 18512 ts_tablet_manager.cc:1434] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:35.343662 18512 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.351666 18516 leader_election.cc:290] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.352964 18512 tablet_bootstrap.cc:654] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.357581 18513 ts_tablet_manager.cc:1434] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:19:35.358954 18513 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.367031 18513 tablet_bootstrap.cc:654] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.367264 18512 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.368031 18512 ts_tablet_manager.cc:1403] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 13:19:35.372296 18512 raft_consensus.cc:359] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.373332 18512 raft_consensus.cc:385] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.373713 18512 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.374926 18512 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.378937 18512 ts_tablet_manager.cc:1434] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:19:35.380546 18512 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.381940 18513 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.382660 18513 ts_tablet_manager.cc:1403] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 13:19:35.386037 18513 raft_consensus.cc:359] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.386956 18513 raft_consensus.cc:385] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.387311 18513 raft_consensus.cc:740] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.390399 18512 tablet_bootstrap.cc:654] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.403654 18513 consensus_queue.cc:260] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.406526 18512 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.407351 18512 ts_tablet_manager.cc:1403] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 13:19:35.406661 18513 ts_tablet_manager.cc:1434] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
W20260709 13:19:35.407788 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:35.408597 18513 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.406615 18516 raft_consensus.cc:493] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.409879 18516 raft_consensus.cc:515] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.410697 18511 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.410538 18512 raft_consensus.cc:359] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.411404 18512 raft_consensus.cc:385] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.411404 18511 ts_tablet_manager.cc:1403] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.089s	user 0.030s	sys 0.052s
I20260709 13:19:35.411885 18512 raft_consensus.cc:740] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.412243 18516 leader_election.cc:290] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.412864 18512 consensus_queue.cc:260] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.415077 18511 raft_consensus.cc:359] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.415934 18511 raft_consensus.cc:385] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.416074 18513 tablet_bootstrap.cc:654] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.416356 18511 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.417379 18511 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.418421 18512 ts_tablet_manager.cc:1434] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:19:35.419559 18512 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.420001 18511 ts_tablet_manager.cc:1434] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:35.421111 18511 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.426457 18512 tablet_bootstrap.cc:654] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.430579 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:35.431285 18511 tablet_bootstrap.cc:654] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.432206 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
W20260709 13:19:35.434800 18362 leader_election.cc:343] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:35.435809 18362 leader_election.cc:343] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.438838 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.439939 18471 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
W20260709 13:19:35.440354 18423 tablet.cc:2406] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:35.440790 18512 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.441598 18512 ts_tablet_manager.cc:1403] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 13:19:35.443142 18522 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.443926 18522 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.446817 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.445930 18512 raft_consensus.cc:359] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.447832 18471 raft_consensus.cc:2468] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:35.448252 18512 raft_consensus.cc:385] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.448661 18512 raft_consensus.cc:740] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.449457 18511 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.449584 18512 consensus_queue.cc:260] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.450270 18511 ts_tablet_manager.cc:1403] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 13:19:35.453665 18511 raft_consensus.cc:359] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.454577 18511 raft_consensus.cc:385] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.454962 18511 raft_consensus.cc:740] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.455866 18511 consensus_queue.cc:260] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.458609 18511 ts_tablet_manager.cc:1434] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:35.459173 18522 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.459744 18512 ts_tablet_manager.cc:1434] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:19:35.459862 18511 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.441768 18363 leader_election.cc:304] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:35.463233 18516 raft_consensus.cc:2804] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.463636 18516 raft_consensus.cc:493] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.463973 18516 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.468547 18512 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.470100 18511 tablet_bootstrap.cc:654] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.476276 18512 tablet_bootstrap.cc:654] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.475485 18363 leader_election.cc:304] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:35.481204 18536 raft_consensus.cc:2804] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.482759 18536 raft_consensus.cc:493] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.483855 18536 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.494572 18511 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.495616 18511 ts_tablet_manager.cc:1403] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.006s
I20260709 13:19:35.498065 18516 raft_consensus.cc:515] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.503058 18512 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.501799 18511 raft_consensus.cc:359] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.503736 18512 ts_tablet_manager.cc:1403] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.012s
I20260709 13:19:35.504032 18511 raft_consensus.cc:385] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.504467 18511 raft_consensus.cc:740] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.507063 18512 raft_consensus.cc:359] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.508908 18512 raft_consensus.cc:385] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.509248 18512 raft_consensus.cc:740] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.510192 18512 consensus_queue.cc:260] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.509588 18511 consensus_queue.cc:260] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.511768 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.508054 18536 raft_consensus.cc:515] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.513085 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.512444 18471 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.515039 18536 leader_election.cc:290] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.519739 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.520502 18470 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.522523 18512 ts_tablet_manager.cc:1434] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:19:35.526654 18522 raft_consensus.cc:493] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.527271 18522 raft_consensus.cc:515] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.528046 18512 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.529486 18522 leader_election.cc:290] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
W20260709 13:19:35.530730 18362 leader_election.cc:343] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.531594 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.532162 18471 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:35.533269 18516 leader_election.cc:290] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.536430 18363 leader_election.cc:304] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:35.537467 18512 tablet_bootstrap.cc:654] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.537825 18516 raft_consensus.cc:2804] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.538393 18513 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.538936 18513 ts_tablet_manager.cc:1403] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.131s	user 0.035s	sys 0.045s
I20260709 13:19:35.540571 18470 raft_consensus.cc:2468] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:35.538447 18516 raft_consensus.cc:697] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:35.542075 18513 raft_consensus.cc:359] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.542901 18513 raft_consensus.cc:385] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.542678 18516 consensus_queue.cc:237] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.544623 18363 leader_election.cc:304] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
W20260709 13:19:35.545799 18362 leader_election.cc:343] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.543200 18513 raft_consensus.cc:740] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.547050 18511 ts_tablet_manager.cc:1434] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.051s	user 0.019s	sys 0.015s
I20260709 13:19:35.545954 18538 raft_consensus.cc:2804] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.548139 18538 raft_consensus.cc:697] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:35.548758 18513 consensus_queue.cc:260] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.549414 18538 consensus_queue.cc:237] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.548436 18511 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.555868 18397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.556631 18397 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 0.
I20260709 13:19:35.557319 18512 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.557823 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.558177 18512 ts_tablet_manager.cc:1403] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:19:35.559852 18287 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:35.565042 18511 tablet_bootstrap.cc:654] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.565527 18512 raft_consensus.cc:359] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.566368 18512 raft_consensus.cc:385] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.566651 18512 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
W20260709 13:19:35.568957 18287 leader_election.cc:343] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.568814 18218 catalog_manager.cc:5697] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 1 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.569933 18522 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.570547 18522 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.571003 18522 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.576885 18512 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.584059 18513 ts_tablet_manager.cc:1434] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:19:35.584043 18512 ts_tablet_manager.cc:1434] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:19:35.585778 18512 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.589500 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.590590 18470 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 0.
I20260709 13:19:35.592108 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.592993 18512 tablet_bootstrap.cc:654] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:35.594709 18288 leader_election.cc:343] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.595261 18288 leader_election.cc:304] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480; no voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:35.596307 18511 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.597534 18545 raft_consensus.cc:2749] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:35.596879 18511 ts_tablet_manager.cc:1403] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260709 13:19:35.602221 18522 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.603717 18511 raft_consensus.cc:359] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.604550 18522 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 election: Requested vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.605866 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:35.606532 18396 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.606879 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.607532 18471 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.605885 18513 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.615373 18471 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 1.
I20260709 13:19:35.604571 18511 raft_consensus.cc:385] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.616901 18511 raft_consensus.cc:740] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.617514 18512 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.618070 18512 ts_tablet_manager.cc:1403] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:19:35.617746 18511 consensus_queue.cc:260] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.620546 18511 ts_tablet_manager.cc:1434] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:19:35.621166 18512 raft_consensus.cc:359] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.621608 18511 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.620900 18219 catalog_manager.cc:5697] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 1 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.622007 18512 raft_consensus.cc:385] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.622916 18288 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:35.623374 18512 raft_consensus.cc:740] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.623936 18522 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.624269 18512 consensus_queue.cc:260] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.626631 18513 tablet_bootstrap.cc:654] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.629031 18511 tablet_bootstrap.cc:654] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.631464 18522 raft_consensus.cc:697] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Running, Role: LEADER
I20260709 13:19:35.632738 18522 consensus_queue.cc:237] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.635308 18512 ts_tablet_manager.cc:1434] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:35.636626 18512 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.638976 18513 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.639757 18513 ts_tablet_manager.cc:1403] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.003s
I20260709 13:19:35.643190 18513 raft_consensus.cc:359] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.645378 18513 raft_consensus.cc:385] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.645929 18513 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.646870 18511 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.647483 18511 ts_tablet_manager.cc:1403] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 13:19:35.644740 18512 tablet_bootstrap.cc:654] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.650906 18511 raft_consensus.cc:359] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.651728 18511 raft_consensus.cc:385] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.652056 18511 raft_consensus.cc:740] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.647348 18513 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.652992 18511 consensus_queue.cc:260] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.655584 18511 ts_tablet_manager.cc:1434] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:35.656682 18511 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.656884 18513 ts_tablet_manager.cc:1434] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:19:35.658205 18513 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.615373 18396 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 1.
I20260709 13:19:35.660264 18217 catalog_manager.cc:5697] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "0b5cb61759da4b6c973379bd76a09480" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.663339 18511 tablet_bootstrap.cc:654] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.665720 18513 tablet_bootstrap.cc:654] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.669711 18512 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.670606 18512 ts_tablet_manager.cc:1403] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 13:19:35.674381 18512 raft_consensus.cc:359] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.675282 18512 raft_consensus.cc:385] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.675588 18512 raft_consensus.cc:740] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.676401 18512 consensus_queue.cc:260] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.677989 18513 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.678592 18513 ts_tablet_manager.cc:1403] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 13:19:35.678809 18512 ts_tablet_manager.cc:1434] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:35.679885 18512 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe: Bootstrap starting.
I20260709 13:19:35.681630 18513 raft_consensus.cc:359] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.682447 18513 raft_consensus.cc:385] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.682790 18513 raft_consensus.cc:740] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.683881 18513 consensus_queue.cc:260] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.685808 18512 tablet_bootstrap.cc:654] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.686519 18513 ts_tablet_manager.cc:1434] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:19:35.687742 18513 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.690634 18519 raft_consensus.cc:493] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.691268 18519 raft_consensus.cc:515] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.693846 18519 leader_election.cc:290] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:35.694765 18513 tablet_bootstrap.cc:654] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.700172 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7494b1c1d04a4b5f88ad35f55cef7dca" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:35.701179 18321 raft_consensus.cc:2468] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 0.
I20260709 13:19:35.703130 18436 leader_election.cc:304] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:35.704496 18517 raft_consensus.cc:2804] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.705016 18517 raft_consensus.cc:493] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.705511 18517 raft_consensus.cc:3060] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.712430 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7494b1c1d04a4b5f88ad35f55cef7dca" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
W20260709 13:19:35.714669 18436 leader_election.cc:343] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.718475 18538 raft_consensus.cc:493] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.719368 18538 raft_consensus.cc:515] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.724774 18538 leader_election.cc:290] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.725986 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
W20260709 13:19:35.728374 18362 leader_election.cc:343] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.729512 18516 raft_consensus.cc:493] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.730183 18516 raft_consensus.cc:515] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.733119 18511 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.733225 18516 leader_election.cc:290] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.733700 18511 ts_tablet_manager.cc:1403] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.051s
I20260709 13:19:35.734072 18516 raft_consensus.cc:493] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.735783 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:35.735914 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.736595 18322 raft_consensus.cc:2468] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:35.736508 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.736690 18471 raft_consensus.cc:2468] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:35.734572 18516 raft_consensus.cc:515] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.738473 18511 raft_consensus.cc:359] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.739283 18511 raft_consensus.cc:385] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.739601 18511 raft_consensus.cc:740] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.739385 18517 raft_consensus.cc:515] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.738526 18362 leader_election.cc:304] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
W20260709 13:19:35.741931 18363 leader_election.cc:343] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.742116 18516 leader_election.cc:290] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.745247 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7494b1c1d04a4b5f88ad35f55cef7dca" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.746176 18363 leader_election.cc:304] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:35.746829 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.747844 18471 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:35.748117 18538 raft_consensus.cc:2804] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.748771 18538 raft_consensus.cc:493] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.749105 18516 raft_consensus.cc:2804] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.746301 18322 raft_consensus.cc:3060] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.749886 18516 raft_consensus.cc:493] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.753343 18516 raft_consensus.cc:3060] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.749248 18538 raft_consensus.cc:3060] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.740458 18511 consensus_queue.cc:260] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.759855 18511 ts_tablet_manager.cc:1434] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:19:35.771600 18511 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.788336 18512 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe: No bootstrap required, opened a new log
I20260709 13:19:35.789161 18512 ts_tablet_manager.cc:1403] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.001s
I20260709 13:19:35.792773 18517 leader_election.cc:290] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
W20260709 13:19:35.793748 18362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:36047, user_credentials={real_user=slave}} blocked reactor thread for 55321.8us
I20260709 13:19:35.794437 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7494b1c1d04a4b5f88ad35f55cef7dca" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:35.799172 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
W20260709 13:19:35.800052 18436 leader_election.cc:343] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.800123 18321 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:35.801568 18511 tablet_bootstrap.cc:654] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.794760 18363 leader_election.cc:304] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:35.802955 18536 raft_consensus.cc:2804] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.803347 18536 raft_consensus.cc:493] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.803709 18536 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.804759 18512 raft_consensus.cc:359] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.805733 18512 raft_consensus.cc:385] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.806015 18512 raft_consensus.cc:740] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.806942 18512 consensus_queue.cc:260] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.810734 18513 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.811890 18512 ts_tablet_manager.cc:1434] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 13:19:35.812320 18536 raft_consensus.cc:515] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.812995 18513 ts_tablet_manager.cc:1403] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.126s	user 0.047s	sys 0.050s
I20260709 13:19:35.815611 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.816015 18322 raft_consensus.cc:2468] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 1.
I20260709 13:19:35.816269 18321 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.816864 18513 raft_consensus.cc:359] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.817571 18513 raft_consensus.cc:385] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.817772 18513 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.818441 18513 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.819041 18436 leader_election.cc:304] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:35.819965 18517 raft_consensus.cc:2804] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.820453 18517 raft_consensus.cc:697] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:35.820809 18513 ts_tablet_manager.cc:1434] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:35.821329 18517 consensus_queue.cc:237] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.827570 18513 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.829818 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.830608 18471 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.838766 18471 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:35.841203 18519 raft_consensus.cc:493] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.841786 18519 raft_consensus.cc:515] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.842296 18513 tablet_bootstrap.cc:654] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.842062 18363 leader_election.cc:304] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:35.839428 18536 leader_election.cc:290] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.843650 18536 raft_consensus.cc:2804] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.844202 18519 leader_election.cc:290] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:35.844424 18536 raft_consensus.cc:697] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:35.846694 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:35.847671 18322 raft_consensus.cc:2468] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 0.
I20260709 13:19:35.846412 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.840595 18321 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:35.847728 18516 raft_consensus.cc:515] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.845618 18538 raft_consensus.cc:515] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.848042 18536 consensus_queue.cc:237] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.851101 18396 raft_consensus.cc:2393] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3be76f1574b94f7bacfdb34a9608bffe in current term 1: Already voted for candidate e09a79422e704bf78421f51f15b1f7bd in this term.
I20260709 13:19:35.854287 18511 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.854808 18511 ts_tablet_manager.cc:1403] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.018s
I20260709 13:19:35.854619 18522 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.852075 18516 leader_election.cc:290] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.855432 18522 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.857873 18511 raft_consensus.cc:359] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.858909 18511 raft_consensus.cc:385] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.859287 18511 raft_consensus.cc:740] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.860108 18511 consensus_queue.cc:260] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.861332 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.862499 18511 ts_tablet_manager.cc:1434] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:35.853117 18320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.862957 18522 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.862366 18396 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 0.
I20260709 13:19:35.852528 18436 leader_election.cc:304] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:35.863132 18320 raft_consensus.cc:3060] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.865248 18519 raft_consensus.cc:2804] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.865516 18538 leader_election.cc:290] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.865792 18519 raft_consensus.cc:493] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.866263 18519 raft_consensus.cc:3060] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.866741 18511 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd: Bootstrap starting.
I20260709 13:19:35.871004 18287 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:35.872087 18522 raft_consensus.cc:2804] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.872664 18522 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.873148 18522 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.877717 18511 tablet_bootstrap.cc:654] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.878804 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.879810 18471 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 0.
I20260709 13:19:35.879396 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.881672 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.877637 18320 raft_consensus.cc:2468] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
W20260709 13:19:35.883008 18362 leader_election.cc:343] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.883755 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.884763 18469 raft_consensus.cc:3060] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.883886 18362 leader_election.cc:304] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:35.891453 18558 raft_consensus.cc:2804] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.892539 18558 raft_consensus.cc:697] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:35.895902 18558 consensus_queue.cc:237] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.897054 18469 raft_consensus.cc:2468] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:35.901737 18363 leader_election.cc:304] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:35.900018 18513 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:35.902745 18538 raft_consensus.cc:2804] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.903419 18538 raft_consensus.cc:697] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:35.903453 18513 ts_tablet_manager.cc:1403] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.030s
I20260709 13:19:35.904354 18538 consensus_queue.cc:237] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.904552 18217 catalog_manager.cc:5697] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 1 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.907946 18513 raft_consensus.cc:359] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.913285 18513 raft_consensus.cc:385] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.913630 18513 raft_consensus.cc:740] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.914255 18511 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd: No bootstrap required, opened a new log
I20260709 13:19:35.914862 18511 ts_tablet_manager.cc:1403] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.014s
I20260709 13:19:35.914486 18513 consensus_queue.cc:260] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.916894 18513 ts_tablet_manager.cc:1434] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:35.917960 18511 raft_consensus.cc:359] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.919422 18511 raft_consensus.cc:385] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:35.919883 18511 raft_consensus.cc:740] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:35.921047 18511 consensus_queue.cc:260] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.923699 18522 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.924664 18511 ts_tablet_manager.cc:1434] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:35.917980 18513 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:35.926815 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:35.927477 18396 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.935587 18513 tablet_bootstrap.cc:654] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:35.936050 18517 raft_consensus.cc:493] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.941306 18516 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:35.942952 18519 raft_consensus.cc:515] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.944289 18470 raft_consensus.cc:2393] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e09a79422e704bf78421f51f15b1f7bd in current term 1: Already voted for candidate 3be76f1574b94f7bacfdb34a9608bffe in this term.
I20260709 13:19:35.946158 18519 leader_election.cc:290] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:35.948642 18470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:35.949317 18470 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.956213 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:35.956918 18470 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 1.
I20260709 13:19:35.957139 18321 raft_consensus.cc:2393] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3be76f1574b94f7bacfdb34a9608bffe in current term 1: Already voted for candidate e09a79422e704bf78421f51f15b1f7bd in this term.
I20260709 13:19:35.957722 18397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed1dd4cf91314e3fae31adfe759c88d7" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:35.957947 18522 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 election: Requested vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.960209 18436 leader_election.cc:304] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe; no voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:35.960489 18288 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:35.961059 18519 raft_consensus.cc:2749] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:35.961802 18522 raft_consensus.cc:2804] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:35.962499 18522 raft_consensus.cc:697] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 LEADER]: Becoming Leader. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Running, Role: LEADER
I20260709 13:19:35.962805 18517 raft_consensus.cc:515] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.963697 18522 consensus_queue.cc:237] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.965994 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:35.967741 18545 raft_consensus.cc:493] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.968094 18436 leader_election.cc:343] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:35.968453 18545 raft_consensus.cc:515] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:35.969823 18517 leader_election.cc:290] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:35.971581 18545 leader_election.cc:290] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:35.972610 18397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.976439 18397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:35.977137 18397 raft_consensus.cc:2468] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 0.
I20260709 13:19:35.978619 18436 leader_election.cc:304] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:35.980015 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:35.981557 18288 leader_election.cc:304] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480; no voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:35.982831 18545 raft_consensus.cc:2749] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:35.935472 18396 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b5cb61759da4b6c973379bd76a09480 in term 1.
I20260709 13:19:35.985812 18517 raft_consensus.cc:2804] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:35.986297 18517 raft_consensus.cc:493] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.986639 18517 raft_consensus.cc:3060] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:35.991920 18217 catalog_manager.cc:5697] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 1 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.006496 18517 raft_consensus.cc:515] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.009716 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:36.009868 18320 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.009896 18513 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:36.010738 18513 ts_tablet_manager.cc:1403] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.093s	user 0.046s	sys 0.032s
I20260709 13:19:36.009750 18517 leader_election.cc:290] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:36.013440 18513 raft_consensus.cc:359] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.014384 18513 raft_consensus.cc:385] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:36.014676 18513 raft_consensus.cc:740] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:36.015136 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:36.015372 18513 consensus_queue.cc:260] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.017827 18513 ts_tablet_manager.cc:1434] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:36.015859 18396 raft_consensus.cc:3060] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:36.017977 18436 leader_election.cc:343] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:36.018822 18513 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
W20260709 13:19:36.022738 18362 consensus_peers.cc:597] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.025775 18396 raft_consensus.cc:2468] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 1.
I20260709 13:19:36.027245 18436 leader_election.cc:304] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:36.027350 18217 catalog_manager.cc:5697] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 1 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.028555 18517 raft_consensus.cc:2804] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:36.024928 18216 catalog_manager.cc:5697] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "0b5cb61759da4b6c973379bd76a09480" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.029100 18513 tablet_bootstrap.cc:654] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:36.029275 18558 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:36.030262 18217 catalog_manager.cc:5697] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 1 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.029109 18517 raft_consensus.cc:697] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:36.044639 18517 consensus_queue.cc:237] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.071856 18513 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:36.072531 18513 ts_tablet_manager.cc:1403] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.022s
I20260709 13:19:36.073521 18216 catalog_manager.cc:5697] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 0 to 1, leader changed from <none> to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 1 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.075470 18513 raft_consensus.cc:359] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.076234 18513 raft_consensus.cc:385] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:36.076493 18513 raft_consensus.cc:740] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:36.077270 18513 consensus_queue.cc:260] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.079380 18513 ts_tablet_manager.cc:1434] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:36.080345 18513 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:36.085731 18513 tablet_bootstrap.cc:654] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:36.090775 18513 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: No bootstrap required, opened a new log
I20260709 13:19:36.091293 18513 ts_tablet_manager.cc:1403] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:19:36.094050 18513 raft_consensus.cc:359] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.094790 18513 raft_consensus.cc:385] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:36.095072 18513 raft_consensus.cc:740] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:36.095590 18522 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:36.095773 18513 consensus_queue.cc:260] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.098580 18513 ts_tablet_manager.cc:1434] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:36.110951 18522 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.115798 18558 consensus_queue.cc:1048] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.151472 18522 raft_consensus.cc:493] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.151958 18522 raft_consensus.cc:515] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.153672 18522 leader_election.cc:290] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:36.154529 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:36.154682 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:36.155305 18396 raft_consensus.cc:2393] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b5cb61759da4b6c973379bd76a09480 in current term 1: Already voted for candidate 3be76f1574b94f7bacfdb34a9608bffe in this term.
I20260709 13:19:36.156256 18287 leader_election.cc:304] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480; no voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:36.156929 18522 raft_consensus.cc:3060] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.161989 18522 raft_consensus.cc:2749] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:36.167322 18522 raft_consensus.cc:493] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.167774 18522 raft_consensus.cc:515] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.169432 18522 leader_election.cc:290] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:36.170473 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:36.170497 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:36.171991 18288 leader_election.cc:304] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480; no voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:36.172698 18522 raft_consensus.cc:2749] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:36.189968 18538 raft_consensus.cc:493] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.190631 18538 raft_consensus.cc:515] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.192310 18538 leader_election.cc:290] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:36.193257 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:36.193344 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:36.194262 18321 raft_consensus.cc:2468] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:36.194366 18471 raft_consensus.cc:2468] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 0.
I20260709 13:19:36.195328 18362 leader_election.cc:304] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:36.196049 18538 raft_consensus.cc:2804] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:36.196405 18538 raft_consensus.cc:493] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.196642 18538 raft_consensus.cc:3060] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.202055 18538 raft_consensus.cc:515] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.203742 18538 leader_election.cc:290] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:36.204646 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:36.204901 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:36.205248 18321 raft_consensus.cc:3060] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.205600 18471 raft_consensus.cc:3060] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.211522 18321 raft_consensus.cc:2468] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:36.211680 18471 raft_consensus.cc:2468] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:36.212808 18362 leader_election.cc:304] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:36.213524 18538 raft_consensus.cc:2804] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:36.213963 18538 raft_consensus.cc:697] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:36.214820 18538 consensus_queue.cc:237] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.222102 18216 catalog_manager.cc:5697] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 0 to 1, leader changed from <none> to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 1 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:36.242022 18538 raft_consensus.cc:493] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.242676 18538 raft_consensus.cc:515] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.244362 18517 consensus_queue.cc:1048] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.245608 18538 leader_election.cc:290] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:36.245484 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7494b1c1d04a4b5f88ad35f55cef7dca" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b5cb61759da4b6c973379bd76a09480" is_pre_election: true
I20260709 13:19:36.245846 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7494b1c1d04a4b5f88ad35f55cef7dca" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:36.246662 18321 raft_consensus.cc:2393] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e09a79422e704bf78421f51f15b1f7bd in current term 1: Already voted for candidate 3be76f1574b94f7bacfdb34a9608bffe in this term.
I20260709 13:19:36.247702 18362 leader_election.cc:304] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:36.248519 18538 raft_consensus.cc:3060] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.258370 18538 raft_consensus.cc:2749] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:36.262360 18579 consensus_queue.cc:1048] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.340662 18536 consensus_queue.cc:1048] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.342931 18522 raft_consensus.cc:493] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.343536 18522 raft_consensus.cc:515] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:36.345822 18522 leader_election.cc:290] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:36.345093 18538 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:36.346959 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:36.348065 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:36.349705 18287 leader_election.cc:304] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480; no voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:36.351066 18522 raft_consensus.cc:2749] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:36.353781 18320 raft_consensus.cc:3060] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:36.362761 18545 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:36.368052 18538 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.375032 18536 consensus_queue.cc:1048] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:36.394925 18545 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.405479  9147 ts_manager.cc:295] Set tserver state for 0b5cb61759da4b6c973379bd76a09480 to MAINTENANCE_MODE
I20260709 13:19:36.406468  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
W20260709 13:19:36.408931 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:36.437222  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:36.438156  9147 tablet_replica.cc:333] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.438905  9147 raft_consensus.cc:2243] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.439268  9147 raft_consensus.cc:2272] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.441483  9147 tablet_replica.cc:333] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.442024  9147 raft_consensus.cc:2243] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.442469  9147 raft_consensus.cc:2272] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.444484  9147 tablet_replica.cc:333] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.445004  9147 raft_consensus.cc:2243] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.445355  9147 raft_consensus.cc:2272] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.447619  9147 tablet_replica.cc:333] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.448160  9147 raft_consensus.cc:2243] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.448523  9147 raft_consensus.cc:2272] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.450726  9147 tablet_replica.cc:333] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.451249  9147 raft_consensus.cc:2243] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.451659  9147 raft_consensus.cc:2272] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.454111  9147 tablet_replica.cc:333] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.454761  9147 raft_consensus.cc:2243] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.455840  9147 raft_consensus.cc:2272] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:36.456308 18436 consensus_peers.cc:597] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.458091  9147 tablet_replica.cc:333] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.458837  9147 raft_consensus.cc:2243] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.459795  9147 raft_consensus.cc:2272] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.462837  9147 tablet_replica.cc:333] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.462934 18538 consensus_queue.cc:1048] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.463642  9147 raft_consensus.cc:2243] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.464193  9147 raft_consensus.cc:2272] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.464573 18579 consensus_queue.cc:1048] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:36.466773  9147 tablet_replica.cc:333] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.467571  9147 raft_consensus.cc:2243] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.468073  9147 raft_consensus.cc:2272] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.471684  9147 tablet_replica.cc:333] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: stopping tablet replica
I20260709 13:19:36.472324  9147 raft_consensus.cc:2243] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.472827  9147 raft_consensus.cc:2272] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.502556  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
W20260709 13:19:36.506191 18362 consensus_peers.cc:597] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.526072 18362 consensus_peers.cc:597] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.666744 18436 consensus_peers.cc:597] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.759948 18362 consensus_peers.cc:597] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.760437 18362 consensus_peers.cc:597] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.787123 18558 consensus_queue.cc:1048] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:36.799993 18362 consensus_peers.cc:597] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.410068 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:37.611055 18558 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
I20260709 13:19:37.611574 18558 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.613201 18558 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:37.614465 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
W20260709 13:19:37.614785 18362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111) [suppressed 128 similar messages]
I20260709 13:19:37.615077 18596 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
I20260709 13:19:37.615605 18596 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.616530 18469 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 1.
I20260709 13:19:37.617743 18596 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
W20260709 13:19:37.618188 18362 leader_election.cc:336] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.619957 18363 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:37.620362 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:37.621043 18396 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 1.
I20260709 13:19:37.621544 18558 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:37.621922 18558 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
I20260709 13:19:37.622335 18558 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.622360 18436 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:37.623386 18596 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:19:37.623472 18436 leader_election.cc:336] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.623713 18596 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
I20260709 13:19:37.624100 18596 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.629761 18558 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.631156 18596 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.632229 18558 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:37.633002 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:37.633190 18596 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:37.633893 18469 raft_consensus.cc:2393] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e09a79422e704bf78421f51f15b1f7bd in current term 2: Already voted for candidate 3be76f1574b94f7bacfdb34a9608bffe in this term.
I20260709 13:19:37.635555 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
W20260709 13:19:37.636070 18362 leader_election.cc:336] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.636435 18396 raft_consensus.cc:2393] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3be76f1574b94f7bacfdb34a9608bffe in current term 2: Already voted for candidate e09a79422e704bf78421f51f15b1f7bd in this term.
I20260709 13:19:37.636643 18362 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:37.637431 18538 raft_consensus.cc:2749] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:37.639307 18436 leader_election.cc:336] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.639776 18436 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe; no voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:37.640419 18596 raft_consensus.cc:2749] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.893859 18538 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
I20260709 13:19:37.894443 18538 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.896221 18538 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:37.897423 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:37.899847 18596 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
W20260709 13:19:37.900066 18362 leader_election.cc:336] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.900388 18596 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.900647 18362 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:37.901374 18538 raft_consensus.cc:2749] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:37.902395 18596 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:37.903788 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:37.904388 18396 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 1.
I20260709 13:19:37.905340 18436 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:37.906008 18596 raft_consensus.cc:2804] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:19:37.906028 18436 leader_election.cc:336] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.906451 18596 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0b5cb61759da4b6c973379bd76a09480)
I20260709 13:19:37.906941 18596 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:37.912091 18596 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.913740 18596 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:37.915439 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:37.915992 18396 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:37.917563 18436 leader_election.cc:336] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:37.921450 18396 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:37.922587 18436 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:37.923321 18596 raft_consensus.cc:2804] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:37.923745 18596 raft_consensus.cc:697] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:37.924400 18596 consensus_queue.cc:237] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:37.931614 18220 catalog_manager.cc:5697] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 1 to 2, leader changed from 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 2 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:38.320133 18396 raft_consensus.cc:1275] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:38.321573 18596 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:38.338812 18436 consensus_peers.cc:597] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.411257 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:38.647567 18362 consensus_peers.cc:597] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.680588 18436 consensus_peers.cc:597] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.830679 18362 consensus_peers.cc:597] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:38.925424 18362 consensus_peers.cc:597] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.153805 18538 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.154356 18538 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:39.156023 18538 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:39.157176 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:39.157915 18469 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 2.
I20260709 13:19:39.159102 18363 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
W20260709 13:19:39.159803 18362 leader_election.cc:336] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:39.159795 18538 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:39.160305 18538 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.160573 18538 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:39.165555 18538 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:39.167305 18538 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:39.168454 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:39.169106 18469 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:39.171206 18362 leader_election.cc:336] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111)
I20260709 13:19:39.174882 18469 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:39.176095 18363 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 0b5cb61759da4b6c973379bd76a09480
I20260709 13:19:39.176786 18538 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:39.177597 18538 raft_consensus.cc:697] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:39.178460 18538 consensus_queue.cc:237] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:39.185618 18216 catalog_manager.cc:5697] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 1 to 3, leader changed from 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 3 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:39.214929 18362 consensus_peers.cc:597] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:39.314046 18362 consensus_peers.cc:597] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:39.412288 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:39.430850 18362 consensus_peers.cc:597] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:39.456568 18436 consensus_peers.cc:597] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:39.612509 18469 raft_consensus.cc:1275] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:39.613950 18538 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:39.629204 18362 consensus_peers.cc:597] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.413434 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:40.847743 18436 consensus_peers.cc:597] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:41.024338 18436 consensus_peers.cc:597] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.217507 18362 consensus_peers.cc:597] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.414750 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:41.419646 18362 consensus_peers.cc:597] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:41.489796 18362 consensus_peers.cc:597] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:41.524046  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.533133 18618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.534019 18619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.534297 18621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.535748  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:41.536933  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:41.537134  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.537285  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603181537274 us; error 0 us; skew 500 ppm
I20260709 13:19:41.537869  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.542791  9147 webserver.cc:533] Webserver started at http://127.8.238.193:46057/ using document root <none> and password file <none>
I20260709 13:19:41.543496  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.543743  9147 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:41.548192  9147 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:19:41.552433 18626 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.553399  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:19:41.553746  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "0b5cb61759da4b6c973379bd76a09480"
format_stamp: "Formatted at 2026-07-09 13:19:34 on dist-test-slave-ml7r"
I20260709 13:19:41.554368  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.570787  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.572237  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:41.573822  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:41.577821 18633 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:19:41.633618  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:19:41.633953  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.002s	sys 0.000s
I20260709 13:19:41.634384  9147 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:19:41.640405 18633 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.656620 18633 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.657531 18633 tablet_bootstrap.cc:492] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.658138 18633 ts_tablet_manager.cc:1403] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 13:19:41.660938 18633 raft_consensus.cc:359] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.661846 18633 raft_consensus.cc:740] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.662652 18633 consensus_queue.cc:260] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.665918 18633 ts_tablet_manager.cc:1434] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:41.666811 18633 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.681849 18633 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.682727 18633 tablet_bootstrap.cc:492] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.683312 18633 ts_tablet_manager.cc:1403] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:19:41.685472 18633 raft_consensus.cc:359] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.686084 18633 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.686642  9147 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:19:41.687080  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.053s	user 0.044s	sys 0.007s
I20260709 13:19:41.686733 18633 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.688830 18633 ts_tablet_manager.cc:1434] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:41.689589 18633 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.706663 18633 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.707557 18633 tablet_bootstrap.cc:492] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.708204 18633 ts_tablet_manager.cc:1403] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:19:41.710503 18633 raft_consensus.cc:359] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.711082 18633 raft_consensus.cc:740] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.711809 18633 consensus_queue.cc:260] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.713423 18633 ts_tablet_manager.cc:1434] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:41.714097 18633 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.729107 18633 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.730419 18633 tablet_bootstrap.cc:492] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.731256 18633 ts_tablet_manager.cc:1403] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:19:41.734431 18633 raft_consensus.cc:359] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.735176 18633 raft_consensus.cc:740] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.735926 18633 consensus_queue.cc:260] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.738288 18633 ts_tablet_manager.cc:1434] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:41.739318 18633 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.749185  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:36047
I20260709 13:19:41.749270 18694 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:36047 every 8 connection(s)
I20260709 13:19:41.756227  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:41.758036 18633 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.759261 18633 tablet_bootstrap.cc:492] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.760022 18633 ts_tablet_manager.cc:1403] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:19:41.762830 18633 raft_consensus.cc:359] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.763615 18633 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.764400 18633 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.766623 18633 ts_tablet_manager.cc:1434] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:41.767535 18633 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.787454 18633 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.788163 18633 tablet_bootstrap.cc:492] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.788736 18633 ts_tablet_manager.cc:1403] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:19:41.791440 18633 raft_consensus.cc:359] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.792183 18633 raft_consensus.cc:740] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.792646 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:41.793056 18633 consensus_queue.cc:260] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.793556 18396 raft_consensus.cc:606] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:41.794159 18696 heartbeater.cc:344] Connected to a master server at 127.8.238.254:41099
I20260709 13:19:41.794718 18696 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:41.795430 18633 ts_tablet_manager.cc:1434] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:19:41.795760 18696 heartbeater.cc:507] Master 127.8.238.254:41099 requested a full tablet report, sending...
I20260709 13:19:41.796233 18633 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.796871 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a88b108232984c39808091ebfd593d96"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:41.797603 18396 raft_consensus.cc:606] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:41.800611 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:41.801241 18396 raft_consensus.cc:606] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:41.802146 18216 ts_manager.cc:194] Re-registered known tserver with Master: 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047)
I20260709 13:19:41.802615  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:41.803280  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:41.804070  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:41.809353 18633 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.810381 18633 tablet_bootstrap.cc:492] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.811172 18633 ts_tablet_manager.cc:1403] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:19:41.814184 18216 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35720
I20260709 13:19:41.814834 18633 raft_consensus.cc:359] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.815984 18633 raft_consensus.cc:385] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:41.816385 18633 raft_consensus.cc:740] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.817844 18696 heartbeater.cc:499] Master 127.8.238.254:41099 was elected leader, sending a full tablet report...
I20260709 13:19:41.817376 18633 consensus_queue.cc:260] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.820747 18633 ts_tablet_manager.cc:1434] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:19:41.821945 18633 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.834870 18704 raft_consensus.cc:993] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:41.835774 18705 raft_consensus.cc:1081] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:41.838393 18633 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.838367 18471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a88b108232984c39808091ebfd593d96"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:41.839066 18471 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.839408 18633 tablet_bootstrap.cc:492] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.839548 18471 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:41.840308 18633 ts_tablet_manager.cc:1403] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:19:41.843231 18633 raft_consensus.cc:359] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.844154 18633 raft_consensus.cc:740] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.845013 18633 consensus_queue.cc:260] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.847620 18633 ts_tablet_manager.cc:1434] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:41.848635 18633 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.848968 18635 raft_consensus.cc:493] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.849613 18635 raft_consensus.cc:515] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.860296 18635 leader_election.cc:290] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:41.863417 18471 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.866729 18471 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:41.867367 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e09a79422e704bf78421f51f15b1f7bd" is_pre_election: true
I20260709 13:19:41.871697 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:41.872581 18396 raft_consensus.cc:3055] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:41.873026 18396 raft_consensus.cc:740] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:41.876154 18396 consensus_queue.cc:260] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.878280 18396 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:41.888788 18633 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.889904 18633 tablet_bootstrap.cc:492] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.890779 18633 ts_tablet_manager.cc:1403] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.000s
I20260709 13:19:41.893489 18396 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:41.893633 18633 raft_consensus.cc:359] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.895629 18633 raft_consensus.cc:740] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.896347 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:41.896495 18633 consensus_queue.cc:260] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.897148 18670 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 4
I20260709 13:19:41.898952 18633 ts_tablet_manager.cc:1434] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:41.899789 18633 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Bootstrap starting.
I20260709 13:19:41.896404 18436 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:41.906651 18595 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:41.904970 18670 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:41.908752 18595 raft_consensus.cc:697] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:41.909926 18595 consensus_queue.cc:237] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.917090 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "0b5cb61759da4b6c973379bd76a09480" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe" is_pre_election: true
I20260709 13:19:41.918327 18670 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:41.920406 18630 leader_election.cc:304] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480; no voters: 3be76f1574b94f7bacfdb34a9608bffe, e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:41.925803 18216 catalog_manager.cc:5697] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 3 to 4, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 4 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.952417 18633 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:41.953742 18633 tablet_bootstrap.cc:492] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Bootstrap complete.
I20260709 13:19:41.954345 18635 raft_consensus.cc:2749] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:41.954566 18633 ts_tablet_manager.cc:1403] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.018s
I20260709 13:19:41.957819 18633 raft_consensus.cc:359] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.958588 18633 raft_consensus.cc:740] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b5cb61759da4b6c973379bd76a09480, State: Initialized, Role: FOLLOWER
I20260709 13:19:41.959311 18633 consensus_queue.cc:260] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:41.960942 18633 ts_tablet_manager.cc:1434] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:42.001052 18704 raft_consensus.cc:993] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:42.001541 18704 raft_consensus.cc:1081] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:42.003149 18471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:42.003679 18471 raft_consensus.cc:493] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.003999 18471 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.011121 18471 raft_consensus.cc:515] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.013583 18471 leader_election.cc:290] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:42.014871 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:42.015565 18396 raft_consensus.cc:3055] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.015951 18396 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:42.015867 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:42.016754 18670 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.017110 18396 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.018855 18396 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.025035 18670 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:42.026306 18436 leader_election.cc:304] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:42.027037 18595 raft_consensus.cc:2804] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.026929 18396 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:42.027721 18595 raft_consensus.cc:697] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:42.028769 18595 consensus_queue.cc:237] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.036006 18220 catalog_manager.cc:5697] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 1 to 2, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 2 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.181253 18705 raft_consensus.cc:993] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:42.181841 18704 raft_consensus.cc:1081] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:42.183830 18471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:42.184415 18471 raft_consensus.cc:493] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.184751 18471 raft_consensus.cc:3060] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.190698 18471 raft_consensus.cc:515] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.192322 18471 leader_election.cc:290] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595), 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047)
I20260709 13:19:42.193229 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:42.193555 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412d3e75afeb4bd89dd2535f94de9348" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:42.193830 18396 raft_consensus.cc:3055] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.194195 18670 raft_consensus.cc:3060] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.194271 18396 raft_consensus.cc:740] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:42.197492 18396 consensus_queue.cc:260] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.198781 18396 raft_consensus.cc:3060] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.201128 18670 raft_consensus.cc:2468] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:42.202380 18436 leader_election.cc:304] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:42.203217 18595 raft_consensus.cc:2804] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.203786 18595 raft_consensus.cc:697] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:42.204684 18595 consensus_queue.cc:237] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.204980 18396 raft_consensus.cc:2468] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:42.212356 18220 catalog_manager.cc:5697] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 1 to 2, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 2 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:42.415740 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:42.449652 18396 raft_consensus.cc:1275] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:42.451499 18729 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:42.452020 18670 raft_consensus.cc:1275] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:42.453332 18729 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:42.465920 18670 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.474814 18397 raft_consensus.cc:1275] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:42.480438 18595 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:42.490504 18668 raft_consensus.cc:1275] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:42.492098 18595 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:42.610168 18668 raft_consensus.cc:1275] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:42.611577 18713 consensus_queue.cc:1048] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:42.621515 18396 raft_consensus.cc:1275] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:42.622972 18713 consensus_queue.cc:1048] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:42.815634  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:42.833351 18471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "683d3003003e4691a429683e921e244c"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
mode: GRACEFUL
new_leader_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:19:42.833895 18471 raft_consensus.cc:606] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Received request to transfer leadership to TS e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:42.836431 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:42.836867 18396 raft_consensus.cc:606] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:42.839205 18471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
mode: GRACEFUL
new_leader_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:19:42.839702 18471 raft_consensus.cc:606] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Received request to transfer leadership to TS e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:42.840688  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:42.841171  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:42.841744  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:42.940623 18729 raft_consensus.cc:993] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: : Instructing follower e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:42.941051 18713 raft_consensus.cc:1081] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Signalling peer e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:42.942444 18396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:52886
I20260709 13:19:42.942847 18396 raft_consensus.cc:493] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.943064 18396 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:42.948519 18396 raft_consensus.cc:515] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.949893 18396 leader_election.cc:290] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:42.950785 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:42.950937 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:42.951462 18668 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:42.951575 18471 raft_consensus.cc:3055] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:42.951980 18471 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:42.952700 18471 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.953660 18471 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:42.957394 18668 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:42.958657 18362 leader_election.cc:304] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:42.959427 18704 raft_consensus.cc:2804] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:42.959712 18471 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:42.959853 18704 raft_consensus.cc:697] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:42.960796 18704 consensus_queue.cc:237] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:42.967150 18217 catalog_manager.cc:5697] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 2 to 3, leader changed from 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 3 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.130939 18705 raft_consensus.cc:993] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:43.131386 18704 raft_consensus.cc:1081] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:43.132900 18471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:43.133414 18471 raft_consensus.cc:493] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.133734 18471 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.139201 18471 raft_consensus.cc:515] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.140887 18471 leader_election.cc:290] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:43.141825 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:43.141996 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:43.142598 18668 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.142670 18396 raft_consensus.cc:3055] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.143095 18396 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:43.143775 18396 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.144737 18396 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.148046 18668 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:43.149245 18436 leader_election.cc:304] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:43.149902 18396 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:43.150092 18729 raft_consensus.cc:2804] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.150766 18729 raft_consensus.cc:697] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:43.151821 18729 consensus_queue.cc:237] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.154014 18595 raft_consensus.cc:993] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: : Instructing follower e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:43.154672 18713 raft_consensus.cc:1081] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Signalling peer e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:43.158049 18396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "683d3003003e4691a429683e921e244c"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:52886
I20260709 13:19:43.158557 18396 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.158849 18396 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:43.159482 18217 catalog_manager.cc:5697] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 1 to 2, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 2 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.163528 18396 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.165323 18396 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:43.166205 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:43.166953 18668 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:43.166352 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:43.168313 18471 raft_consensus.cc:3055] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:43.168581 18471 raft_consensus.cc:740] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:43.169160 18471 consensus_queue.cc:260] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.170007 18471 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:43.172477 18668 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:43.173600 18362 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:43.174431 18704 raft_consensus.cc:2804] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:43.174858 18704 raft_consensus.cc:697] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:43.175060 18471 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:43.175843 18704 consensus_queue.cc:237] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.182670 18217 catalog_manager.cc:5697] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 2 to 3, leader changed from 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 3 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.401945 18471 raft_consensus.cc:1275] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:43.403252 18704 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:43.413909 18668 raft_consensus.cc:1275] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:43.415488 18728 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:19:43.416816 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:43.540577 18668 raft_consensus.cc:1275] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.541873 18713 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.550983 18396 raft_consensus.cc:1275] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.553378 18595 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.574043 18471 raft_consensus.cc:1275] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:43.575368 18704 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:43.584268 18668 raft_consensus.cc:1275] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:43.585924 18705 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:43.848276  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:43.855418 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:43.855993 18396 raft_consensus.cc:606] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:43.858570 18471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a88b108232984c39808091ebfd593d96"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
mode: GRACEFUL
new_leader_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:19:43.859012 18471 raft_consensus.cc:606] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Received request to transfer leadership to TS e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:43.861553 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:43.862146 18396 raft_consensus.cc:606] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:43.863498  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:43.863958  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:43.864473  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:43.920517 18595 raft_consensus.cc:993] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: : Instructing follower e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:43.921121 18729 raft_consensus.cc:1081] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Signalling peer e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:43.922796 18396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a88b108232984c39808091ebfd593d96"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:52886
I20260709 13:19:43.923244 18396 raft_consensus.cc:493] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.923477 18396 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:43.928153 18396 raft_consensus.cc:515] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.929752 18396 leader_election.cc:290] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 5 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:43.930598 18668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:43.931279 18668 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:43.931151 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b108232984c39808091ebfd593d96" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:43.931916 18471 raft_consensus.cc:3055] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:43.932242 18471 raft_consensus.cc:740] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:43.933014 18471 consensus_queue.cc:260] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.934258 18471 raft_consensus.cc:3060] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:43.938947 18668 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 5.
I20260709 13:19:43.940402 18362 leader_election.cc:304] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:43.941186 18705 raft_consensus.cc:2804] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:43.941349 18471 raft_consensus.cc:2468] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 5.
I20260709 13:19:43.941689 18705 raft_consensus.cc:697] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 5 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:43.942798 18705 consensus_queue.cc:237] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:43.949265 18216 catalog_manager.cc:5697] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 4 to 5, leader changed from 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 5 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.136505 18754 raft_consensus.cc:993] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:44.137130 18705 raft_consensus.cc:1081] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:44.138736 18471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:44.139182 18471 raft_consensus.cc:493] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.139480 18471 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.144614 18471 raft_consensus.cc:515] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.146174 18471 leader_election.cc:290] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:44.147017 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:44.147541 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:44.147758 18670 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.148164 18396 raft_consensus.cc:3055] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.148526 18396 raft_consensus.cc:740] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:44.149394 18396 consensus_queue.cc:260] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.151196 18396 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.155388 18670 raft_consensus.cc:2468] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:44.156523 18436 leader_election.cc:304] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:44.156666 18396 raft_consensus.cc:2468] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:44.157398 18729 raft_consensus.cc:2804] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.157917 18729 raft_consensus.cc:697] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:44.158691 18729 consensus_queue.cc:237] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.166415 18216 catalog_manager.cc:5697] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 1 to 2, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 2 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.315734 18705 raft_consensus.cc:993] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:44.316195 18754 raft_consensus.cc:1081] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:44.317673 18471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:44.318152 18471 raft_consensus.cc:493] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.318488 18471 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:44.323589 18471 raft_consensus.cc:515] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.325201 18471 leader_election.cc:290] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:44.325873 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:44.326486 18670 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:44.327062 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c578f6e91b1d4e58aaf311a9b44e7995" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:44.327571 18396 raft_consensus.cc:3055] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:44.327804 18396 raft_consensus.cc:740] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:44.328397 18396 consensus_queue.cc:260] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.329264 18396 raft_consensus.cc:3060] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:44.331956 18670 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:44.333106 18436 leader_election.cc:304] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:44.333890 18729 raft_consensus.cc:2804] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:44.334395 18729 raft_consensus.cc:697] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:44.334883 18396 raft_consensus.cc:2468] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:44.335141 18729 consensus_queue.cc:237] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.341181 18216 catalog_manager.cc:5697] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 3 to 4, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 4 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:44.417968 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:44.470317 18471 raft_consensus.cc:1275] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 5 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:44.471730 18754 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:44.481119 18670 raft_consensus.cc:1275] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 5 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:44.483083 18754 consensus_queue.cc:1048] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:44.618669 18396 raft_consensus.cc:1275] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.620069 18729 consensus_queue.cc:1048] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.629630 18670 raft_consensus.cc:1275] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.631610 18768 consensus_queue.cc:1048] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.854007 18670 raft_consensus.cc:1275] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:44.855408 18768 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:44.865427 18396 raft_consensus.cc:1275] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:44.867388 18595 consensus_queue.cc:1048] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:44.871692  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:44.882759 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ffedf663e245809ad6654a30fad813"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:44.884378 18396 raft_consensus.cc:606] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:44.886148 18754 raft_consensus.cc:993] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:44.886613 18754 raft_consensus.cc:1081] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:44.887323 18471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
mode: GRACEFUL
new_leader_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:19:44.887945 18471 raft_consensus.cc:606] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Received request to transfer leadership to TS e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:44.889020 18469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ffedf663e245809ad6654a30fad813"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:44.889628 18469 raft_consensus.cc:493] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.890002 18469 raft_consensus.cc:3060] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.890568 18471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
mode: GRACEFUL
new_leader_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:19:44.891194 18471 raft_consensus.cc:606] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Received request to transfer leadership to TS e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:44.892387  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:44.892930  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:44.893558  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:44.897022 18469 raft_consensus.cc:515] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.898892 18469 leader_election.cc:290] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:44.899814 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:44.899976 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ffedf663e245809ad6654a30fad813" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:44.900539 18670 raft_consensus.cc:3060] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.900614 18396 raft_consensus.cc:3055] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.900970 18396 raft_consensus.cc:740] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:44.901634 18396 consensus_queue.cc:260] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.902498 18396 raft_consensus.cc:3060] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.905987 18670 raft_consensus.cc:2468] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:44.907218 18436 leader_election.cc:304] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:44.907632 18396 raft_consensus.cc:2468] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 2.
I20260709 13:19:44.907990 18768 raft_consensus.cc:2804] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.908535 18768 raft_consensus.cc:697] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:44.909389 18768 consensus_queue.cc:237] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:44.916633 18217 catalog_manager.cc:5697] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 1 to 2, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 2 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.232384 18595 raft_consensus.cc:993] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: : Instructing follower e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:45.232897 18768 raft_consensus.cc:1081] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Signalling peer e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:45.234452 18396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:52886
I20260709 13:19:45.234895 18396 raft_consensus.cc:493] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:45.235139 18396 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:45.239748 18396 raft_consensus.cc:515] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:45.241405 18396 leader_election.cc:290] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:45.242246 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:45.242408 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:45.242875 18670 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:45.243024 18471 raft_consensus.cc:3055] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:45.243409 18471 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:45.244077 18471 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:45.245054 18471 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:45.248878 18670 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:45.249990 18471 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:45.250294 18362 leader_election.cc:304] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:45.251140 18754 raft_consensus.cc:2804] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:45.251608 18754 raft_consensus.cc:697] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:45.252302 18754 consensus_queue.cc:237] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:45.259255 18217 catalog_manager.cc:5697] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 2 to 3, leader changed from 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 3 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.368628 18396 raft_consensus.cc:1275] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:45.369791 18768 consensus_queue.cc:1048] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:45.379985 18670 raft_consensus.cc:1275] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:45.381438 18768 consensus_queue.cc:1048] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:45.412182 18595 raft_consensus.cc:993] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: : Instructing follower e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:45.412679 18768 raft_consensus.cc:1081] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Signalling peer e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:45.414256 18396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:52886
I20260709 13:19:45.414774 18396 raft_consensus.cc:493] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:45.415081 18396 raft_consensus.cc:3060] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:45.418985 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:45.420140 18396 raft_consensus.cc:515] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:45.422405 18396 leader_election.cc:290] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:45.422760 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:45.423084 18471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38048382cb4f496eb9a99f12507fc0e4" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:45.423602 18670 raft_consensus.cc:3060] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:45.423736 18471 raft_consensus.cc:3055] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:45.424156 18471 raft_consensus.cc:740] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:45.424933 18471 consensus_queue.cc:260] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:45.426000 18471 raft_consensus.cc:3060] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:45.430035 18670 raft_consensus.cc:2468] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 2.
I20260709 13:19:45.430612 18471 raft_consensus.cc:2468] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 2.
I20260709 13:19:45.431540 18362 leader_election.cc:304] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:45.432425 18754 raft_consensus.cc:2804] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:45.432861 18754 raft_consensus.cc:697] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 2 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:45.433755 18754 consensus_queue.cc:237] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:45.440645 18216 catalog_manager.cc:5697] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 1 to 2, leader changed from 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 2 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.697576 18670 raft_consensus.cc:1275] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:45.698886 18754 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:45.708339 18469 raft_consensus.cc:1275] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:45.711656 18754 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:45.888810 18670 raft_consensus.cc:1275] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:45.890115 18705 consensus_queue.cc:1048] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:45.899770 18469 raft_consensus.cc:1275] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:45.901419  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:45.901947 18785 consensus_queue.cc:1048] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:45.912758 18469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
mode: GRACEFUL
new_leader_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:19:45.913321 18469 raft_consensus.cc:606] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Received request to transfer leadership to TS e09a79422e704bf78421f51f15b1f7bd
I20260709 13:19:45.915987 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "683d3003003e4691a429683e921e244c"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:45.916577 18396 raft_consensus.cc:606] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:45.919270 18396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
mode: GRACEFUL
new_leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:52894
I20260709 13:19:45.919840 18396 raft_consensus.cc:606] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Received request to transfer leadership to TS 3be76f1574b94f7bacfdb34a9608bffe
I20260709 13:19:45.920802  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:45.921329  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:45.921905  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:46.110224 18729 raft_consensus.cc:993] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: : Instructing follower e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:46.110738 18595 raft_consensus.cc:1081] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Signalling peer e09a79422e704bf78421f51f15b1f7bd to start an election
I20260709 13:19:46.112295 18396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e"
dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
 from {username='slave'} at 127.0.0.1:52886
I20260709 13:19:46.112799 18396 raft_consensus.cc:493] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.113076 18396 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:46.117823 18396 raft_consensus.cc:515] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.119593 18396 leader_election.cc:290] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195:39083)
I20260709 13:19:46.120333 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:46.121013 18469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4482694754dc4beea49ddb55c7eb0e4e" candidate_uuid: "e09a79422e704bf78421f51f15b1f7bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
I20260709 13:19:46.121052 18670 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:46.121637 18469 raft_consensus.cc:3055] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:46.121970 18469 raft_consensus.cc:740] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:46.122785 18469 consensus_queue.cc:260] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.124976 18469 raft_consensus.cc:3060] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:46.130424 18670 raft_consensus.cc:2468] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:46.131829 18362 leader_election.cc:304] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, e09a79422e704bf78421f51f15b1f7bd; no voters: 
I20260709 13:19:46.132900 18785 raft_consensus.cc:2804] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:46.133404 18785 raft_consensus.cc:697] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Leader. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:46.134517 18785 consensus_queue.cc:237] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.135928 18469 raft_consensus.cc:2468] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e09a79422e704bf78421f51f15b1f7bd in term 3.
I20260709 13:19:46.144410 18217 catalog_manager.cc:5697] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd reported cstate change: term changed from 2 to 3, leader changed from 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195) to e09a79422e704bf78421f51f15b1f7bd (127.8.238.194). New cstate: current_term: 3 leader_uuid: "e09a79422e704bf78421f51f15b1f7bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.231184 18754 raft_consensus.cc:993] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:46.231649 18785 raft_consensus.cc:1081] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:46.233623 18469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:46.234221 18469 raft_consensus.cc:493] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.234647 18469 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:46.239894 18469 raft_consensus.cc:515] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.241488 18469 leader_election.cc:290] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:46.242398 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:46.242527 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8102ebfff7204a4e8194f2317a78bce6" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:46.242973 18670 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:46.243134 18396 raft_consensus.cc:3055] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:46.243528 18396 raft_consensus.cc:740] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:46.244220 18396 consensus_queue.cc:260] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.245103 18396 raft_consensus.cc:3060] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:46.248021 18670 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:46.249087 18436 leader_election.cc:304] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:46.249768 18595 raft_consensus.cc:2804] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:46.249934 18396 raft_consensus.cc:2468] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:46.250211 18595 raft_consensus.cc:697] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:46.251155 18595 consensus_queue.cc:237] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.257265 18217 catalog_manager.cc:5697] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 3 to 4, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 4 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.304096 18754 raft_consensus.cc:993] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: : Instructing follower 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:46.304634 18785 raft_consensus.cc:1081] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Signalling peer 3be76f1574b94f7bacfdb34a9608bffe to start an election
I20260709 13:19:46.306139 18469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "683d3003003e4691a429683e921e244c"
dest_uuid: "3be76f1574b94f7bacfdb34a9608bffe"
 from {username='slave'} at 127.0.0.1:53808
I20260709 13:19:46.306691 18469 raft_consensus.cc:493] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:46.307004 18469 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:46.311719 18469 raft_consensus.cc:515] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.313364 18469 leader_election.cc:290] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Requested vote from peers 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047), e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595)
I20260709 13:19:46.314182 18670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b5cb61759da4b6c973379bd76a09480"
I20260709 13:19:46.314455 18396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683d3003003e4691a429683e921e244c" candidate_uuid: "3be76f1574b94f7bacfdb34a9608bffe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e09a79422e704bf78421f51f15b1f7bd"
I20260709 13:19:46.314934 18670 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:46.314961 18396 raft_consensus.cc:3055] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:46.315440 18396 raft_consensus.cc:740] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e09a79422e704bf78421f51f15b1f7bd, State: Running, Role: LEADER
I20260709 13:19:46.316179 18396 consensus_queue.cc:260] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.317373 18396 raft_consensus.cc:3060] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:46.322106 18670 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:46.323542 18436 leader_election.cc:304] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b5cb61759da4b6c973379bd76a09480, 3be76f1574b94f7bacfdb34a9608bffe; no voters: 
I20260709 13:19:46.324018 18396 raft_consensus.cc:2468] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3be76f1574b94f7bacfdb34a9608bffe in term 4.
I20260709 13:19:46.324272 18595 raft_consensus.cc:2804] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:46.324823 18595 raft_consensus.cc:697] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Becoming Leader. State: Replica: 3be76f1574b94f7bacfdb34a9608bffe, State: Running, Role: LEADER
I20260709 13:19:46.325932 18595 consensus_queue.cc:237] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } }
I20260709 13:19:46.333442 18217 catalog_manager.cc:5697] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe reported cstate change: term changed from 3 to 4, leader changed from e09a79422e704bf78421f51f15b1f7bd (127.8.238.194) to 3be76f1574b94f7bacfdb34a9608bffe (127.8.238.195). New cstate: current_term: 4 leader_uuid: "3be76f1574b94f7bacfdb34a9608bffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:46.420085 18268 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:46.560082 18668 raft_consensus.cc:1275] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:46.561414 18785 consensus_queue.cc:1048] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:46.572685 18469 raft_consensus.cc:1275] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Refusing update from remote peer e09a79422e704bf78421f51f15b1f7bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:46.574152 18785 consensus_queue.cc:1048] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3be76f1574b94f7bacfdb34a9608bffe" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:46.746768 18668 raft_consensus.cc:1275] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:46.748142 18595 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.757613 18396 raft_consensus.cc:1275] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:46.759673 18595 consensus_queue.cc:1048] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.801847 18396 raft_consensus.cc:1275] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:46.803218 18595 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e09a79422e704bf78421f51f15b1f7bd" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.814460 18668 raft_consensus.cc:1275] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Refusing update from remote peer 3be76f1574b94f7bacfdb34a9608bffe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:46.815846 18801 consensus_queue.cc:1048] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b5cb61759da4b6c973379bd76a09480" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 36047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.928382  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:46.956452  9147 tablet_server.cc:179] TabletServer@127.8.238.193:36047 shutting down...
W20260709 13:19:46.973696 18436 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 86 similar messages]
W20260709 13:19:46.977017 18436 consensus_peers.cc:597] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.977219  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:46.978029  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.978957  9147 raft_consensus.cc:2243] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.979560  9147 raft_consensus.cc:2272] T 38048382cb4f496eb9a99f12507fc0e4 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.981428  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.981956  9147 raft_consensus.cc:2243] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.982438  9147 raft_consensus.cc:2272] T 22ffedf663e245809ad6654a30fad813 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.984239  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.984715  9147 raft_consensus.cc:2243] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.985086  9147 raft_consensus.cc:2272] T c578f6e91b1d4e58aaf311a9b44e7995 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.986893  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.987361  9147 raft_consensus.cc:2243] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.987713  9147 raft_consensus.cc:2272] T ed1dd4cf91314e3fae31adfe759c88d7 P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.989362  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.989831  9147 raft_consensus.cc:2243] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.990217  9147 raft_consensus.cc:2272] T 4482694754dc4beea49ddb55c7eb0e4e P 0b5cb61759da4b6c973379bd76a09480 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.992594  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.993146  9147 raft_consensus.cc:2243] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.993515  9147 raft_consensus.cc:2272] T 412d3e75afeb4bd89dd2535f94de9348 P 0b5cb61759da4b6c973379bd76a09480 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.995355  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.996032  9147 raft_consensus.cc:2243] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.996487  9147 raft_consensus.cc:2272] T 7494b1c1d04a4b5f88ad35f55cef7dca P 0b5cb61759da4b6c973379bd76a09480 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.998955  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.999639  9147 raft_consensus.cc:2243] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.000202  9147 raft_consensus.cc:2272] T 8102ebfff7204a4e8194f2317a78bce6 P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.003019  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:47.003509  9147 raft_consensus.cc:2243] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.003917  9147 raft_consensus.cc:2272] T 683d3003003e4691a429683e921e244c P 0b5cb61759da4b6c973379bd76a09480 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.006143  9147 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:47.006726  9147 raft_consensus.cc:2243] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.007125  9147 raft_consensus.cc:2272] T a88b108232984c39808091ebfd593d96 P 0b5cb61759da4b6c973379bd76a09480 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.036195  9147 tablet_server.cc:196] TabletServer@127.8.238.193:36047 shutdown complete.
I20260709 13:19:47.055601  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
I20260709 13:19:47.084358  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:47.085228  9147 tablet_replica.cc:333] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.086293  9147 raft_consensus.cc:2243] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.086869  9147 raft_consensus.cc:2272] T 7494b1c1d04a4b5f88ad35f55cef7dca P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:47.087859 18362 consensus_peers.cc:597] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.089368  9147 tablet_replica.cc:333] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.090094  9147 raft_consensus.cc:2243] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.090642  9147 raft_consensus.cc:2272] T 22ffedf663e245809ad6654a30fad813 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.092722  9147 tablet_replica.cc:333] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.093340  9147 raft_consensus.cc:2243] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.094132  9147 raft_consensus.cc:2272] T 38048382cb4f496eb9a99f12507fc0e4 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.096302  9147 tablet_replica.cc:333] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.096931  9147 raft_consensus.cc:2243] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.097362  9147 raft_consensus.cc:2272] T 683d3003003e4691a429683e921e244c P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.100239  9147 tablet_replica.cc:333] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.100844  9147 raft_consensus.cc:2243] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.101616  9147 raft_consensus.cc:2272] T a88b108232984c39808091ebfd593d96 P e09a79422e704bf78421f51f15b1f7bd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.103685  9147 tablet_replica.cc:333] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.104231  9147 raft_consensus.cc:2243] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.104647  9147 raft_consensus.cc:2272] T 8102ebfff7204a4e8194f2317a78bce6 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.107450  9147 tablet_replica.cc:333] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.108011  9147 raft_consensus.cc:2243] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.108477  9147 raft_consensus.cc:2272] T c578f6e91b1d4e58aaf311a9b44e7995 P e09a79422e704bf78421f51f15b1f7bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.110455  9147 tablet_replica.cc:333] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.110946  9147 raft_consensus.cc:2243] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.111727  9147 raft_consensus.cc:2272] T ed1dd4cf91314e3fae31adfe759c88d7 P e09a79422e704bf78421f51f15b1f7bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.114380  9147 tablet_replica.cc:333] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.114933  9147 raft_consensus.cc:2243] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.115379  9147 raft_consensus.cc:2272] T 412d3e75afeb4bd89dd2535f94de9348 P e09a79422e704bf78421f51f15b1f7bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.117353  9147 tablet_replica.cc:333] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd: stopping tablet replica
I20260709 13:19:47.117873  9147 raft_consensus.cc:2243] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.118682  9147 raft_consensus.cc:2272] T 4482694754dc4beea49ddb55c7eb0e4e P e09a79422e704bf78421f51f15b1f7bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.151659  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
I20260709 13:19:47.174749  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
W20260709 13:19:47.193835 18436 consensus_peers.cc:597] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe -> Peer 0b5cb61759da4b6c973379bd76a09480 (127.8.238.193:36047): Couldn't send request to peer 0b5cb61759da4b6c973379bd76a09480. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:36047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.207259  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:47.208033  9147 tablet_replica.cc:333] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.209187  9147 raft_consensus.cc:2243] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.209728  9147 raft_consensus.cc:2272] T 38048382cb4f496eb9a99f12507fc0e4 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.212064  9147 tablet_replica.cc:333] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.212697  9147 raft_consensus.cc:2243] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.213575  9147 raft_consensus.cc:2272] T 8102ebfff7204a4e8194f2317a78bce6 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.216384  9147 tablet_replica.cc:333] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.217013  9147 raft_consensus.cc:2243] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.217855  9147 raft_consensus.cc:2272] T 7494b1c1d04a4b5f88ad35f55cef7dca P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.219853  9147 tablet_replica.cc:333] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.220409  9147 raft_consensus.cc:2243] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.220890  9147 raft_consensus.cc:2272] T ed1dd4cf91314e3fae31adfe759c88d7 P 3be76f1574b94f7bacfdb34a9608bffe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.223713  9147 tablet_replica.cc:333] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.224311  9147 raft_consensus.cc:2243] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.225257  9147 raft_consensus.cc:2272] T 412d3e75afeb4bd89dd2535f94de9348 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:47.226646 18436 consensus_peers.cc:597] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe -> Peer e09a79422e704bf78421f51f15b1f7bd (127.8.238.194:34595): Couldn't send request to peer e09a79422e704bf78421f51f15b1f7bd. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:34595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.227749  9147 tablet_replica.cc:333] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.228302  9147 raft_consensus.cc:2243] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.228681  9147 raft_consensus.cc:2272] T 4482694754dc4beea49ddb55c7eb0e4e P 3be76f1574b94f7bacfdb34a9608bffe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.231220  9147 tablet_replica.cc:333] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.231737  9147 raft_consensus.cc:2243] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.232493  9147 raft_consensus.cc:2272] T c578f6e91b1d4e58aaf311a9b44e7995 P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.234642  9147 tablet_replica.cc:333] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.235140  9147 raft_consensus.cc:2243] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.235870  9147 raft_consensus.cc:2272] T 683d3003003e4691a429683e921e244c P 3be76f1574b94f7bacfdb34a9608bffe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.238350  9147 tablet_replica.cc:333] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.238849  9147 raft_consensus.cc:2243] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.239351  9147 raft_consensus.cc:2272] T a88b108232984c39808091ebfd593d96 P 3be76f1574b94f7bacfdb34a9608bffe [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.241389  9147 tablet_replica.cc:333] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe: stopping tablet replica
I20260709 13:19:47.241817  9147 raft_consensus.cc:2243] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.242647  9147 raft_consensus.cc:2272] T 22ffedf663e245809ad6654a30fad813 P 3be76f1574b94f7bacfdb34a9608bffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.274293  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:19:47.296722  9147 master.cc:562] Master@127.8.238.254:41099 shutting down...
I20260709 13:19:47.320735  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.321323  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.321691  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P 93959618b27d4bc98ba4d07a97c66041: stopping tablet replica
I20260709 13:19:47.343168  9147 master.cc:584] Master@127.8.238.254:41099 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13115 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:19:47.388134  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:38875
I20260709 13:19:47.389328  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.395282 18812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.395401 18811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.396245 18814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.397900  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:47.398927  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.399108  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.399219  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603187399207 us; error 0 us; skew 500 ppm
I20260709 13:19:47.399691  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.401969  9147 webserver.cc:533] Webserver started at http://127.8.238.254:44417/ using document root <none> and password file <none>
I20260709 13:19:47.402506  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.402679  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.402900  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.403980  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "b3a7587614a642299c179d9ca65ee5dd"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.408437  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:47.411849 18819 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.412703  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:47.413077  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "b3a7587614a642299c179d9ca65ee5dd"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.413398  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.434574  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.435863  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.476727  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:38875
I20260709 13:19:47.476826 18870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:38875 every 8 connection(s)
I20260709 13:19:47.480803 18871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.492293 18871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd: Bootstrap starting.
I20260709 13:19:47.497221 18871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.501838 18871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd: No bootstrap required, opened a new log
I20260709 13:19:47.504164 18871 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a7587614a642299c179d9ca65ee5dd" member_type: VOTER }
I20260709 13:19:47.504558 18871 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.504755 18871 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a7587614a642299c179d9ca65ee5dd, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.505347 18871 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a7587614a642299c179d9ca65ee5dd" member_type: VOTER }
I20260709 13:19:47.505795 18871 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:47.505992 18871 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:47.506204 18871 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.511437 18871 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a7587614a642299c179d9ca65ee5dd" member_type: VOTER }
I20260709 13:19:47.511982 18871 leader_election.cc:304] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3a7587614a642299c179d9ca65ee5dd; no voters: 
I20260709 13:19:47.513073 18871 leader_election.cc:290] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:47.513479 18874 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.514957 18874 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 1 LEADER]: Becoming Leader. State: Replica: b3a7587614a642299c179d9ca65ee5dd, State: Running, Role: LEADER
I20260709 13:19:47.515733 18874 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a7587614a642299c179d9ca65ee5dd" member_type: VOTER }
I20260709 13:19:47.516307 18871 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:47.520290 18875 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3a7587614a642299c179d9ca65ee5dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a7587614a642299c179d9ca65ee5dd" member_type: VOTER } }
I20260709 13:19:47.521184 18875 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:47.521076 18876 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3a7587614a642299c179d9ca65ee5dd. Latest consensus state: current_term: 1 leader_uuid: "b3a7587614a642299c179d9ca65ee5dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a7587614a642299c179d9ca65ee5dd" member_type: VOTER } }
I20260709 13:19:47.521793 18876 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:47.523789 18881 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:47.532014 18881 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:47.533010  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:47.541229 18881 catalog_manager.cc:1383] Generated new cluster ID: 39a16a9f5a66474494614777afed20dc
I20260709 13:19:47.541548 18881 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:47.558739 18881 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:47.560174 18881 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:47.576964 18881 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd: Generated new TSK 0
I20260709 13:19:47.577654 18881 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:47.599897  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.605816 18892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.607309 18893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.610023  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:47.610357 18895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.611611  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.611822  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.611945  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603187611933 us; error 0 us; skew 500 ppm
I20260709 13:19:47.612406  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.614990  9147 webserver.cc:533] Webserver started at http://127.8.238.193:44919/ using document root <none> and password file <none>
I20260709 13:19:47.615509  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.615680  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.615911  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.616995  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "1c0992d696d34516adf1087972dd91e2"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.621759  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:19:47.625393 18900 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.626339  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:47.626688  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "1c0992d696d34516adf1087972dd91e2"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.626996  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.677029  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.678479  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.680346  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.682832  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.683094  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.683352  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.683529  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.726061  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:42163
I20260709 13:19:47.726117 18962 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:42163 every 8 connection(s)
I20260709 13:19:47.731269  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.738615 18967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.744391 18968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.746862  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:47.749171 18970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.749550 18963 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38875
I20260709 13:19:47.750138 18963 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.750490  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.750819  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.751019  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603187751000 us; error 0 us; skew 500 ppm
I20260709 13:19:47.751134 18963 heartbeater.cc:507] Master 127.8.238.254:38875 requested a full tablet report, sending...
I20260709 13:19:47.751806  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.753805 18836 ts_manager.cc:194] Registered new tserver with Master: 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163)
I20260709 13:19:47.754575  9147 webserver.cc:533] Webserver started at http://127.8.238.194:39895/ using document root <none> and password file <none>
I20260709 13:19:47.755210  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.755439  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.755712  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.756055 18836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51370
I20260709 13:19:47.756907  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.762215  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:19:47.765686 18975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.766538  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:47.766867  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.767190  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.780030  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.781286  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.782855  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.785188  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.785425  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.785665  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.785846  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.829361  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:44003
I20260709 13:19:47.829471 19037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:44003 every 8 connection(s)
I20260709 13:19:47.834446  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.841809 19041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.843206 19042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.846020  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:47.846079 19045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.847057 19038 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38875
I20260709 13:19:47.847486 19038 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.847543  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.847904  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.848089  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603187848057 us; error 0 us; skew 500 ppm
I20260709 13:19:47.848364 19038 heartbeater.cc:507] Master 127.8.238.254:38875 requested a full tablet report, sending...
I20260709 13:19:47.848788  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.850723 18836 ts_manager.cc:194] Registered new tserver with Master: e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003)
I20260709 13:19:47.851608  9147 webserver.cc:533] Webserver started at http://127.8.238.195:34255/ using document root <none> and password file <none>
I20260709 13:19:47.852211  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.852416  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.852396 18836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51380
I20260709 13:19:47.852959  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.854415  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.859042  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:47.862628 19049 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.863492  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:47.863849  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-ml7r"
I20260709 13:19:47.864167  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.877998  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.879333  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.880857  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.883242  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.883509  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.883831  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.884014  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.928409  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:42151
I20260709 13:19:47.928511 19111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:42151 every 8 connection(s)
I20260709 13:19:47.943114 19112 heartbeater.cc:344] Connected to a master server at 127.8.238.254:38875
I20260709 13:19:47.943581 19112 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.944352 19112 heartbeater.cc:507] Master 127.8.238.254:38875 requested a full tablet report, sending...
I20260709 13:19:47.946388 18836 ts_manager.cc:194] Registered new tserver with Master: de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:47.947484  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015713373s
I20260709 13:19:47.947892 18836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51390
I20260709 13:19:47.973419 18836 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51400:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:47.975673 18836 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:48.022053 19003 tablet_service.cc:1511] Processing CreateTablet for tablet 1eeed47e6ad744cf956ebfd6d94339eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=640a9799147c4b48ac4f1d31eafbea8c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:48.024194 19003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eeed47e6ad744cf956ebfd6d94339eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.022053 19002 tablet_service.cc:1511] Processing CreateTablet for tablet 233afae344984461a628ed647e412312 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=640a9799147c4b48ac4f1d31eafbea8c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:48.028748 18928 tablet_service.cc:1511] Processing CreateTablet for tablet 1eeed47e6ad744cf956ebfd6d94339eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=640a9799147c4b48ac4f1d31eafbea8c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:48.030321 18928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eeed47e6ad744cf956ebfd6d94339eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.031824 18927 tablet_service.cc:1511] Processing CreateTablet for tablet 233afae344984461a628ed647e412312 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=640a9799147c4b48ac4f1d31eafbea8c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:48.039986 18927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233afae344984461a628ed647e412312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.028748 19002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233afae344984461a628ed647e412312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.057796 19077 tablet_service.cc:1511] Processing CreateTablet for tablet 1eeed47e6ad744cf956ebfd6d94339eb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=640a9799147c4b48ac4f1d31eafbea8c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:48.059907 19077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eeed47e6ad744cf956ebfd6d94339eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.059562 19076 tablet_service.cc:1511] Processing CreateTablet for tablet 233afae344984461a628ed647e412312 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=640a9799147c4b48ac4f1d31eafbea8c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:48.063661 19076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233afae344984461a628ed647e412312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.064359 19127 tablet_bootstrap.cc:492] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d: Bootstrap starting.
I20260709 13:19:48.075191 19127 tablet_bootstrap.cc:654] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.082960 19128 tablet_bootstrap.cc:492] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2: Bootstrap starting.
I20260709 13:19:48.087234 19130 tablet_bootstrap.cc:492] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: Bootstrap starting.
I20260709 13:19:48.089092 19127 tablet_bootstrap.cc:492] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d: No bootstrap required, opened a new log
I20260709 13:19:48.089823 19127 ts_tablet_manager.cc:1403] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:19:48.090624 19128 tablet_bootstrap.cc:654] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.093391 19127 raft_consensus.cc:359] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.094317 19127 raft_consensus.cc:385] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.094731 19130 tablet_bootstrap.cc:654] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.094697 19127 raft_consensus.cc:740] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b5fad5ef3e41a0a64c3a256305b01d, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.095681 19127 consensus_queue.cc:260] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.096242 19128 tablet_bootstrap.cc:492] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2: No bootstrap required, opened a new log
I20260709 13:19:48.096812 19128 ts_tablet_manager.cc:1403] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:19:48.098316 19038 heartbeater.cc:499] Master 127.8.238.254:38875 was elected leader, sending a full tablet report...
I20260709 13:19:48.099157 19127 ts_tablet_manager.cc:1434] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:19:48.100720 19127 tablet_bootstrap.cc:492] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d: Bootstrap starting.
I20260709 13:19:48.104532 19128 raft_consensus.cc:359] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.105397 19128 raft_consensus.cc:385] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.105755 19128 raft_consensus.cc:740] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.106575 19128 consensus_queue.cc:260] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.107623 19130 tablet_bootstrap.cc:492] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: No bootstrap required, opened a new log
I20260709 13:19:48.108302 19130 ts_tablet_manager.cc:1403] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 13:19:48.108860 19127 tablet_bootstrap.cc:654] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.111737 19130 raft_consensus.cc:359] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.112941 19130 raft_consensus.cc:385] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.113399 19130 raft_consensus.cc:740] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.116146 18963 heartbeater.cc:499] Master 127.8.238.254:38875 was elected leader, sending a full tablet report...
I20260709 13:19:48.116879 19128 ts_tablet_manager.cc:1434] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 13:19:48.118041 19128 tablet_bootstrap.cc:492] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: Bootstrap starting.
I20260709 13:19:48.114741 19130 consensus_queue.cc:260] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.124185 19128 tablet_bootstrap.cc:654] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.125811 19127 tablet_bootstrap.cc:492] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d: No bootstrap required, opened a new log
I20260709 13:19:48.126468 19127 ts_tablet_manager.cc:1403] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:19:48.130349 19127 raft_consensus.cc:359] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.131155 19127 raft_consensus.cc:385] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.131453 19127 raft_consensus.cc:740] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b5fad5ef3e41a0a64c3a256305b01d, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.132721 19127 consensus_queue.cc:260] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.135465 19127 ts_tablet_manager.cc:1434] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:48.137169 19137 raft_consensus.cc:493] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.138072 19130 ts_tablet_manager.cc:1434] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.004s
I20260709 13:19:48.137888 19137 raft_consensus.cc:515] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.140316 19130 tablet_bootstrap.cc:492] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1: Bootstrap starting.
I20260709 13:19:48.140784 19112 heartbeater.cc:499] Master 127.8.238.254:38875 was elected leader, sending a full tablet report...
I20260709 13:19:48.147956 19130 tablet_bootstrap.cc:654] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.160275 19130 tablet_bootstrap.cc:492] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1: No bootstrap required, opened a new log
I20260709 13:19:48.160691 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" is_pre_election: true
I20260709 13:19:48.160985 19130 ts_tablet_manager.cc:1403] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:19:48.161527 19013 raft_consensus.cc:2468] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 0.
I20260709 13:19:48.163249 19051 leader_election.cc:304] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de54e9b80da94b78a71ac8745ffbc0a1, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:48.164333 19136 raft_consensus.cc:2804] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.164757 19136 raft_consensus.cc:493] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.165114 19136 raft_consensus.cc:3060] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.166864 19128 tablet_bootstrap.cc:492] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: No bootstrap required, opened a new log
I20260709 13:19:48.167318 19128 ts_tablet_manager.cc:1403] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.026s
I20260709 13:19:48.168190 19137 leader_election.cc:290] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163)
I20260709 13:19:48.169571 19130 raft_consensus.cc:359] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.170538 19130 raft_consensus.cc:385] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.170908 19130 raft_consensus.cc:740] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.171900 19130 consensus_queue.cc:260] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.173712 19128 raft_consensus.cc:359] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.173810 19136 raft_consensus.cc:515] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.174707 19128 raft_consensus.cc:385] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.175045 19128 raft_consensus.cc:740] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.175849 19128 consensus_queue.cc:260] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.178176 19128 ts_tablet_manager.cc:1434] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:19:48.177738 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:48.179911 19013 raft_consensus.cc:3060] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.177772 18938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0992d696d34516adf1087972dd91e2" is_pre_election: true
I20260709 13:19:48.182224 18938 raft_consensus.cc:2468] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 0.
I20260709 13:19:48.184161 19130 ts_tablet_manager.cc:1434] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:19:48.185516 19136 leader_election.cc:290] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 election: Requested vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163)
I20260709 13:19:48.186968 18938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0992d696d34516adf1087972dd91e2"
I20260709 13:19:48.187655 18938 raft_consensus.cc:3060] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.190023 19013 raft_consensus.cc:2468] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 1.
I20260709 13:19:48.191851 19051 leader_election.cc:304] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de54e9b80da94b78a71ac8745ffbc0a1, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:48.192775 19136 raft_consensus.cc:2804] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.193351 19136 raft_consensus.cc:697] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Becoming Leader. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Running, Role: LEADER
I20260709 13:19:48.194180 19136 consensus_queue.cc:237] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.195408 18938 raft_consensus.cc:2468] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 1.
I20260709 13:19:48.202466 18835 catalog_manager.cc:5697] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.232471 19134 raft_consensus.cc:493] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.233091 19134 raft_consensus.cc:515] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.235445 19134 leader_election.cc:290] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:48.245343 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233afae344984461a628ed647e412312" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" is_pre_election: true
I20260709 13:19:48.246026 19013 raft_consensus.cc:2468] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 0.
I20260709 13:19:48.246712 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233afae344984461a628ed647e412312" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" is_pre_election: true
I20260709 13:19:48.247020 18902 leader_election.cc:304] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:48.247442 19087 raft_consensus.cc:2468] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 0.
I20260709 13:19:48.247876 19134 raft_consensus.cc:2804] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.248235 19134 raft_consensus.cc:493] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.248548 19134 raft_consensus.cc:3060] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.254387 19134 raft_consensus.cc:515] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.256052 19134 leader_election.cc:290] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 election: Requested vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:48.257028 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233afae344984461a628ed647e412312" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:48.257146 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233afae344984461a628ed647e412312" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
I20260709 13:19:48.257634 19013 raft_consensus.cc:3060] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.257726 19087 raft_consensus.cc:3060] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.262930 19013 raft_consensus.cc:2468] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 1.
I20260709 13:19:48.263058 19087 raft_consensus.cc:2468] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 1.
I20260709 13:19:48.264213 18902 leader_election.cc:304] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:48.264886 19134 raft_consensus.cc:2804] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.265866 19134 raft_consensus.cc:697] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Becoming Leader. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Running, Role: LEADER
I20260709 13:19:48.266764 19134 consensus_queue.cc:237] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.273767 18835 catalog_manager.cc:5697] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0992d696d34516adf1087972dd91e2 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "1c0992d696d34516adf1087972dd91e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.312973 18835 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51404:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:48.315021 18835 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:48.339005 18927 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6b62f37af04a288e099ae0075bb4c3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d1e76c398864cd19ab6c163648b35fd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:48.340401 18927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6b62f37af04a288e099ae0075bb4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.340039 19002 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6b62f37af04a288e099ae0075bb4c3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d1e76c398864cd19ab6c163648b35fd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:48.341537 19002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6b62f37af04a288e099ae0075bb4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.341862 19077 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6b62f37af04a288e099ae0075bb4c3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d1e76c398864cd19ab6c163648b35fd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:48.343221 19077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6b62f37af04a288e099ae0075bb4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.347098 19076 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6301e1b0a84b398de81d24bee08764 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d1e76c398864cd19ab6c163648b35fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:48.349164 19076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6301e1b0a84b398de81d24bee08764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.349897 19003 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6301e1b0a84b398de81d24bee08764 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d1e76c398864cd19ab6c163648b35fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:48.351325 19003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6301e1b0a84b398de81d24bee08764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.359791 19127 tablet_bootstrap.cc:492] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Bootstrap starting.
I20260709 13:19:48.362622 18928 tablet_service.cc:1511] Processing CreateTablet for tablet 8c6301e1b0a84b398de81d24bee08764 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d1e76c398864cd19ab6c163648b35fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:48.364104 18928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c6301e1b0a84b398de81d24bee08764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.367405 19127 tablet_bootstrap.cc:654] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.368753 19130 tablet_bootstrap.cc:492] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: Bootstrap starting.
I20260709 13:19:48.375633 19130 tablet_bootstrap.cc:654] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.383669 19127 tablet_bootstrap.cc:492] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: No bootstrap required, opened a new log
I20260709 13:19:48.384241 19127 ts_tablet_manager.cc:1403] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:19:48.385972 19128 tablet_bootstrap.cc:492] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: Bootstrap starting.
I20260709 13:19:48.389667 19127 raft_consensus.cc:359] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.390328 19127 raft_consensus.cc:385] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.390645 19127 raft_consensus.cc:740] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b5fad5ef3e41a0a64c3a256305b01d, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.391719 19127 consensus_queue.cc:260] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.394080 19127 ts_tablet_manager.cc:1434] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:48.394524 19128 tablet_bootstrap.cc:654] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.393566 19130 tablet_bootstrap.cc:492] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: No bootstrap required, opened a new log
I20260709 13:19:48.395279 19127 tablet_bootstrap.cc:492] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d: Bootstrap starting.
I20260709 13:19:48.395373 19130 ts_tablet_manager.cc:1403] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.016s
I20260709 13:19:48.398883 19130 raft_consensus.cc:359] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.399840 19130 raft_consensus.cc:385] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.400218 19130 raft_consensus.cc:740] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.401137 19130 consensus_queue.cc:260] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.404903 19127 tablet_bootstrap.cc:654] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.406716 19130 ts_tablet_manager.cc:1434] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:19:48.407774 19128 tablet_bootstrap.cc:492] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: No bootstrap required, opened a new log
I20260709 13:19:48.408149 19130 tablet_bootstrap.cc:492] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1: Bootstrap starting.
I20260709 13:19:48.408375 19128 ts_tablet_manager.cc:1403] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.013s
I20260709 13:19:48.411931 19128 raft_consensus.cc:359] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.412789 19128 raft_consensus.cc:385] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.413071 19128 raft_consensus.cc:740] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.421629 19128 consensus_queue.cc:260] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.423009 19130 tablet_bootstrap.cc:654] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.424070 19127 tablet_bootstrap.cc:492] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d: No bootstrap required, opened a new log
I20260709 13:19:48.424162 19128 ts_tablet_manager.cc:1434] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:19:48.424777 19127 ts_tablet_manager.cc:1403] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.014s
I20260709 13:19:48.425732 19128 tablet_bootstrap.cc:492] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2: Bootstrap starting.
I20260709 13:19:48.428241 19127 raft_consensus.cc:359] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.429278 19127 raft_consensus.cc:385] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.429692 19127 raft_consensus.cc:740] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1b5fad5ef3e41a0a64c3a256305b01d, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.430748 19127 consensus_queue.cc:260] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.433993 19128 tablet_bootstrap.cc:654] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.438185 19136 raft_consensus.cc:493] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.438818 19136 raft_consensus.cc:515] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.440979 19136 leader_election.cc:290] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163), e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003)
I20260709 13:19:48.442471 18938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0992d696d34516adf1087972dd91e2" is_pre_election: true
I20260709 13:19:48.440943 19127 ts_tablet_manager.cc:1434] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:48.443311 18938 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 0.
I20260709 13:19:48.445017 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" is_pre_election: true
I20260709 13:19:48.445721 19013 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 0.
I20260709 13:19:48.447252 19050 leader_election.cc:304] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, de54e9b80da94b78a71ac8745ffbc0a1; no voters: 
I20260709 13:19:48.447587 19130 tablet_bootstrap.cc:492] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1: No bootstrap required, opened a new log
I20260709 13:19:48.448158 19130 ts_tablet_manager.cc:1403] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.008s
I20260709 13:19:48.448313 19128 tablet_bootstrap.cc:492] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2: No bootstrap required, opened a new log
I20260709 13:19:48.448871 19136 raft_consensus.cc:2804] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.448911 19128 ts_tablet_manager.cc:1403] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:19:48.449424 19136 raft_consensus.cc:493] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.449870 19136 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.451481 19130 raft_consensus.cc:359] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.452304 19130 raft_consensus.cc:385] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.452184 19128 raft_consensus.cc:359] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.452785 19130 raft_consensus.cc:740] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.453043 19128 raft_consensus.cc:385] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.453433 19128 raft_consensus.cc:740] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.453696 19130 consensus_queue.cc:260] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.454133 19128 consensus_queue.cc:260] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.456583 19128 ts_tablet_manager.cc:1434] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:48.458323 19130 ts_tablet_manager.cc:1434] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:19:48.460108 19136 raft_consensus.cc:515] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.462294 19136 leader_election.cc:290] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 election: Requested vote from peers 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163), e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003)
I20260709 13:19:48.464388 18938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0992d696d34516adf1087972dd91e2"
I20260709 13:19:48.464463 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:48.465238 18938 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.465298 19013 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.473389 19013 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 1.
I20260709 13:19:48.473389 18938 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 1.
I20260709 13:19:48.474579 19051 leader_election.cc:304] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de54e9b80da94b78a71ac8745ffbc0a1, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:48.475329 19136 raft_consensus.cc:2804] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.475787 19136 raft_consensus.cc:697] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Becoming Leader. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Running, Role: LEADER
I20260709 13:19:48.476579 19136 consensus_queue.cc:237] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.483985 18834 catalog_manager.cc:5697] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:48.527377 18884 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:48.578748 19134 raft_consensus.cc:493] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.579370 19134 raft_consensus.cc:515] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.579715 19136 raft_consensus.cc:493] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.580286 19136 raft_consensus.cc:515] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.582456 19136 leader_election.cc:290] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163), e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003)
I20260709 13:19:48.583001 19134 leader_election.cc:290] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:48.583380 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" is_pre_election: true
I20260709 13:19:48.584100 19013 raft_consensus.cc:2468] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 0.
I20260709 13:19:48.583314 18938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0992d696d34516adf1087972dd91e2" is_pre_election: true
I20260709 13:19:48.585623 18902 leader_election.cc:304] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:48.585738 18938 raft_consensus.cc:2468] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 0.
I20260709 13:19:48.586056 19011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" is_pre_election: true
I20260709 13:19:48.586556 19134 raft_consensus.cc:2804] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.586827 19011 raft_consensus.cc:2468] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 0.
I20260709 13:19:48.586974 19134 raft_consensus.cc:493] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.587191 19050 leader_election.cc:304] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, de54e9b80da94b78a71ac8745ffbc0a1; no voters: 
I20260709 13:19:48.584070 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" is_pre_election: true
I20260709 13:19:48.587428 19134 raft_consensus.cc:3060] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.588274 19087 raft_consensus.cc:2468] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 0.
I20260709 13:19:48.589030 19137 consensus_queue.cc:1048] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.590401 19136 raft_consensus.cc:2804] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.590906 19136 raft_consensus.cc:493] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.593890 19136 raft_consensus.cc:3060] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.595711 19134 raft_consensus.cc:515] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.598071 19134 leader_election.cc:290] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 election: Requested vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:48.601337 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
I20260709 13:19:48.600610 19011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:48.604297 19011 raft_consensus.cc:3060] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.605607 19136 raft_consensus.cc:515] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.606837 19087 raft_consensus.cc:2393] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c0992d696d34516adf1087972dd91e2 in current term 1: Already voted for candidate de54e9b80da94b78a71ac8745ffbc0a1 in this term.
I20260709 13:19:48.608603 18938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c0992d696d34516adf1087972dd91e2"
I20260709 13:19:48.609328 19136 leader_election.cc:290] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 election: Requested vote from peers 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163), e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003)
I20260709 13:19:48.609640 19012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c6301e1b0a84b398de81d24bee08764" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:48.609519 18938 raft_consensus.cc:2393] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate de54e9b80da94b78a71ac8745ffbc0a1 in current term 1: Already voted for candidate 1c0992d696d34516adf1087972dd91e2 in this term.
I20260709 13:19:48.611451 19051 leader_election.cc:304] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de54e9b80da94b78a71ac8745ffbc0a1; no voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d
I20260709 13:19:48.612610 19136 raft_consensus.cc:2749] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.615935 19011 raft_consensus.cc:2468] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 1.
I20260709 13:19:48.617261 18902 leader_election.cc:304] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: de54e9b80da94b78a71ac8745ffbc0a1
I20260709 13:19:48.618283 19134 raft_consensus.cc:2804] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.618809 19134 raft_consensus.cc:697] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Becoming Leader. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Running, Role: LEADER
I20260709 13:19:48.619699 19134 consensus_queue.cc:237] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.619990 19137 consensus_queue.cc:1048] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.633637 18834 catalog_manager.cc:5697] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c0992d696d34516adf1087972dd91e2 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "1c0992d696d34516adf1087972dd91e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.660116 19134 consensus_queue.cc:1048] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.672012 19164 consensus_queue.cc:1048] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.702692 19087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb"
dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
mode: GRACEFUL
new_leader_uuid: "1c0992d696d34516adf1087972dd91e2"
 from {username='slave'} at 127.0.0.1:56676
I20260709 13:19:48.703217 19087 raft_consensus.cc:606] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Received request to transfer leadership to TS 1c0992d696d34516adf1087972dd91e2
I20260709 13:19:48.716614 18938 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233afae344984461a628ed647e412312"
dest_uuid: "1c0992d696d34516adf1087972dd91e2"
mode: GRACEFUL
new_leader_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
 from {username='slave'} at 127.0.0.1:39874
I20260709 13:19:48.717188 18938 raft_consensus.cc:606] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Received request to transfer leadership to TS de54e9b80da94b78a71ac8745ffbc0a1
I20260709 13:19:48.723626 19087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3"
dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
mode: GRACEFUL
new_leader_uuid: "1c0992d696d34516adf1087972dd91e2"
 from {username='slave'} at 127.0.0.1:56676
I20260709 13:19:48.724246 19087 raft_consensus.cc:606] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Received request to transfer leadership to TS 1c0992d696d34516adf1087972dd91e2
I20260709 13:19:48.930166 19137 consensus_queue.cc:1048] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.939216 19157 raft_consensus.cc:993] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: : Instructing follower 1c0992d696d34516adf1087972dd91e2 to start an election
I20260709 13:19:48.939707 19157 raft_consensus.cc:1081] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Signalling peer 1c0992d696d34516adf1087972dd91e2 to start an election
I20260709 13:19:48.941847 18937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3"
dest_uuid: "1c0992d696d34516adf1087972dd91e2"
 from {username='slave'} at 127.0.0.1:39868
I20260709 13:19:48.943425 18937 raft_consensus.cc:493] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:48.943864 18937 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:48.948464 19136 consensus_queue.cc:1048] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.952960 18937 raft_consensus.cc:515] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.960971 19011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:48.961565 19011 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:48.962873 18937 leader_election.cc:290] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 2 election: Requested vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:48.963904 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
I20260709 13:19:48.964458 19087 raft_consensus.cc:3055] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:48.964761 19087 raft_consensus.cc:740] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Running, Role: LEADER
I20260709 13:19:48.965426 19087 consensus_queue.cc:260] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.966585 19087 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:48.971863 19087 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 2.
I20260709 13:19:48.972972 18903 leader_election.cc:304] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, de54e9b80da94b78a71ac8745ffbc0a1; no voters: 
I20260709 13:19:48.973758 19164 raft_consensus.cc:2804] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:48.974256 19164 raft_consensus.cc:697] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Becoming Leader. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Running, Role: LEADER
I20260709 13:19:48.975116 19164 consensus_queue.cc:237] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:48.975667 19011 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 2.
I20260709 13:19:48.982324 18834 catalog_manager.cc:5697] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 reported cstate change: term changed from 1 to 2, leader changed from de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195) to 1c0992d696d34516adf1087972dd91e2 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "1c0992d696d34516adf1087972dd91e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.032452  9147 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:19:49.034299  9147 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:19:49.034721  9147 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:19:49.046380 18937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3"
dest_uuid: "1c0992d696d34516adf1087972dd91e2"
mode: GRACEFUL
new_leader_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
 from {username='slave'} at 127.0.0.1:39888
I20260709 13:19:49.046943 18937 raft_consensus.cc:606] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Received request to transfer leadership to TS e1b5fad5ef3e41a0a64c3a256305b01d
I20260709 13:19:49.048148  9147 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:19:49.120246 19164 consensus_queue.cc:1048] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.132894 19134 consensus_queue.cc:1048] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.136432 19137 raft_consensus.cc:993] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: : Instructing follower 1c0992d696d34516adf1087972dd91e2 to start an election
I20260709 13:19:49.136942 19137 raft_consensus.cc:1081] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Signalling peer 1c0992d696d34516adf1087972dd91e2 to start an election
I20260709 13:19:49.138867 18937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb"
dest_uuid: "1c0992d696d34516adf1087972dd91e2"
 from {username='slave'} at 127.0.0.1:39868
I20260709 13:19:49.139447 18937 raft_consensus.cc:493] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.139804 18937 raft_consensus.cc:3060] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.148393 18937 raft_consensus.cc:515] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.151532 18937 leader_election.cc:290] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 2 election: Requested vote from peers e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:49.151793 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
I20260709 13:19:49.152699 19087 raft_consensus.cc:3055] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.152918 19011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eeed47e6ad744cf956ebfd6d94339eb" candidate_uuid: "1c0992d696d34516adf1087972dd91e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:49.153136 19087 raft_consensus.cc:740] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Running, Role: LEADER
I20260709 13:19:49.153635 19011 raft_consensus.cc:3060] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.154171 19087 consensus_queue.cc:260] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.155604 19087 raft_consensus.cc:3060] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.161427 19011 raft_consensus.cc:2468] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 2.
I20260709 13:19:49.162844 18902 leader_election.cc:304] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:49.163193 19087 raft_consensus.cc:2468] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c0992d696d34516adf1087972dd91e2 in term 2.
I20260709 13:19:49.163825 19134 raft_consensus.cc:2804] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.164345 19134 raft_consensus.cc:697] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Becoming Leader. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Running, Role: LEADER
I20260709 13:19:49.165199 19134 consensus_queue.cc:237] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.171538 18836 catalog_manager.cc:5697] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 reported cstate change: term changed from 1 to 2, leader changed from de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195) to 1c0992d696d34516adf1087972dd91e2 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "1c0992d696d34516adf1087972dd91e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.180212 19142 raft_consensus.cc:993] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: : Instructing follower de54e9b80da94b78a71ac8745ffbc0a1 to start an election
I20260709 13:19:49.180716 19134 raft_consensus.cc:1081] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Signalling peer de54e9b80da94b78a71ac8745ffbc0a1 to start an election
I20260709 13:19:49.182287 19087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "233afae344984461a628ed647e412312"
dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
 from {username='slave'} at 127.0.0.1:56674
I20260709 13:19:49.182788 19087 raft_consensus.cc:493] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.183095 19087 raft_consensus.cc:3060] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.188689 19087 raft_consensus.cc:515] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.191027 19087 leader_election.cc:290] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 2 election: Requested vote from peers 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163), e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194:44003)
I20260709 13:19:49.191336 18937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233afae344984461a628ed647e412312" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c0992d696d34516adf1087972dd91e2"
I20260709 13:19:49.191666 19011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233afae344984461a628ed647e412312" candidate_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
I20260709 13:19:49.192457 19011 raft_consensus.cc:3060] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.192952 18937 raft_consensus.cc:3055] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.193286 18937 raft_consensus.cc:740] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Running, Role: LEADER
I20260709 13:19:49.194130 18937 consensus_queue.cc:260] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.195561 18937 raft_consensus.cc:3060] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.199275 19011 raft_consensus.cc:2468] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 2.
I20260709 13:19:49.200596 19051 leader_election.cc:304] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de54e9b80da94b78a71ac8745ffbc0a1, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:49.201329 18937 raft_consensus.cc:2468] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de54e9b80da94b78a71ac8745ffbc0a1 in term 2.
I20260709 13:19:49.201457 19137 raft_consensus.cc:2804] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.202056 19137 raft_consensus.cc:697] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 LEADER]: Becoming Leader. State: Replica: de54e9b80da94b78a71ac8745ffbc0a1, State: Running, Role: LEADER
I20260709 13:19:49.202931 19137 consensus_queue.cc:237] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.209481 18836 catalog_manager.cc:5697] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 reported cstate change: term changed from 1 to 2, leader changed from 1c0992d696d34516adf1087972dd91e2 (127.8.238.193) to de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.458436 19011 raft_consensus.cc:1275] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Refusing update from remote peer 1c0992d696d34516adf1087972dd91e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.459924 19134 consensus_queue.cc:1048] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.465126 19142 raft_consensus.cc:993] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: : Instructing follower e1b5fad5ef3e41a0a64c3a256305b01d to start an election
I20260709 13:19:49.465632 19164 raft_consensus.cc:1081] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Signalling peer e1b5fad5ef3e41a0a64c3a256305b01d to start an election
I20260709 13:19:49.467778 19012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3"
dest_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d"
 from {username='slave'} at 127.0.0.1:36084
I20260709 13:19:49.468482 19012 raft_consensus.cc:493] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.468912 19012 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:49.470206 19087 raft_consensus.cc:1275] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Refusing update from remote peer 1c0992d696d34516adf1087972dd91e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.472008 19134 consensus_queue.cc:1048] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.477597 19012 raft_consensus.cc:515] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.479314 19011 raft_consensus.cc:1240] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 FOLLOWER]: Rejecting Update request from peer 1c0992d696d34516adf1087972dd91e2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:49.483340 19134 consensus_queue.cc:1059] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.484503 19142 raft_consensus.cc:3055] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:49.484895 19142 raft_consensus.cc:740] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c0992d696d34516adf1087972dd91e2, State: Running, Role: LEADER
I20260709 13:19:49.485743 19142 consensus_queue.cc:260] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.486920 19142 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:49.488955 19012 leader_election.cc:290] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [CANDIDATE]: Term 3 election: Requested vote from peers 1c0992d696d34516adf1087972dd91e2 (127.8.238.193:42163), de54e9b80da94b78a71ac8745ffbc0a1 (127.8.238.195:42151)
I20260709 13:19:49.496613 18937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c0992d696d34516adf1087972dd91e2"
I20260709 13:19:49.503830 19087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6b62f37af04a288e099ae0075bb4c3" candidate_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de54e9b80da94b78a71ac8745ffbc0a1"
I20260709 13:19:49.504560 19087 raft_consensus.cc:3060] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:49.504696 18937 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b5fad5ef3e41a0a64c3a256305b01d in term 3.
I20260709 13:19:49.506677 18976 leader_election.cc:304] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c0992d696d34516adf1087972dd91e2, e1b5fad5ef3e41a0a64c3a256305b01d; no voters: 
I20260709 13:19:49.507479 19132 raft_consensus.cc:2804] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:49.508883 19132 raft_consensus.cc:697] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 LEADER]: Becoming Leader. State: Replica: e1b5fad5ef3e41a0a64c3a256305b01d, State: Running, Role: LEADER
I20260709 13:19:49.509850 19132 consensus_queue.cc:237] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } }
I20260709 13:19:49.512890 19087 raft_consensus.cc:2468] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1b5fad5ef3e41a0a64c3a256305b01d in term 3.
I20260709 13:19:49.517270 18836 catalog_manager.cc:5697] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d reported cstate change: term changed from 2 to 3, leader changed from 1c0992d696d34516adf1087972dd91e2 (127.8.238.193) to e1b5fad5ef3e41a0a64c3a256305b01d (127.8.238.194). New cstate: current_term: 3 leader_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.583424 19012 raft_consensus.cc:1275] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Refusing update from remote peer 1c0992d696d34516adf1087972dd91e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.584621 19142 consensus_queue.cc:1048] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.592758 19087 raft_consensus.cc:1275] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Refusing update from remote peer 1c0992d696d34516adf1087972dd91e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.594394 19164 consensus_queue.cc:1048] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de54e9b80da94b78a71ac8745ffbc0a1" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 42151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.660481 19012 raft_consensus.cc:1275] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Refusing update from remote peer de54e9b80da94b78a71ac8745ffbc0a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.661952 19137 consensus_queue.cc:1048] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1b5fad5ef3e41a0a64c3a256305b01d" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 44003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.672458 18937 raft_consensus.cc:1275] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Refusing update from remote peer de54e9b80da94b78a71ac8745ffbc0a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.675083 19178 consensus_queue.cc:1048] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c0992d696d34516adf1087972dd91e2" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 42163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:49.681157  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
I20260709 13:19:49.710976  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:49.711645  9147 tablet_replica.cc:333] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2: stopping tablet replica
I20260709 13:19:49.712251  9147 raft_consensus.cc:2243] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.712656  9147 raft_consensus.cc:2272] T 8b6b62f37af04a288e099ae0075bb4c3 P 1c0992d696d34516adf1087972dd91e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.715018  9147 tablet_replica.cc:333] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2: stopping tablet replica
I20260709 13:19:49.715643  9147 raft_consensus.cc:2243] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.716085  9147 raft_consensus.cc:2272] T 233afae344984461a628ed647e412312 P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.718488  9147 tablet_replica.cc:333] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2: stopping tablet replica
I20260709 13:19:49.719031  9147 raft_consensus.cc:2243] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:49.719820  9147 raft_consensus.cc:2272] T 8c6301e1b0a84b398de81d24bee08764 P 1c0992d696d34516adf1087972dd91e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.722098  9147 tablet_replica.cc:333] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2: stopping tablet replica
I20260709 13:19:49.722676  9147 raft_consensus.cc:2243] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:49.723517  9147 raft_consensus.cc:2272] T 1eeed47e6ad744cf956ebfd6d94339eb P 1c0992d696d34516adf1087972dd91e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.747777  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
I20260709 13:19:49.760165  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
I20260709 13:19:49.781239  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:49.782032  9147 tablet_replica.cc:333] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: stopping tablet replica
I20260709 13:19:49.782913  9147 raft_consensus.cc:2243] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:49.783571  9147 pending_rounds.cc:70] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Trying to abort 2 pending ops.
I20260709 13:19:49.783744  9147 pending_rounds.cc:77] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638664243273728 op_type: NO_OP noop_request { }
I20260709 13:19:49.784017  9147 raft_consensus.cc:2889] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:49.784219  9147 pending_rounds.cc:77] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638662049738752 op_type: NO_OP noop_request { }
I20260709 13:19:49.784399  9147 raft_consensus.cc:2889] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:49.784610  9147 raft_consensus.cc:2272] T 8b6b62f37af04a288e099ae0075bb4c3 P e1b5fad5ef3e41a0a64c3a256305b01d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.787014  9147 tablet_replica.cc:333] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d: stopping tablet replica
I20260709 13:19:49.787516  9147 raft_consensus.cc:2243] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.787921  9147 raft_consensus.cc:2272] T 233afae344984461a628ed647e412312 P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.790136  9147 tablet_replica.cc:333] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d: stopping tablet replica
I20260709 13:19:49.790740  9147 raft_consensus.cc:2243] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.791160  9147 raft_consensus.cc:2272] T 8c6301e1b0a84b398de81d24bee08764 P e1b5fad5ef3e41a0a64c3a256305b01d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.793467  9147 tablet_replica.cc:333] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d: stopping tablet replica
I20260709 13:19:49.793924  9147 raft_consensus.cc:2243] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.794413  9147 raft_consensus.cc:2272] T 1eeed47e6ad744cf956ebfd6d94339eb P e1b5fad5ef3e41a0a64c3a256305b01d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.807967  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
I20260709 13:19:49.821111  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
I20260709 13:19:49.840880  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:49.841478  9147 tablet_replica.cc:333] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1: stopping tablet replica
I20260709 13:19:49.841995  9147 raft_consensus.cc:2243] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.842504  9147 raft_consensus.cc:2272] T 8b6b62f37af04a288e099ae0075bb4c3 P de54e9b80da94b78a71ac8745ffbc0a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.844605  9147 tablet_replica.cc:333] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1: stopping tablet replica
I20260709 13:19:49.845091  9147 raft_consensus.cc:2243] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:49.845858  9147 raft_consensus.cc:2272] T 233afae344984461a628ed647e412312 P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.849673  9147 tablet_replica.cc:333] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1: stopping tablet replica
I20260709 13:19:49.850449  9147 raft_consensus.cc:2243] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.851208  9147 raft_consensus.cc:2272] T 8c6301e1b0a84b398de81d24bee08764 P de54e9b80da94b78a71ac8745ffbc0a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.854735  9147 tablet_replica.cc:333] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1: stopping tablet replica
I20260709 13:19:49.855479  9147 raft_consensus.cc:2243] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:49.856117  9147 raft_consensus.cc:2272] T 1eeed47e6ad744cf956ebfd6d94339eb P de54e9b80da94b78a71ac8745ffbc0a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.869992  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:19:49.882682  9147 master.cc:562] Master@127.8.238.254:38875 shutting down...
I20260709 13:19:49.900650  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:49.901223  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.901530  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3a7587614a642299c179d9ca65ee5dd: stopping tablet replica
I20260709 13:19:49.913952  9147 master.cc:584] Master@127.8.238.254:38875 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2555 ms)
[----------] 6 tests from LeaderRebalancerTest (339996 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:19:49.943861  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:42815
I20260709 13:19:49.945041  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:49.950322 19180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:49.950450 19181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:49.951931 19183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:49.952852  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:49.953756  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:49.954005  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:49.954126  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603189954114 us; error 0 us; skew 500 ppm
I20260709 13:19:49.954875  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:49.957360  9147 webserver.cc:533] Webserver started at http://127.8.238.254:35399/ using document root <none> and password file <none>
I20260709 13:19:49.957847  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:49.958007  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:49.958307  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:49.959456  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "9d91e2b8c6d946328d3493ce7858bd4f"
format_stamp: "Formatted at 2026-07-09 13:19:49 on dist-test-slave-ml7r"
I20260709 13:19:49.964295  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:19:49.967962 19188 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:49.968768  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:49.969097  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "9d91e2b8c6d946328d3493ce7858bd4f"
format_stamp: "Formatted at 2026-07-09 13:19:49 on dist-test-slave-ml7r"
I20260709 13:19:49.969408  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:49.996598  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:49.997740  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.035804  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:42815
I20260709 13:19:50.035897 19239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:42815 every 8 connection(s)
I20260709 13:19:50.039875 19240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.051124 19240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f: Bootstrap starting.
I20260709 13:19:50.055754 19240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.059954 19240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f: No bootstrap required, opened a new log
I20260709 13:19:50.062090 19240 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" member_type: VOTER }
I20260709 13:19:50.062610 19240 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.062853 19240 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d91e2b8c6d946328d3493ce7858bd4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.063551 19240 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" member_type: VOTER }
I20260709 13:19:50.064023 19240 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:50.064248 19240 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:50.064527 19240 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.069464 19240 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" member_type: VOTER }
I20260709 13:19:50.070042 19240 leader_election.cc:304] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d91e2b8c6d946328d3493ce7858bd4f; no voters: 
I20260709 13:19:50.071334 19240 leader_election.cc:290] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:50.071671 19243 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.073249 19243 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 1 LEADER]: Becoming Leader. State: Replica: 9d91e2b8c6d946328d3493ce7858bd4f, State: Running, Role: LEADER
I20260709 13:19:50.074005 19243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" member_type: VOTER }
I20260709 13:19:50.074645 19240 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:50.077091 19244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" member_type: VOTER } }
I20260709 13:19:50.078003 19244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:50.077086 19245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d91e2b8c6d946328d3493ce7858bd4f. Latest consensus state: current_term: 1 leader_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d91e2b8c6d946328d3493ce7858bd4f" member_type: VOTER } }
I20260709 13:19:50.078738 19245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:50.084270 19249 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:50.092562 19249 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:50.093634  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:50.102056 19249 catalog_manager.cc:1383] Generated new cluster ID: 89bddb500e7242ef8c1d3fdb6c74fee2
I20260709 13:19:50.102438 19249 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:50.134609 19249 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:50.136000 19249 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:50.153939 19249 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f: Generated new TSK 0
I20260709 13:19:50.154623 19249 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:50.160012  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:50.165838 19261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.167033 19262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.168773 19264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.169401  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:50.170389  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:50.170605  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:50.170786  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603190170767 us; error 0 us; skew 500 ppm
I20260709 13:19:50.171388  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:50.173669  9147 webserver.cc:533] Webserver started at http://127.8.238.193:37117/ using document root <none> and password file <none>
I20260709 13:19:50.174090  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:50.174311  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:50.174548  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:50.175582  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "a6a4a238d13e442b9da85f191acbe738"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-ml7r"
I20260709 13:19:50.182801  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:19:50.187319 19269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.188253  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:19:50.188536  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "a6a4a238d13e442b9da85f191acbe738"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-ml7r"
I20260709 13:19:50.188789  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:50.202826  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:50.203917  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.205266  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:50.207787  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:50.208010  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.208276  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:50.208427  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.248098  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:39829
I20260709 13:19:50.248206 19331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:39829 every 8 connection(s)
I20260709 13:19:50.253512  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:50.260563 19336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.262300 19337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.266012  9147 server_base.cc:1061] running on GCE node
W20260709 13:19:50.266898 19339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.267761 19332 heartbeater.cc:344] Connected to a master server at 127.8.238.254:42815
I20260709 13:19:50.268146  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:50.268179 19332 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:50.268500  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:50.268711  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603190268667 us; error 0 us; skew 500 ppm
I20260709 13:19:50.269147 19332 heartbeater.cc:507] Master 127.8.238.254:42815 requested a full tablet report, sending...
I20260709 13:19:50.269304  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:50.271804 19205 ts_manager.cc:194] Registered new tserver with Master: a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829)
I20260709 13:19:50.272485  9147 webserver.cc:533] Webserver started at http://127.8.238.194:42579/ using document root <none> and password file <none>
I20260709 13:19:50.273208  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:50.273454  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:50.273787  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:50.274390 19205 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52010
I20260709 13:19:50.275278  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "93b4e264ae824f25b79453db3d1f3d8e"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-ml7r"
I20260709 13:19:50.280282  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:50.283891 19344 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.284767  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:50.285112  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "93b4e264ae824f25b79453db3d1f3d8e"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-ml7r"
I20260709 13:19:50.285424  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:50.304870  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:50.306046  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.307657  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:50.310004  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:50.310194  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.310519  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:50.310678  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.350566  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:39847
I20260709 13:19:50.350668 19406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:39847 every 8 connection(s)
I20260709 13:19:50.355680  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:50.362936 19410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.364326 19411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.367818 19413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.368391 19407 heartbeater.cc:344] Connected to a master server at 127.8.238.254:42815
I20260709 13:19:50.368896  9147 server_base.cc:1061] running on GCE node
I20260709 13:19:50.368948 19407 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:50.369835  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:50.370019 19407 heartbeater.cc:507] Master 127.8.238.254:42815 requested a full tablet report, sending...
W20260709 13:19:50.370051  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:50.370556  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603190370535 us; error 0 us; skew 500 ppm
I20260709 13:19:50.371389  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:50.372502 19205 ts_manager.cc:194] Registered new tserver with Master: 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:50.374049  9147 webserver.cc:533] Webserver started at http://127.8.238.195:39701/ using document root <none> and password file <none>
I20260709 13:19:50.374394 19205 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52018
I20260709 13:19:50.374709  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:50.375010  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:50.375293  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:50.376566  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-ml7r"
I20260709 13:19:50.380975  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:50.384295 19418 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.385063  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:50.385387  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-ml7r"
I20260709 13:19:50.385673  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:50.398723  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:50.399834  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.401314  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:50.403659  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:50.403903  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.404160  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:50.404347  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.443305  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:33047
I20260709 13:19:50.443426 19480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:33047 every 8 connection(s)
I20260709 13:19:50.457111 19481 heartbeater.cc:344] Connected to a master server at 127.8.238.254:42815
I20260709 13:19:50.457475 19481 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:50.458176 19481 heartbeater.cc:507] Master 127.8.238.254:42815 requested a full tablet report, sending...
I20260709 13:19:50.460187 19205 ts_manager.cc:194] Registered new tserver with Master: 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:50.460335  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013699759s
I20260709 13:19:50.461629 19205 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52026
I20260709 13:19:50.486485 19205 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52028:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:50.489217 19205 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:50.560160 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 21a86a543ba74b68858d8eb05c175138 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:50.561662 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a86a543ba74b68858d8eb05c175138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.567548 19445 tablet_service.cc:1511] Processing CreateTablet for tablet bbd28782bd7e4d7fbd73c3f0aab258e2 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:50.569140 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd28782bd7e4d7fbd73c3f0aab258e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.571374 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 63f5bca940b943c18db11e38255b1261 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:50.573084 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f5bca940b943c18db11e38255b1261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.574249 19372 tablet_service.cc:1511] Processing CreateTablet for tablet 21a86a543ba74b68858d8eb05c175138 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:50.575745 19372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a86a543ba74b68858d8eb05c175138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.577142 19442 tablet_service.cc:1511] Processing CreateTablet for tablet e5a15d95cfc74abbafcb5d82a6ec64d7 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:50.577565 19367 tablet_service.cc:1511] Processing CreateTablet for tablet 5e63ba69e86741a682ae8e0052ed390f (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:50.578964 19365 tablet_service.cc:1511] Processing CreateTablet for tablet 43dd69a5570e4e6b9d98d8664a654e2d (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:50.579341 19371 tablet_service.cc:1511] Processing CreateTablet for tablet bbd28782bd7e4d7fbd73c3f0aab258e2 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:50.579028 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e63ba69e86741a682ae8e0052ed390f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.580164 19366 tablet_service.cc:1511] Processing CreateTablet for tablet 4b971ad6505448589f155d7b895b6723 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:50.581503 19365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dd69a5570e4e6b9d98d8664a654e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.581741 19370 tablet_service.cc:1511] Processing CreateTablet for tablet 63f5bca940b943c18db11e38255b1261 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:50.582448 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 5e63ba69e86741a682ae8e0052ed390f (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:50.582711 19368 tablet_service.cc:1511] Processing CreateTablet for tablet e5a15d95cfc74abbafcb5d82a6ec64d7 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:50.583262 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f5bca940b943c18db11e38255b1261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.584048 19368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a15d95cfc74abbafcb5d82a6ec64d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.584291 19442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a15d95cfc74abbafcb5d82a6ec64d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.585850 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e63ba69e86741a682ae8e0052ed390f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.586527 19369 tablet_service.cc:1511] Processing CreateTablet for tablet b45420f34ff0497785fee7251b2c3c7e (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:50.588320 19369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45420f34ff0497785fee7251b2c3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.575309 19443 tablet_service.cc:1511] Processing CreateTablet for tablet b45420f34ff0497785fee7251b2c3c7e (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:50.590785 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45420f34ff0497785fee7251b2c3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.592495 19371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd28782bd7e4d7fbd73c3f0aab258e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.594305 19366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b971ad6505448589f155d7b895b6723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.595906 19297 tablet_service.cc:1511] Processing CreateTablet for tablet 21a86a543ba74b68858d8eb05c175138 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:50.597901 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a86a543ba74b68858d8eb05c175138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.600325 19296 tablet_service.cc:1511] Processing CreateTablet for tablet bbd28782bd7e4d7fbd73c3f0aab258e2 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:50.604353 19296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbd28782bd7e4d7fbd73c3f0aab258e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.618077 19295 tablet_service.cc:1511] Processing CreateTablet for tablet 63f5bca940b943c18db11e38255b1261 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:50.619696 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f5bca940b943c18db11e38255b1261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.619845 19294 tablet_service.cc:1511] Processing CreateTablet for tablet b45420f34ff0497785fee7251b2c3c7e (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:50.621402 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45420f34ff0497785fee7251b2c3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.623431 19440 tablet_service.cc:1511] Processing CreateTablet for tablet 4b971ad6505448589f155d7b895b6723 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:50.624881 19440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b971ad6505448589f155d7b895b6723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.631966 19439 tablet_service.cc:1511] Processing CreateTablet for tablet 43dd69a5570e4e6b9d98d8664a654e2d (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:50.633618 19439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dd69a5570e4e6b9d98d8664a654e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.638473 19293 tablet_service.cc:1511] Processing CreateTablet for tablet e5a15d95cfc74abbafcb5d82a6ec64d7 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:50.640106 19293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a15d95cfc74abbafcb5d82a6ec64d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.648528 19292 tablet_service.cc:1511] Processing CreateTablet for tablet 5e63ba69e86741a682ae8e0052ed390f (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:50.650111 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e63ba69e86741a682ae8e0052ed390f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.679023 19364 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe84ad7632741b78518543ce38ed68b (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:50.680464 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe84ad7632741b78518543ce38ed68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.707528 19291 tablet_service.cc:1511] Processing CreateTablet for tablet 4b971ad6505448589f155d7b895b6723 (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:50.709657 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b971ad6505448589f155d7b895b6723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.720029 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe84ad7632741b78518543ce38ed68b (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:50.721431 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe84ad7632741b78518543ce38ed68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.719817 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 43dd69a5570e4e6b9d98d8664a654e2d (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:50.723704 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dd69a5570e4e6b9d98d8664a654e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.724464 19438 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe84ad7632741b78518543ce38ed68b (DEFAULT_TABLE table=test-workload [id=b2f1076f90e24ee8abc262db8a3bdbf9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:50.725929 19438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe84ad7632741b78518543ce38ed68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.764312 19497 tablet_bootstrap.cc:492] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:50.770514 19498 tablet_bootstrap.cc:492] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:50.771186 19497 tablet_bootstrap.cc:654] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.775942 19499 tablet_bootstrap.cc:492] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:50.847292 19499 tablet_bootstrap.cc:654] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.864571 19498 tablet_bootstrap.cc:654] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.889575 19497 tablet_bootstrap.cc:492] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:50.890803 19497 ts_tablet_manager.cc:1403] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.009s
I20260709 13:19:50.897225 19499 tablet_bootstrap.cc:492] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:50.898379 19499 ts_tablet_manager.cc:1403] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.031s
I20260709 13:19:50.899597 19497 raft_consensus.cc:359] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.901279 19497 raft_consensus.cc:385] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.901669 19497 raft_consensus.cc:740] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.903088 19499 raft_consensus.cc:359] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.904300 19499 raft_consensus.cc:385] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.904707 19499 raft_consensus.cc:740] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.905833 19499 consensus_queue.cc:260] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.911743 19498 tablet_bootstrap.cc:492] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:50.912685 19498 ts_tablet_manager.cc:1403] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.000s
I20260709 13:19:50.914955 19497 consensus_queue.cc:260] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.921697 19498 raft_consensus.cc:359] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.922439 19497 ts_tablet_manager.cc:1434] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:19:50.922905 19498 raft_consensus.cc:385] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.923305 19498 raft_consensus.cc:740] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.924108 19498 consensus_queue.cc:260] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.926432 19481 heartbeater.cc:499] Master 127.8.238.254:42815 was elected leader, sending a full tablet report...
I20260709 13:19:50.927083 19499 ts_tablet_manager.cc:1434] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.028s	user 0.015s	sys 0.013s
I20260709 13:19:50.927664 19498 ts_tablet_manager.cc:1434] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:19:50.928920 19407 heartbeater.cc:499] Master 127.8.238.254:42815 was elected leader, sending a full tablet report...
I20260709 13:19:50.929428 19498 tablet_bootstrap.cc:492] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:50.931012 19332 heartbeater.cc:499] Master 127.8.238.254:42815 was elected leader, sending a full tablet report...
I20260709 13:19:50.931202 19497 tablet_bootstrap.cc:492] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:50.931536 19499 tablet_bootstrap.cc:492] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:50.940657 19499 tablet_bootstrap.cc:654] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.948293 19497 tablet_bootstrap.cc:654] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.953125 19499 tablet_bootstrap.cc:492] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:50.953972 19499 ts_tablet_manager.cc:1403] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 13:19:50.955731 19498 tablet_bootstrap.cc:654] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.957644 19499 raft_consensus.cc:359] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.958629 19499 raft_consensus.cc:385] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.958992 19499 raft_consensus.cc:740] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.960179 19499 consensus_queue.cc:260] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.962024 19497 tablet_bootstrap.cc:492] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:50.962918 19497 ts_tablet_manager.cc:1403] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 13:19:50.963145 19499 ts_tablet_manager.cc:1434] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:19:50.964671 19499 tablet_bootstrap.cc:492] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:50.967464 19497 raft_consensus.cc:359] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.968832 19497 raft_consensus.cc:385] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.969310 19497 raft_consensus.cc:740] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.970816 19497 consensus_queue.cc:260] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:50.974960 19499 tablet_bootstrap.cc:654] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.975194 19497 ts_tablet_manager.cc:1434] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 13:19:50.976684 19497 tablet_bootstrap.cc:492] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:50.977723 19498 tablet_bootstrap.cc:492] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:50.978487 19498 ts_tablet_manager.cc:1403] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.021s
I20260709 13:19:50.982087 19498 raft_consensus.cc:359] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:50.983026 19498 raft_consensus.cc:385] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.983393 19498 raft_consensus.cc:740] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.984613 19497 tablet_bootstrap.cc:654] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.984440 19498 consensus_queue.cc:260] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:50.987478 19498 ts_tablet_manager.cc:1434] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:19:50.989190 19498 tablet_bootstrap.cc:492] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:50.999469 19498 tablet_bootstrap.cc:654] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.013128 19498 tablet_bootstrap.cc:492] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.014003 19498 ts_tablet_manager.cc:1403] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.005s
I20260709 13:19:51.018697 19498 raft_consensus.cc:359] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.019958 19498 raft_consensus.cc:385] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.020473 19498 raft_consensus.cc:740] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.021807 19498 consensus_queue.cc:260] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.023731 19499 tablet_bootstrap.cc:492] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.023777 19497 tablet_bootstrap.cc:492] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.024535 19499 ts_tablet_manager.cc:1403] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.060s	user 0.032s	sys 0.021s
I20260709 13:19:51.024621 19497 ts_tablet_manager.cc:1403] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.022s
I20260709 13:19:51.027427 19498 ts_tablet_manager.cc:1434] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:19:51.028039 19499 raft_consensus.cc:359] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.028920 19499 raft_consensus.cc:385] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.029227 19499 raft_consensus.cc:740] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.030023 19499 consensus_queue.cc:260] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.030846 19497 raft_consensus.cc:359] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.031754 19497 raft_consensus.cc:385] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.032059 19497 raft_consensus.cc:740] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.032907 19499 ts_tablet_manager.cc:1434] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:51.033155 19497 consensus_queue.cc:260] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.034130 19499 tablet_bootstrap.cc:492] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:51.037312 19498 tablet_bootstrap.cc:492] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:51.038995 19497 ts_tablet_manager.cc:1434] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:19:51.040359 19497 tablet_bootstrap.cc:492] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:51.042105 19499 tablet_bootstrap.cc:654] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.047753 19497 tablet_bootstrap.cc:654] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.054188 19498 tablet_bootstrap.cc:654] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.057286 19497 tablet_bootstrap.cc:492] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.058848 19497 ts_tablet_manager.cc:1403] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:19:51.060693 19499 tablet_bootstrap.cc:492] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.061477 19499 ts_tablet_manager.cc:1403] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.012s
I20260709 13:19:51.062032 19497 raft_consensus.cc:359] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.062870 19497 raft_consensus.cc:385] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.063189 19497 raft_consensus.cc:740] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.063968 19497 consensus_queue.cc:260] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.065223 19498 tablet_bootstrap.cc:492] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.065062 19499 raft_consensus.cc:359] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.065918 19498 ts_tablet_manager.cc:1403] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.006s
I20260709 13:19:51.065980 19499 raft_consensus.cc:385] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.066040 19497 ts_tablet_manager.cc:1434] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 13:19:51.066562 19499 raft_consensus.cc:740] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.067824 19497 tablet_bootstrap.cc:492] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:51.067652 19499 consensus_queue.cc:260] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.070741 19499 ts_tablet_manager.cc:1434] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 13:19:51.072085 19499 tablet_bootstrap.cc:492] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:51.071278 19498 raft_consensus.cc:359] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.074963 19498 raft_consensus.cc:385] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.075382 19498 raft_consensus.cc:740] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.076329 19497 tablet_bootstrap.cc:654] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.076464 19498 consensus_queue.cc:260] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.079687 19499 tablet_bootstrap.cc:654] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.080896 19503 raft_consensus.cc:493] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.081542 19503 raft_consensus.cc:515] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.082087 19498 ts_tablet_manager.cc:1434] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:51.083513 19498 tablet_bootstrap.cc:492] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
W20260709 13:19:51.089259 19253 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:51.091665 19503 leader_election.cc:290] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.095196 19498 tablet_bootstrap.cc:654] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.105129 19504 raft_consensus.cc:493] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.106048 19504 raft_consensus.cc:515] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.114255 19504 leader_election.cc:290] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.124835 19498 tablet_bootstrap.cc:492] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.126478 19497 tablet_bootstrap.cc:492] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.127801 19498 ts_tablet_manager.cc:1403] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.003s
I20260709 13:19:51.131788 19497 ts_tablet_manager.cc:1403] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.017s
I20260709 13:19:51.132402 19499 tablet_bootstrap.cc:492] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.133064 19499 ts_tablet_manager.cc:1403] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.061s	user 0.001s	sys 0.012s
I20260709 13:19:51.136186 19503 raft_consensus.cc:493] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.136814 19503 raft_consensus.cc:515] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.137390 19498 raft_consensus.cc:359] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.138293 19498 raft_consensus.cc:385] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.138625 19498 raft_consensus.cc:740] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.139184 19503 leader_election.cc:290] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.139477 19498 consensus_queue.cc:260] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.141053 19497 raft_consensus.cc:359] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.141870 19497 raft_consensus.cc:385] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.142118 19498 ts_tablet_manager.cc:1434] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:19:51.143302 19505 raft_consensus.cc:493] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.143939 19498 tablet_bootstrap.cc:492] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:51.142194 19497 raft_consensus.cc:740] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.143862 19505 raft_consensus.cc:515] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.145216 19497 consensus_queue.cc:260] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.145639 19499 raft_consensus.cc:359] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.146436 19499 raft_consensus.cc:385] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.146770 19499 raft_consensus.cc:740] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.156272 19497 ts_tablet_manager.cc:1434] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:19:51.150517 19505 leader_election.cc:290] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047), a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829)
I20260709 13:19:51.147647 19499 consensus_queue.cc:260] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.157745 19497 tablet_bootstrap.cc:492] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:51.183442 19499 ts_tablet_manager.cc:1434] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.004s
I20260709 13:19:51.197039 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.201241 19504 raft_consensus.cc:493] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.203470 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.205109 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45420f34ff0497785fee7251b2c3c7e" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.210618 19504 raft_consensus.cc:515] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
W20260709 13:19:51.212164 19273 leader_election.cc:343] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.212154 19456 raft_consensus.cc:2468] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:51.204414 19497 tablet_bootstrap.cc:654] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.214454 19273 leader_election.cc:304] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:51.215880 19503 raft_consensus.cc:2804] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.216908 19503 raft_consensus.cc:493] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.218906 19503 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.214596 19504 leader_election.cc:290] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.220297 19504 raft_consensus.cc:493] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.220990 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.222509 19504 raft_consensus.cc:515] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
W20260709 13:19:51.227185 19419 leader_election.cc:343] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.228955 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.229450 19499 tablet_bootstrap.cc:492] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:51.229209 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45420f34ff0497785fee7251b2c3c7e" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.230057 19380 raft_consensus.cc:2468] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:51.230850 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.231637 19382 raft_consensus.cc:2468] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:51.234289 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.235711 19498 tablet_bootstrap.cc:654] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.235903 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
W20260709 13:19:51.237950 19273 leader_election.cc:343] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.238336 19504 leader_election.cc:290] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.239140 19273 leader_election.cc:304] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:51.237671 19503 raft_consensus.cc:515] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.241478 19306 raft_consensus.cc:2393] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:51.242339 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.243065 19307 raft_consensus.cc:2468] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:51.243225 19499 tablet_bootstrap.cc:654] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.245128 19422 leader_election.cc:304] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.245962 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
W20260709 13:19:51.246711 19422 leader_election.cc:343] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.247364 19530 raft_consensus.cc:2804] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:51.247637 19422 leader_election.cc:343] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.248234 19348 leader_election.cc:343] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.249632 19419 leader_election.cc:304] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced; no voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.251623 19504 raft_consensus.cc:493] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.252290 19504 raft_consensus.cc:515] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.247851 19530 raft_consensus.cc:493] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.254844 19530 raft_consensus.cc:3060] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.258688 19532 raft_consensus.cc:2804] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.259183 19532 raft_consensus.cc:493] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.259467 19504 leader_election.cc:290] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.260444 19504 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.261987 19498 tablet_bootstrap.cc:492] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.262641 19498 ts_tablet_manager.cc:1403] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.004s
I20260709 13:19:51.263276 19497 tablet_bootstrap.cc:492] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.263862 19497 ts_tablet_manager.cc:1403] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.000s
I20260709 13:19:51.264180 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.265240 19380 raft_consensus.cc:2468] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:51.266451 19498 raft_consensus.cc:359] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.267354 19498 raft_consensus.cc:385] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.267753 19498 raft_consensus.cc:740] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.267513 19497 raft_consensus.cc:359] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.268326 19497 raft_consensus.cc:385] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.268675 19497 raft_consensus.cc:740] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.268939 19498 consensus_queue.cc:260] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.259513 19532 raft_consensus.cc:3060] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.269495 19497 consensus_queue.cc:260] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.269461 19422 leader_election.cc:304] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:51.275952 19498 ts_tablet_manager.cc:1434] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:19:51.291734 19498 tablet_bootstrap.cc:492] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:51.293263 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.300705 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
W20260709 13:19:51.305738 19273 leader_election.cc:343] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.301523 19503 leader_election.cc:290] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.314513 19503 raft_consensus.cc:493] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.315274 19503 raft_consensus.cc:515] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.317945 19498 tablet_bootstrap.cc:654] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.319449 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.320497 19380 raft_consensus.cc:2468] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:51.322563 19273 leader_election.cc:304] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:51.324693 19537 raft_consensus.cc:2804] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.328162 19537 raft_consensus.cc:493] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.328819 19537 raft_consensus.cc:3060] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.331292 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.332369 19307 raft_consensus.cc:2468] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:51.334254 19345 leader_election.cc:304] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:51.335487 19505 raft_consensus.cc:2804] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.335987 19505 raft_consensus.cc:493] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.336445 19505 raft_consensus.cc:3060] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.347311 19534 raft_consensus.cc:2804] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.348034 19534 raft_consensus.cc:493] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.348508 19534 raft_consensus.cc:3060] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.354120 19505 raft_consensus.cc:515] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.354664 19537 raft_consensus.cc:515] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.361240 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.371608 19532 raft_consensus.cc:515] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.372577 19454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:51.374356 19537 leader_election.cc:290] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.375089 19380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45420f34ff0497785fee7251b2c3c7e" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.364596 19499 tablet_bootstrap.cc:492] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.375785 19380 raft_consensus.cc:3060] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.376366 19499 ts_tablet_manager.cc:1403] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.147s	user 0.077s	sys 0.052s
I20260709 13:19:51.377445 19530 raft_consensus.cc:515] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.379037 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.379734 19382 raft_consensus.cc:3060] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.380066 19530 leader_election.cc:290] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.381417 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
W20260709 13:19:51.358798 19419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:39829, user_credentials={real_user=slave}} blocked reactor thread for 109321us
I20260709 13:19:51.382277 19381 raft_consensus.cc:3060] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.382544 19419 leader_election.cc:304] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:51.384892 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.385789 19307 raft_consensus.cc:2393] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:51.386842 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.368867 19504 raft_consensus.cc:2749] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:51.374409 19348 leader_election.cc:343] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.381423 19499 raft_consensus.cc:359] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.391343 19454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:51.391700 19499 raft_consensus.cc:385] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.392167 19499 raft_consensus.cc:740] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.362485 19503 leader_election.cc:290] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
W20260709 13:19:51.393889 19419 leader_election.cc:343] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.393299 19499 consensus_queue.cc:260] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.384301 19534 raft_consensus.cc:515] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.398363 19455 raft_consensus.cc:2393] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a4a238d13e442b9da85f191acbe738 in current term 1: Already voted for candidate 1c398cc3e3244f21a5bcb100ad0bcced in this term.
I20260709 13:19:51.399530 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.400496 19306 raft_consensus.cc:2393] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:51.389832 19530 raft_consensus.cc:2804] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.401865 19530 raft_consensus.cc:493] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.402205 19530 raft_consensus.cc:3060] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.410436 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.412215 19505 leader_election.cc:290] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Requested vote from peers 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047), a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829)
I20260709 13:19:51.412429 19422 leader_election.cc:304] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced; no voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.413060 19532 leader_election.cc:290] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.413872 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.415174 19306 raft_consensus.cc:3060] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.416213 19498 tablet_bootstrap.cc:492] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.416846 19498 ts_tablet_manager.cc:1403] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.021s
I20260709 13:19:51.418450 19534 leader_election.cc:290] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.419149 19534 raft_consensus.cc:493] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.419624 19534 raft_consensus.cc:515] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.418758 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45420f34ff0497785fee7251b2c3c7e" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:51.421553 19380 raft_consensus.cc:2468] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
W20260709 13:19:51.421914 19273 leader_election.cc:343] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.422690 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.422847 19273 leader_election.cc:304] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:51.423292 19307 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:51.424628 19419 leader_election.cc:304] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:51.424542 19498 raft_consensus.cc:359] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.425642 19498 raft_consensus.cc:385] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.425967 19306 raft_consensus.cc:2468] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:51.425266 19497 ts_tablet_manager.cc:1434] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.161s	user 0.069s	sys 0.065s
I20260709 13:19:51.395784 19504 raft_consensus.cc:493] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.426050 19498 raft_consensus.cc:740] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.428946 19534 leader_election.cc:290] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.429179 19503 raft_consensus.cc:2804] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.429714 19503 raft_consensus.cc:697] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:51.429785 19345 leader_election.cc:304] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:51.430449 19498 consensus_queue.cc:260] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.430845 19503 consensus_queue.cc:237] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.428047 19504 raft_consensus.cc:515] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.432060 19536 raft_consensus.cc:2749] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.432546 19505 raft_consensus.cc:2804] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.433133 19530 raft_consensus.cc:515] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.433525 19497 tablet_bootstrap.cc:492] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:51.428567 19456 raft_consensus.cc:2468] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:51.433655 19382 raft_consensus.cc:2468] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:51.433380 19381 raft_consensus.cc:2468] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:51.435660 19499 ts_tablet_manager.cc:1434] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.004s
I20260709 13:19:51.442358 19499 tablet_bootstrap.cc:492] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:51.443523 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.444294 19306 raft_consensus.cc:3060] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.445742 19497 tablet_bootstrap.cc:654] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.451844 19273 leader_election.cc:304] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:51.455730 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.457089 19422 leader_election.cc:304] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.457566 19532 raft_consensus.cc:2804] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:51.457625 19419 leader_election.cc:343] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.457813 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.458406 19532 raft_consensus.cc:697] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:51.455709 19530 leader_election.cc:290] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.458833 19504 leader_election.cc:290] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.450271 19534 raft_consensus.cc:2804] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.460004 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.459815 19532 consensus_queue.cc:237] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.456310 19499 tablet_bootstrap.cc:654] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:51.461314 19422 leader_election.cc:343] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.461297 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.465616 19534 raft_consensus.cc:493] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.465268 19530 raft_consensus.cc:2804] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.468255 19505 raft_consensus.cc:697] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:51.468101 19381 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:51.472257 19273 leader_election.cc:304] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:51.472519 19505 consensus_queue.cc:237] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.473902 19503 raft_consensus.cc:2804] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.469838 19382 raft_consensus.cc:2468] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:51.475044 19503 raft_consensus.cc:697] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:51.468365 19534 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.476178 19422 leader_election.cc:304] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.486538 19539 raft_consensus.cc:2804] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.487318 19539 raft_consensus.cc:493] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.487994 19539 raft_consensus.cc:3060] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.492704 19202 catalog_manager.cc:5697] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.477449 19530 raft_consensus.cc:697] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:51.505208 19530 consensus_queue.cc:237] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.476181 19503 consensus_queue.cc:237] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.534663 19306 raft_consensus.cc:2468] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:51.537442 19497 tablet_bootstrap.cc:492] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.543394 19419 leader_election.cc:304] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:51.535133 19534 raft_consensus.cc:515] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.544178 19497 ts_tablet_manager.cc:1403] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.050s
I20260709 13:19:51.544778 19504 raft_consensus.cc:2804] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.545579 19504 raft_consensus.cc:697] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:51.546856 19504 consensus_queue.cc:237] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.547619 19497 raft_consensus.cc:359] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.548398 19497 raft_consensus.cc:385] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.547435 19534 leader_election.cc:290] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.548714 19497 raft_consensus.cc:740] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.551817 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.552523 19382 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.551994 19497 consensus_queue.cc:260] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.549803 19539 raft_consensus.cc:515] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.555822 19497 ts_tablet_manager.cc:1434] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:19:51.556020 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.556761 19307 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.557159 19539 leader_election.cc:290] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.557760 19497 tablet_bootstrap.cc:492] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:51.560379 19499 tablet_bootstrap.cc:492] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.560689 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:51.561002 19499 ts_tablet_manager.cc:1403] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.005s
I20260709 13:19:51.561367 19381 raft_consensus.cc:3060] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.565956 19499 raft_consensus.cc:359] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.566900 19499 raft_consensus.cc:385] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.567235 19499 raft_consensus.cc:740] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.567927 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.568214 19497 tablet_bootstrap.cc:654] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.568140 19499 consensus_queue.cc:260] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
W20260709 13:19:51.569713 19419 leader_election.cc:343] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.570674 19499 ts_tablet_manager.cc:1434] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:19:51.572186 19499 tablet_bootstrap.cc:492] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:51.571157 19204 catalog_manager.cc:5697] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 1 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.567930 19203 catalog_manager.cc:5697] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.580253 19499 tablet_bootstrap.cc:654] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.585240 19497 tablet_bootstrap.cc:492] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.585704 19497 ts_tablet_manager.cc:1403] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.006s
I20260709 13:19:51.588537 19497 raft_consensus.cc:359] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.589215 19497 raft_consensus.cc:385] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.542088 19498 ts_tablet_manager.cc:1434] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.125s	user 0.011s	sys 0.011s
I20260709 13:19:51.589483 19497 raft_consensus.cc:740] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.593003 19497 consensus_queue.cc:260] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.591790 19307 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:51.594273 19498 tablet_bootstrap.cc:492] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:51.595453 19419 leader_election.cc:304] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:51.596058 19497 ts_tablet_manager.cc:1434] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:19:51.596763 19539 raft_consensus.cc:2804] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.594972 19382 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:51.597187 19497 tablet_bootstrap.cc:492] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:51.597451 19539 raft_consensus.cc:697] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:51.598837 19539 consensus_queue.cc:237] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.604031 19498 tablet_bootstrap.cc:654] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.604031 19497 tablet_bootstrap.cc:654] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.611126 19499 tablet_bootstrap.cc:492] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.611790 19499 ts_tablet_manager.cc:1403] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.016s
I20260709 13:19:51.615202 19381 raft_consensus.cc:2468] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:51.615047 19499 raft_consensus.cc:359] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.615798 19499 raft_consensus.cc:385] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.616060 19499 raft_consensus.cc:740] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.616660 19422 leader_election.cc:304] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.616919 19499 consensus_queue.cc:260] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.617470 19497 tablet_bootstrap.cc:492] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:51.618040 19497 ts_tablet_manager.cc:1403] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 13:19:51.617964 19534 raft_consensus.cc:2804] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.618671 19534 raft_consensus.cc:697] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:51.619656 19534 consensus_queue.cc:237] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.620010 19499 ts_tablet_manager.cc:1434] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:19:51.621357 19499 tablet_bootstrap.cc:492] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:51.621411 19497 raft_consensus.cc:359] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.622313 19497 raft_consensus.cc:385] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.622588 19497 raft_consensus.cc:740] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.623593 19497 consensus_queue.cc:260] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.618647 19498 tablet_bootstrap.cc:492] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.625145 19498 ts_tablet_manager.cc:1403] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.010s
I20260709 13:19:51.626257 19497 ts_tablet_manager.cc:1434] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:51.631250 19499 tablet_bootstrap.cc:654] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.632764 19498 raft_consensus.cc:359] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.633664 19498 raft_consensus.cc:385] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.633917 19498 raft_consensus.cc:740] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.634721 19498 consensus_queue.cc:260] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.637143 19498 ts_tablet_manager.cc:1434] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:19:51.638286 19499 tablet_bootstrap.cc:492] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:51.638424 19498 tablet_bootstrap.cc:492] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:51.638844 19499 ts_tablet_manager.cc:1403] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:19:51.643481 19499 raft_consensus.cc:359] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.644328 19499 raft_consensus.cc:385] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.644611 19499 raft_consensus.cc:740] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.645375 19499 consensus_queue.cc:260] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.648897 19499 ts_tablet_manager.cc:1434] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:51.650600 19505 raft_consensus.cc:493] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.658111 19498 tablet_bootstrap.cc:654] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.658059 19505 raft_consensus.cc:515] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.661727 19505 leader_election.cc:290] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.661659 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.662940 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.663008 19307 raft_consensus.cc:2468] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:51.663558 19456 raft_consensus.cc:2468] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:51.664776 19345 leader_election.cc:304] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:51.666474 19505 raft_consensus.cc:2804] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.666869 19505 raft_consensus.cc:493] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.667209 19505 raft_consensus.cc:3060] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.673092 19498 tablet_bootstrap.cc:492] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:51.672297 19204 catalog_manager.cc:5697] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.673699 19498 ts_tablet_manager.cc:1403] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.005s
I20260709 13:19:51.674363 19204 catalog_manager.cc:5697] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.675024 19505 raft_consensus.cc:515] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.676854 19498 raft_consensus.cc:359] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.677614 19498 raft_consensus.cc:385] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.677752 19505 leader_election.cc:290] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.677909 19498 raft_consensus.cc:740] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.678606 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:51.678730 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:51.678850 19498 consensus_queue.cc:260] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.679275 19307 raft_consensus.cc:3060] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.679587 19456 raft_consensus.cc:3060] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.681486 19504 raft_consensus.cc:493] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.681941 19504 raft_consensus.cc:515] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.684127 19504 leader_election.cc:290] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:51.685833 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45420f34ff0497785fee7251b2c3c7e" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.686795 19381 raft_consensus.cc:2393] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:51.687283 19456 raft_consensus.cc:2468] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:51.687951 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b45420f34ff0497785fee7251b2c3c7e" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.688606 19348 leader_election.cc:304] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:51.689517 19505 raft_consensus.cc:2804] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.690187 19505 raft_consensus.cc:697] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:51.690804 19422 leader_election.cc:304] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced; no voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.691140 19505 consensus_queue.cc:237] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.691708 19504 raft_consensus.cc:3060] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.691476 19202 catalog_manager.cc:5697] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.693579 19202 catalog_manager.cc:5697] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.695727 19202 catalog_manager.cc:5697] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.697861 19307 raft_consensus.cc:2468] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:51.696552 19498 ts_tablet_manager.cc:1434] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:19:51.706676 19504 raft_consensus.cc:2749] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.708405 19203 catalog_manager.cc:5697] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 1 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.773412 19505 raft_consensus.cc:493] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.773916 19505 raft_consensus.cc:515] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.775892 19505 leader_election.cc:290] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.776635 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.777015 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.777390 19307 raft_consensus.cc:2393] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93b4e264ae824f25b79453db3d1f3d8e in current term 1: Already voted for candidate 1c398cc3e3244f21a5bcb100ad0bcced in this term.
I20260709 13:19:51.778486 19345 leader_election.cc:304] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.779176 19505 raft_consensus.cc:3060] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.784400 19505 raft_consensus.cc:2749] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.787746 19505 raft_consensus.cc:493] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.788199 19505 raft_consensus.cc:515] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.789891 19505 leader_election.cc:290] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.790922 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.790822 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.791917 19456 raft_consensus.cc:2393] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93b4e264ae824f25b79453db3d1f3d8e in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:51.792918 19348 leader_election.cc:304] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.793520 19505 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.798728 19505 raft_consensus.cc:2749] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.891299 19503 raft_consensus.cc:493] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.891835 19503 raft_consensus.cc:515] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.893497 19503 leader_election.cc:290] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:51.894588 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.894825 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:51.895376 19381 raft_consensus.cc:2393] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a4a238d13e442b9da85f191acbe738 in current term 1: Already voted for candidate 1c398cc3e3244f21a5bcb100ad0bcced in this term.
I20260709 13:19:51.896565 19273 leader_election.cc:304] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:51.897269 19503 raft_consensus.cc:3060] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.903059 19503 raft_consensus.cc:2749] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.915551 19504 raft_consensus.cc:493] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.916153 19504 raft_consensus.cc:515] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:51.918052 19504 leader_election.cc:290] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829)
I20260709 13:19:51.918942 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:51.919178 19307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:51.919952 19307 raft_consensus.cc:2393] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate 93b4e264ae824f25b79453db3d1f3d8e in this term.
I20260709 13:19:51.920845 19419 leader_election.cc:304] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced; no voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.921481 19504 raft_consensus.cc:3060] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.926546 19504 raft_consensus.cc:2749] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.944288 19381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
mode: GRACEFUL
new_leader_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:42948
I20260709 13:19:51.945024 19381 raft_consensus.cc:606] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Received request to transfer leadership to TS a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.963862 19456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:51.964484 19456 raft_consensus.cc:606] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.969734 19503 consensus_queue.cc:1048] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.970427 19456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f5bca940b943c18db11e38255b1261"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:51.971093 19456 raft_consensus.cc:606] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:51.974189 19505 consensus_queue.cc:1048] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.981690 19503 raft_consensus.cc:493] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.983131 19503 raft_consensus.cc:515] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:51.986971 19504 consensus_queue.cc:1048] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.989624 19534 consensus_queue.cc:1048] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.002108 19572 consensus_queue.cc:1048] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.004333 19381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:52.004474 19572 consensus_queue.cc:1048] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.005941 19381 raft_consensus.cc:2393] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a4a238d13e442b9da85f191acbe738 in current term 1: Already voted for candidate 1c398cc3e3244f21a5bcb100ad0bcced in this term.
I20260709 13:19:52.028224 19572 consensus_queue.cc:1048] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.029949 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:52.031208 19503 leader_election.cc:290] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.032256 19273 leader_election.cc:304] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:52.036273 19572 raft_consensus.cc:3060] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.047618 19503 consensus_queue.cc:1048] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.053117 19534 consensus_queue.cc:1048] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.055285 19505 consensus_queue.cc:1048] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.067379 19503 consensus_queue.cc:1048] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.079101 19534 consensus_queue.cc:1048] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.081537 19540 raft_consensus.cc:993] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: : Instructing follower a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:52.089318 19587 raft_consensus.cc:1081] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Signalling peer a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:52.094789 19305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:52334
I20260709 13:19:52.095500 19572 raft_consensus.cc:2749] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.096131 19305 raft_consensus.cc:493] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.096802 19305 raft_consensus.cc:3060] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.107333 19539 raft_consensus.cc:993] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:52.108098 19504 raft_consensus.cc:1081] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:52.114887 19303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:52332
I20260709 13:19:52.115130 19305 raft_consensus.cc:515] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:52.119146 19303 raft_consensus.cc:493] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.119637 19303 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.120095 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.121119 19456 raft_consensus.cc:3060] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.131968 19305 leader_election.cc:290] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:52.132632 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a86a543ba74b68858d8eb05c175138" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:52.132560 19303 raft_consensus.cc:515] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.133448 19379 raft_consensus.cc:3055] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.133841 19379 raft_consensus.cc:740] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:52.135047 19379 consensus_queue.cc:260] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:52.135392 19456 raft_consensus.cc:2468] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:52.136399 19379 raft_consensus.cc:3060] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.136808 19273 leader_election.cc:304] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:52.137897 19572 raft_consensus.cc:2804] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.138446 19572 raft_consensus.cc:697] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:52.139202 19534 consensus_queue.cc:1048] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.140133 19572 consensus_queue.cc:237] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } }
I20260709 13:19:52.144924 19536 raft_consensus.cc:993] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:52.145422 19536 raft_consensus.cc:1081] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:52.147614 19305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f5bca940b943c18db11e38255b1261"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:52332
I20260709 13:19:52.148227 19305 raft_consensus.cc:493] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.148653 19305 raft_consensus.cc:3060] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.149293 19379 raft_consensus.cc:2468] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:52.153844 19203 catalog_manager.cc:5697] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 1 to 2, leader changed from 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194) to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.161566 19534 consensus_queue.cc:1048] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.164211 19305 raft_consensus.cc:515] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.167663 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:52.168327 19379 raft_consensus.cc:3060] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.170383 19530 consensus_queue.cc:1048] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.177597 19587 consensus_queue.cc:1048] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.184420 19379 raft_consensus.cc:2468] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:52.185801 19273 leader_election.cc:304] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:52.189239 19569 raft_consensus.cc:2804] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.189811 19569 raft_consensus.cc:697] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:52.190718 19569 consensus_queue.cc:237] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.193135 19301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:19:52.193884 19301 raft_consensus.cc:606] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:52.195387 19303 leader_election.cc:290] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.196674 19305 leader_election.cc:290] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.202797 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:52.203480 19379 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.204033 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f5bca940b943c18db11e38255b1261" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.204723 19456 raft_consensus.cc:3055] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.205032 19456 raft_consensus.cc:740] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:52.206085 19454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.209038 19456 consensus_queue.cc:260] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.206815 19454 raft_consensus.cc:3055] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.210427 19454 raft_consensus.cc:740] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:52.211440 19456 raft_consensus.cc:3060] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.211748 19379 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:52.213145 19273 leader_election.cc:304] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:52.213984 19572 raft_consensus.cc:2804] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.214478 19572 raft_consensus.cc:697] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:52.214664 19454 consensus_queue.cc:260] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.215426 19572 consensus_queue.cc:237] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.216224 19454 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.216940 19305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:19:52.217636 19305 raft_consensus.cc:606] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:52.218022 19534 consensus_queue.cc:1048] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.225845 19456 raft_consensus.cc:2468] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:52.227679 19587 consensus_queue.cc:1048] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.236068 19454 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:52.237243 19456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b971ad6505448589f155d7b895b6723"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:52.241160 19456 raft_consensus.cc:606] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:52.250747 19456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:52.251438 19456 raft_consensus.cc:606] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:52.259400 19379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
mode: GRACEFUL
new_leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:42948
I20260709 13:19:52.260056 19379 raft_consensus.cc:606] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Received request to transfer leadership to TS 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:52.261746 19203 catalog_manager.cc:5697] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.265156 19203 catalog_manager.cc:5697] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.407748 19572 raft_consensus.cc:993] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.408249 19569 raft_consensus.cc:1081] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.409942 19379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42938
I20260709 13:19:52.410630 19379 raft_consensus.cc:493] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.411031 19379 raft_consensus.cc:3060] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.416289 19379 raft_consensus.cc:515] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.418380 19379 leader_election.cc:290] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.418927 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:52.419075 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a15d95cfc74abbafcb5d82a6ec64d7" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.419626 19306 raft_consensus.cc:3055] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.419735 19455 raft_consensus.cc:3060] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.419950 19306 raft_consensus.cc:740] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:52.420825 19306 consensus_queue.cc:260] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.421793 19306 raft_consensus.cc:3060] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.425766 19455 raft_consensus.cc:2468] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.427055 19348 leader_election.cc:304] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:52.427788 19587 raft_consensus.cc:2804] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.427839 19306 raft_consensus.cc:2468] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.428239 19587 raft_consensus.cc:697] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:52.429157 19587 consensus_queue.cc:237] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.435774 19204 catalog_manager.cc:5697] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.467434 19572 raft_consensus.cc:993] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.467903 19569 raft_consensus.cc:1081] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.469755 19379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42938
I20260709 13:19:52.470407 19379 raft_consensus.cc:493] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.470938 19379 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.477972 19379 raft_consensus.cc:515] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.479753 19379 leader_election.cc:290] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.480835 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.480706 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:52.481564 19455 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.481647 19306 raft_consensus.cc:3055] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.482087 19306 raft_consensus.cc:740] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:52.482873 19306 consensus_queue.cc:260] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.483911 19306 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.487542 19455 raft_consensus.cc:2468] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.488914 19348 leader_election.cc:304] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:52.489825 19587 raft_consensus.cc:2804] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.490084 19306 raft_consensus.cc:2468] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.490432 19587 raft_consensus.cc:697] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:52.491403 19587 consensus_queue.cc:237] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.497718 19204 catalog_manager.cc:5697] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.546904 19455 raft_consensus.cc:1275] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.548460 19569 consensus_queue.cc:1048] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.556365 19379 raft_consensus.cc:1275] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.558019 19569 consensus_queue.cc:1048] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.617254 19379 raft_consensus.cc:1275] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.618724 19569 consensus_queue.cc:1048] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.627458 19455 raft_consensus.cc:1275] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.629117 19573 consensus_queue.cc:1048] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.783630 19534 raft_consensus.cc:993] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.784073 19595 raft_consensus.cc:1081] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.785743 19379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42942
I20260709 13:19:52.786247 19379 raft_consensus.cc:493] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.786511 19379 raft_consensus.cc:3060] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.792068 19379 raft_consensus.cc:515] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.794307 19379 leader_election.cc:290] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.795378 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:52.795482 19455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dd69a5570e4e6b9d98d8664a654e2d" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.796300 19306 raft_consensus.cc:3060] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.796335 19455 raft_consensus.cc:3055] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.796991 19455 raft_consensus.cc:740] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:52.798085 19455 consensus_queue.cc:260] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.799510 19455 raft_consensus.cc:3060] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.801509 19534 raft_consensus.cc:993] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.804776 19306 raft_consensus.cc:2468] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.806277 19534 raft_consensus.cc:1081] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:52.807515 19345 leader_election.cc:304] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:52.808125 19379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b971ad6505448589f155d7b895b6723"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42942
I20260709 13:19:52.808365 19587 raft_consensus.cc:2804] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.808837 19379 raft_consensus.cc:493] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.808991 19456 raft_consensus.cc:1275] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.808905 19587 raft_consensus.cc:697] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:52.809312 19379 raft_consensus.cc:3060] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.810359 19587 consensus_queue.cc:237] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.812198 19573 consensus_queue.cc:1048] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.817700 19379 raft_consensus.cc:515] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.820180 19205 catalog_manager.cc:5697] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.824599 19379 leader_election.cc:290] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:52.824882 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:52.825578 19456 raft_consensus.cc:3055] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.825968 19456 raft_consensus.cc:740] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:52.826877 19382 raft_consensus.cc:1275] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.826860 19456 consensus_queue.cc:260] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.828738 19572 consensus_queue.cc:1048] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.829075 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b971ad6505448589f155d7b895b6723" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:52.829720 19306 raft_consensus.cc:3060] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.834209 19597 raft_consensus.cc:993] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: : Instructing follower 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:19:52.836874 19454 raft_consensus.cc:1275] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.839134 19587 raft_consensus.cc:1081] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Signalling peer 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:19:52.835266 19456 raft_consensus.cc:3060] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.840689 19587 consensus_queue.cc:1048] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.841778 19453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:49428
I20260709 13:19:52.842485 19453 raft_consensus.cc:493] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.842855 19453 raft_consensus.cc:3060] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.844642 19302 raft_consensus.cc:1275] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.846278 19587 consensus_queue.cc:1048] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.849812 19455 raft_consensus.cc:2468] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.853067 19453 raft_consensus.cc:515] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.855334 19456 raft_consensus.cc:2468] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.855950 19453 leader_election.cc:290] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:52.858443 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:52.859134 19302 raft_consensus.cc:3060] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.853055 19306 raft_consensus.cc:2468] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:52.862210 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe84ad7632741b78518543ce38ed68b" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:52.863023 19382 raft_consensus.cc:3055] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.863375 19382 raft_consensus.cc:740] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:52.864210 19382 consensus_queue.cc:260] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.866204 19348 leader_election.cc:304] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:52.865343 19382 raft_consensus.cc:3060] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.868057 19302 raft_consensus.cc:2468] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 2.
I20260709 13:19:52.869740 19419 leader_election.cc:304] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:52.870445 19597 raft_consensus.cc:2804] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.870919 19534 raft_consensus.cc:2804] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.871608 19534 raft_consensus.cc:697] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:52.872553 19534 consensus_queue.cc:237] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.877190 19382 raft_consensus.cc:2468] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 2.
I20260709 13:19:52.879616 19597 raft_consensus.cc:697] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:52.880657 19597 consensus_queue.cc:237] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:52.882771 19203 catalog_manager.cc:5697] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 1 to 2, leader changed from 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194) to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 2 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.893745 19205 catalog_manager.cc:5697] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.959213 19456 raft_consensus.cc:1275] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.960638 19597 consensus_queue.cc:1048] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:52.969642 19302 raft_consensus.cc:1275] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:52.971274 19598 consensus_queue.cc:1048] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.264186 19456 raft_consensus.cc:1275] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.265625 19598 consensus_queue.cc:1048] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.276356 19302 raft_consensus.cc:1275] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.277878 19597 consensus_queue.cc:1048] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.292279 19302 raft_consensus.cc:1275] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.293732 19456 raft_consensus.cc:1275] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.293601 19587 consensus_queue.cc:1048] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.295285 19587 consensus_queue.cc:1048] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.311575 19302 raft_consensus.cc:1275] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.312927 19534 consensus_queue.cc:1048] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:53.326804 19382 raft_consensus.cc:1275] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:53.328462 19534 consensus_queue.cc:1048] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:55.288060 19205 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46030:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:55.291013 19205 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:55.349658 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 497039fa2f0943f1b1f8a4f23ce9f63c (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:55.351203 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497039fa2f0943f1b1f8a4f23ce9f63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.352109 19443 tablet_service.cc:1511] Processing CreateTablet for tablet 497039fa2f0943f1b1f8a4f23ce9f63c (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:55.353689 19443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497039fa2f0943f1b1f8a4f23ce9f63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.354547 19366 tablet_service.cc:1511] Processing CreateTablet for tablet c50d60833588421393abda714c75404e (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:55.355345 19370 tablet_service.cc:1511] Processing CreateTablet for tablet 497039fa2f0943f1b1f8a4f23ce9f63c (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:55.355968 19366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50d60833588421393abda714c75404e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.356606 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497039fa2f0943f1b1f8a4f23ce9f63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.357671 19291 tablet_service.cc:1511] Processing CreateTablet for tablet c50d60833588421393abda714c75404e (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:55.359400 19291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50d60833588421393abda714c75404e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.362354 19440 tablet_service.cc:1511] Processing CreateTablet for tablet c50d60833588421393abda714c75404e (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:55.363842 19440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c50d60833588421393abda714c75404e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.367842 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd0b67c9966464d88a632905f3d92de (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:55.369273 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd0b67c9966464d88a632905f3d92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.373383 19367 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd0b67c9966464d88a632905f3d92de (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:55.374939 19367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd0b67c9966464d88a632905f3d92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.375762 19438 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd0b67c9966464d88a632905f3d92de (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:55.377151 19438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd0b67c9966464d88a632905f3d92de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.380807 19364 tablet_service.cc:1511] Processing CreateTablet for tablet 21e56e48fcba4e34a0404d93c1793d87 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:55.383739 19296 tablet_service.cc:1511] Processing CreateTablet for tablet 21e56e48fcba4e34a0404d93c1793d87 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:55.385131 19296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e56e48fcba4e34a0404d93c1793d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.391424 19446 tablet_service.cc:1511] Processing CreateTablet for tablet 21e56e48fcba4e34a0404d93c1793d87 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:55.392974 19446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e56e48fcba4e34a0404d93c1793d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.392701 19294 tablet_service.cc:1511] Processing CreateTablet for tablet 17cb4c76287648b597cd1d275ccfdd86 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:55.394083 19294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cb4c76287648b597cd1d275ccfdd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.394874 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e56e48fcba4e34a0404d93c1793d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.397101 19365 tablet_service.cc:1511] Processing CreateTablet for tablet 17cb4c76287648b597cd1d275ccfdd86 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:55.397572 19445 tablet_service.cc:1511] Processing CreateTablet for tablet 17cb4c76287648b597cd1d275ccfdd86 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:55.398599 19365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cb4c76287648b597cd1d275ccfdd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.399673 19445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17cb4c76287648b597cd1d275ccfdd86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.403642 19293 tablet_service.cc:1511] Processing CreateTablet for tablet 3574f8f346ae44f5b2dda45f6230b821 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:55.405033 19293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3574f8f346ae44f5b2dda45f6230b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.404721 19368 tablet_service.cc:1511] Processing CreateTablet for tablet 3574f8f346ae44f5b2dda45f6230b821 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:55.406193 19368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3574f8f346ae44f5b2dda45f6230b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.407168 19444 tablet_service.cc:1511] Processing CreateTablet for tablet 3574f8f346ae44f5b2dda45f6230b821 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:55.408541 19444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3574f8f346ae44f5b2dda45f6230b821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.411706 19371 tablet_service.cc:1511] Processing CreateTablet for tablet 00f851abede8426b8e934d1d828965a2 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:55.413163 19371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f851abede8426b8e934d1d828965a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.414512 19297 tablet_service.cc:1511] Processing CreateTablet for tablet 00f851abede8426b8e934d1d828965a2 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:55.416011 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f851abede8426b8e934d1d828965a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.439435 19441 tablet_service.cc:1511] Processing CreateTablet for tablet 00f851abede8426b8e934d1d828965a2 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:55.441015 19441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f851abede8426b8e934d1d828965a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.446473 19295 tablet_service.cc:1511] Processing CreateTablet for tablet c259819e55e44f8bb20fffd77fb5c20c (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:55.447269 19368 tablet_service.cc:1511] Processing CreateTablet for tablet c259819e55e44f8bb20fffd77fb5c20c (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:55.447980 19295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c259819e55e44f8bb20fffd77fb5c20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.448590 19368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c259819e55e44f8bb20fffd77fb5c20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.459576 19439 tablet_service.cc:1511] Processing CreateTablet for tablet c259819e55e44f8bb20fffd77fb5c20c (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:55.461170 19439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c259819e55e44f8bb20fffd77fb5c20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.488435 19292 tablet_service.cc:1511] Processing CreateTablet for tablet 176930c6e1a349ed98f6c16a09da0e88 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:55.490082 19292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176930c6e1a349ed98f6c16a09da0e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.493208 19370 tablet_service.cc:1511] Processing CreateTablet for tablet 176930c6e1a349ed98f6c16a09da0e88 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:55.507076 19370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176930c6e1a349ed98f6c16a09da0e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.531562 19440 tablet_service.cc:1511] Processing CreateTablet for tablet 176930c6e1a349ed98f6c16a09da0e88 (DEFAULT_TABLE table=soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:55.534994 19620 tablet_bootstrap.cc:492] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.539047 19621 tablet_bootstrap.cc:492] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.557474 19622 tablet_bootstrap.cc:492] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:55.560964 19621 tablet_bootstrap.cc:654] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.565122 19440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176930c6e1a349ed98f6c16a09da0e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.567312 19620 tablet_bootstrap.cc:654] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.572480 19622 tablet_bootstrap.cc:654] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.579517 19621 tablet_bootstrap.cc:492] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.580116 19621 ts_tablet_manager.cc:1403] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260709 13:19:55.583617 19621 raft_consensus.cc:359] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.584439 19621 raft_consensus.cc:385] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.584760 19621 raft_consensus.cc:740] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.585672 19620 tablet_bootstrap.cc:492] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.585592 19621 consensus_queue.cc:260] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.586455 19620 ts_tablet_manager.cc:1403] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.012s
I20260709 13:19:55.588654 19621 ts_tablet_manager.cc:1434] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:19:55.589896 19621 tablet_bootstrap.cc:492] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.592924 19622 tablet_bootstrap.cc:492] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:55.593602 19622 ts_tablet_manager.cc:1403] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.011s
I20260709 13:19:55.593009 19620 raft_consensus.cc:359] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.594044 19620 raft_consensus.cc:385] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.594446 19620 raft_consensus.cc:740] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.595345 19620 consensus_queue.cc:260] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.597115 19622 raft_consensus.cc:359] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.597988 19620 ts_tablet_manager.cc:1434] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:19:55.599259 19620 tablet_bootstrap.cc:492] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.597991 19622 raft_consensus.cc:385] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.602166 19622 raft_consensus.cc:740] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.603143 19622 consensus_queue.cc:260] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.605953 19622 ts_tablet_manager.cc:1434] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:19:55.606575 19621 tablet_bootstrap.cc:654] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.606575 19620 tablet_bootstrap.cc:654] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.611407 19622 tablet_bootstrap.cc:492] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:55.619338 19622 tablet_bootstrap.cc:654] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.625586 19620 tablet_bootstrap.cc:492] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.626157 19620 ts_tablet_manager.cc:1403] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.014s
I20260709 13:19:55.626565 19621 tablet_bootstrap.cc:492] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.627146 19621 ts_tablet_manager.cc:1403] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.010s
I20260709 13:19:55.629289 19620 raft_consensus.cc:359] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.630124 19620 raft_consensus.cc:385] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.630457 19620 raft_consensus.cc:740] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.630534 19621 raft_consensus.cc:359] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.631438 19621 raft_consensus.cc:385] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.631250 19620 consensus_queue.cc:260] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.631749 19621 raft_consensus.cc:740] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.633817 19620 ts_tablet_manager.cc:1434] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:19:55.634944 19620 tablet_bootstrap.cc:492] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.635254 19621 consensus_queue.cc:260] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.637885 19621 ts_tablet_manager.cc:1434] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:55.639024 19621 tablet_bootstrap.cc:492] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.641944 19620 tablet_bootstrap.cc:654] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.648427 19621 tablet_bootstrap.cc:654] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.654790 19620 tablet_bootstrap.cc:492] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.655534 19620 ts_tablet_manager.cc:1403] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:19:55.659761 19620 raft_consensus.cc:359] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.660537 19620 raft_consensus.cc:385] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.660849 19620 raft_consensus.cc:740] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.661597 19620 consensus_queue.cc:260] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.664172 19620 ts_tablet_manager.cc:1434] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:55.665337 19620 tablet_bootstrap.cc:492] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.674297 19620 tablet_bootstrap.cc:654] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.679679 19621 tablet_bootstrap.cc:492] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.680430 19621 ts_tablet_manager.cc:1403] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.005s
I20260709 13:19:55.684487 19621 raft_consensus.cc:359] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.685253 19621 raft_consensus.cc:385] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.685559 19621 raft_consensus.cc:740] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.686345 19620 tablet_bootstrap.cc:492] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.686981 19620 ts_tablet_manager.cc:1403] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:19:55.686510 19621 consensus_queue.cc:260] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.689435 19621 ts_tablet_manager.cc:1434] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:55.690554 19621 tablet_bootstrap.cc:492] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.690472 19620 raft_consensus.cc:359] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.691370 19620 raft_consensus.cc:385] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.691694 19620 raft_consensus.cc:740] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.692696 19622 tablet_bootstrap.cc:492] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:55.692431 19620 consensus_queue.cc:260] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.693298 19622 ts_tablet_manager.cc:1403] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.044s
I20260709 13:19:55.694924 19620 ts_tablet_manager.cc:1434] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:19:55.695987 19620 tablet_bootstrap.cc:492] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.696622 19622 raft_consensus.cc:359] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.697417 19622 raft_consensus.cc:385] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.697714 19622 raft_consensus.cc:740] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.698534 19622 consensus_queue.cc:260] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.700984 19622 ts_tablet_manager.cc:1434] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:55.701282 19621 tablet_bootstrap.cc:654] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.703207 19622 tablet_bootstrap.cc:492] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:55.703657 19620 tablet_bootstrap.cc:654] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.714089 19620 tablet_bootstrap.cc:492] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.714151 19622 tablet_bootstrap.cc:654] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.714704 19620 ts_tablet_manager.cc:1403] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:19:55.717244 19621 tablet_bootstrap.cc:492] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.717813 19621 ts_tablet_manager.cc:1403] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.003s
I20260709 13:19:55.718034 19620 raft_consensus.cc:359] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.718868 19620 raft_consensus.cc:385] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.719172 19620 raft_consensus.cc:740] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.719951 19620 consensus_queue.cc:260] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.721496 19621 raft_consensus.cc:359] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.722337 19621 raft_consensus.cc:385] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.722553 19620 ts_tablet_manager.cc:1434] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:55.722644 19621 raft_consensus.cc:740] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.723908 19620 tablet_bootstrap.cc:492] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.723742 19621 consensus_queue.cc:260] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.726259 19621 ts_tablet_manager.cc:1434] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:55.727365 19621 tablet_bootstrap.cc:492] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.731245 19622 tablet_bootstrap.cc:492] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:55.731662 19620 tablet_bootstrap.cc:654] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.731941 19622 ts_tablet_manager.cc:1403] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.012s
I20260709 13:19:55.734994 19621 tablet_bootstrap.cc:654] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.735656 19622 raft_consensus.cc:359] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.736541 19622 raft_consensus.cc:385] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.736910 19622 raft_consensus.cc:740] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.737752 19622 consensus_queue.cc:260] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.740149 19622 ts_tablet_manager.cc:1434] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:55.741214 19622 tablet_bootstrap.cc:492] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:55.744724 19620 tablet_bootstrap.cc:492] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.745496 19620 ts_tablet_manager.cc:1403] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 13:19:55.748660 19622 tablet_bootstrap.cc:654] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.748857 19620 raft_consensus.cc:359] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.749653 19620 raft_consensus.cc:385] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.750015 19620 raft_consensus.cc:740] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.750909 19620 consensus_queue.cc:260] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.752429 19587 raft_consensus.cc:493] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.752848 19621 tablet_bootstrap.cc:492] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.752934 19587 raft_consensus.cc:515] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.753502 19620 ts_tablet_manager.cc:1434] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:19:55.753582 19621 ts_tablet_manager.cc:1403] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.013s
I20260709 13:19:55.754702 19620 tablet_bootstrap.cc:492] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.756613 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:55.756608 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
W20260709 13:19:55.758545 19345 leader_election.cc:343] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.756706 19587 leader_election.cc:290] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
W20260709 13:19:55.760660 19348 leader_election.cc:343] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.762879 19348 leader_election.cc:304] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:55.763171 19620 tablet_bootstrap.cc:654] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.763761 19587 raft_consensus.cc:2749] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.763887 19607 raft_consensus.cc:493] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.764488 19607 raft_consensus.cc:515] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.766722 19607 leader_election.cc:290] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:55.757256 19621 raft_consensus.cc:359] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.768388 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50d60833588421393abda714c75404e" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:55.768797 19621 raft_consensus.cc:385] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.769124 19621 raft_consensus.cc:740] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
W20260709 13:19:55.770053 19419 leader_election.cc:343] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.769932 19621 consensus_queue.cc:260] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.768452 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50d60833588421393abda714c75404e" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:55.771028 19622 tablet_bootstrap.cc:492] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:55.771448 19379 raft_consensus.cc:2468] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:55.772169 19622 ts_tablet_manager.cc:1403] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.010s
I20260709 13:19:55.772956 19422 leader_election.cc:304] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:55.774080 19572 raft_consensus.cc:493] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.774354 19607 raft_consensus.cc:2804] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.775480 19607 raft_consensus.cc:493] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.774895 19572 raft_consensus.cc:515] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.775856 19607 raft_consensus.cc:3060] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.780993 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:55.781944 19453 raft_consensus.cc:2468] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:55.775941 19621 ts_tablet_manager.cc:1434] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:19:55.783708 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:55.783986 19273 leader_election.cc:304] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:55.784824 19621 tablet_bootstrap.cc:492] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.784410 19379 raft_consensus.cc:2468] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:55.786092 19572 leader_election.cc:290] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.787024 19572 raft_consensus.cc:2804] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.787925 19572 raft_consensus.cc:493] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.788967 19572 raft_consensus.cc:3060] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.794016 19621 tablet_bootstrap.cc:654] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.802120 19622 raft_consensus.cc:359] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.805277 19622 raft_consensus.cc:385] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.806480 19622 raft_consensus.cc:740] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.806929 19607 raft_consensus.cc:515] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.808322 19621 tablet_bootstrap.cc:492] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.808908 19621 ts_tablet_manager.cc:1403] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:19:55.808555 19622 consensus_queue.cc:260] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.810750 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50d60833588421393abda714c75404e" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:55.811480 19306 raft_consensus.cc:3060] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.811650 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50d60833588421393abda714c75404e" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:55.812331 19379 raft_consensus.cc:3060] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.811697 19622 ts_tablet_manager.cc:1434] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:19:55.812587 19621 raft_consensus.cc:359] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.813995 19622 tablet_bootstrap.cc:492] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:55.814059 19621 raft_consensus.cc:385] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.814610 19621 raft_consensus.cc:740] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.815407 19621 consensus_queue.cc:260] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.816641 19607 leader_election.cc:290] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:55.822135 19572 raft_consensus.cc:515] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.818295 19620 tablet_bootstrap.cc:492] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.819677 19587 raft_consensus.cc:493] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.824235 19620 ts_tablet_manager.cc:1403] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.023s
I20260709 13:19:55.824432 19587 raft_consensus.cc:515] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.825601 19572 leader_election.cc:290] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.826666 19587 leader_election.cc:290] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.827525 19620 raft_consensus.cc:359] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.828286 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:55.829070 19453 raft_consensus.cc:2468] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:55.829291 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:55.829933 19456 raft_consensus.cc:3060] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.831372 19622 tablet_bootstrap.cc:654] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.831578 19302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:55.832243 19302 raft_consensus.cc:2468] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:55.819720 19306 raft_consensus.cc:2468] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:55.834604 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:55.835237 19382 raft_consensus.cc:3060] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.839141 19348 leader_election.cc:304] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:55.844913 19644 raft_consensus.cc:2804] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.845382 19644 raft_consensus.cc:493] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.845722 19644 raft_consensus.cc:3060] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.849092 19419 leader_election.cc:304] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:55.828287 19620 raft_consensus.cc:385] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.854990 19620 raft_consensus.cc:740] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.855880 19620 consensus_queue.cc:260] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.854450 19382 raft_consensus.cc:2468] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:55.851604 19456 raft_consensus.cc:2468] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:55.858331 19587 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.859021 19273 leader_election.cc:304] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:55.859795 19607 raft_consensus.cc:2804] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.860176 19639 raft_consensus.cc:2804] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.820709 19379 raft_consensus.cc:2468] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:55.860772 19639 raft_consensus.cc:697] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:55.861994 19639 consensus_queue.cc:237] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.858989 19587 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.866474 19572 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.867043 19572 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.867321 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:55.868007 19305 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:55.869163 19572 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.871380 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:55.872427 19453 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:55.864634 19644 raft_consensus.cc:515] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.874606 19645 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.874734 19620 ts_tablet_manager.cc:1434] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.001s
I20260709 13:19:55.875156 19645 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.876157 19620 tablet_bootstrap.cc:492] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
I20260709 13:19:55.876914 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:55.877552 19453 raft_consensus.cc:3060] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.877712 19647 raft_consensus.cc:493] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.878566 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:55.879264 19382 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:55.880419 19422 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:55.880692 19203 catalog_manager.cc:5697] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.882602 19273 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:55.883526 19639 raft_consensus.cc:2804] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.883908 19639 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.883935 19607 raft_consensus.cc:697] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:55.884343 19639 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.885372 19620 tablet_bootstrap.cc:654] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.878361 19647 raft_consensus.cc:515] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.885519 19453 raft_consensus.cc:2468] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:55.888231 19650 raft_consensus.cc:2804] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.888660 19647 leader_election.cc:290] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.889354 19348 leader_election.cc:304] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:55.891495 19650 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.890789 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:55.890002 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:55.891839 19647 raft_consensus.cc:2804] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.898425 19650 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.871353 19345 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:55.899494 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:55.900269 19621 ts_tablet_manager.cc:1434] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.091s	user 0.011s	sys 0.015s
I20260709 13:19:55.899767 19645 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
W20260709 13:19:55.900309 19348 leader_election.cc:343] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.900303 19379 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:55.885308 19607 consensus_queue.cc:237] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.898836 19647 raft_consensus.cc:697] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:55.901474 19621 tablet_bootstrap.cc:492] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.902581 19647 consensus_queue.cc:237] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.903628 19642 raft_consensus.cc:2804] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.904070 19642 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.904464 19642 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.893841 19639 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.909314 19305 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:55.893851 19644 leader_election.cc:290] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.894852 19622 tablet_bootstrap.cc:492] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:55.910907 19622 ts_tablet_manager.cc:1403] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.011s
I20260709 13:19:55.912909 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:55.913666 19305 raft_consensus.cc:3060] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.915670 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:55.915941 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:55.918175 19587 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.919059 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
W20260709 13:19:55.920816 19345 leader_election.cc:343] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.921296 19345 leader_election.cc:304] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:55.922118 19587 raft_consensus.cc:2749] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.914340 19622 raft_consensus.cc:359] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.922760 19622 raft_consensus.cc:385] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.923075 19622 raft_consensus.cc:740] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.925884 19621 tablet_bootstrap.cc:654] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.926009 19622 consensus_queue.cc:260] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.930075 19622 ts_tablet_manager.cc:1434] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.005s
I20260709 13:19:55.934959 19639 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.935197 19622 tablet_bootstrap.cc:492] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:55.936926 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:55.937240 19642 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.944027 19379 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6a4a238d13e442b9da85f191acbe738 in current term 1: Already voted for candidate 93b4e264ae824f25b79453db3d1f3d8e in this term.
I20260709 13:19:55.946708 19204 catalog_manager.cc:5697] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.948997 19620 tablet_bootstrap.cc:492] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.949244 19305 raft_consensus.cc:2468] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:55.949800 19620 ts_tablet_manager.cc:1403] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.010s
I20260709 13:19:55.938203 19650 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.951738 19456 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93b4e264ae824f25b79453db3d1f3d8e in current term 1: Already voted for candidate 1c398cc3e3244f21a5bcb100ad0bcced in this term.
I20260709 13:19:55.952126 19650 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:55.954582 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:55.954203 19205 catalog_manager.cc:5697] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 1 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.955909 19379 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate 93b4e264ae824f25b79453db3d1f3d8e in this term.
I20260709 13:19:55.956521 19642 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.957500 19273 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a4a238d13e442b9da85f191acbe738; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:55.958385 19639 raft_consensus.cc:2749] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.959316 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:55.959316 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:55.960350 19306 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93b4e264ae824f25b79453db3d1f3d8e in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:55.960350 19453 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93b4e264ae824f25b79453db3d1f3d8e in current term 1: Already voted for candidate 1c398cc3e3244f21a5bcb100ad0bcced in this term.
I20260709 13:19:55.962340 19348 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:55.963392 19642 raft_consensus.cc:2749] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.964078 19642 raft_consensus.cc:493] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.964684 19642 raft_consensus.cc:515] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.964778 19620 raft_consensus.cc:359] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.965494 19620 raft_consensus.cc:385] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.965791 19620 raft_consensus.cc:740] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.966471 19620 consensus_queue.cc:260] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.967227 19642 leader_election.cc:290] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:55.968501 19620 ts_tablet_manager.cc:1434] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:19:55.968333 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:55.969573 19620 tablet_bootstrap.cc:492] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: Bootstrap starting.
W20260709 13:19:55.970384 19345 leader_election.cc:343] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.971829 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:55.972101 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
W20260709 13:19:55.973402 19348 leader_election.cc:343] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.973949 19348 leader_election.cc:304] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e; no voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:55.975047 19642 raft_consensus.cc:2749] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.976410 19620 tablet_bootstrap.cc:654] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.976862 19621 tablet_bootstrap.cc:492] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:55.977331 19621 ts_tablet_manager.cc:1403] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.016s
I20260709 13:19:55.973798 19305 raft_consensus.cc:2393] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c398cc3e3244f21a5bcb100ad0bcced in current term 1: Already voted for candidate a6a4a238d13e442b9da85f191acbe738 in this term.
I20260709 13:19:55.979481 19419 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced; no voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:55.979766 19622 tablet_bootstrap.cc:654] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.980782 19650 raft_consensus.cc:2749] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.981302 19620 tablet_bootstrap.cc:492] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: No bootstrap required, opened a new log
I20260709 13:19:55.981143 19621 raft_consensus.cc:359] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.981817 19620 ts_tablet_manager.cc:1403] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:19:55.981973 19621 raft_consensus.cc:385] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.982331 19621 raft_consensus.cc:740] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.983134 19621 consensus_queue.cc:260] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.985460 19621 ts_tablet_manager.cc:1434] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:55.986722 19621 tablet_bootstrap.cc:492] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:55.984880 19620 raft_consensus.cc:359] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.987524 19620 raft_consensus.cc:385] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.987828 19620 raft_consensus.cc:740] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.988622 19620 consensus_queue.cc:260] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:55.990810 19620 ts_tablet_manager.cc:1434] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:19:56.002143 19621 tablet_bootstrap.cc:654] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.027158 19622 tablet_bootstrap.cc:492] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:56.027870 19622 ts_tablet_manager.cc:1403] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.026s
I20260709 13:19:56.031286 19622 raft_consensus.cc:359] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.032084 19622 raft_consensus.cc:385] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.032403 19622 raft_consensus.cc:740] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.033422 19622 consensus_queue.cc:260] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.036372 19622 ts_tablet_manager.cc:1434] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:19:56.037425 19622 tablet_bootstrap.cc:492] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:56.037761 19621 tablet_bootstrap.cc:492] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:56.041214 19621 ts_tablet_manager.cc:1403] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.010s
I20260709 13:19:56.044108 19622 tablet_bootstrap.cc:654] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.044293 19621 raft_consensus.cc:359] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.045011 19621 raft_consensus.cc:385] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.045305 19621 raft_consensus.cc:740] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.046036 19621 consensus_queue.cc:260] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.048606 19621 ts_tablet_manager.cc:1434] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:56.049997 19621 tablet_bootstrap.cc:492] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: Bootstrap starting.
I20260709 13:19:56.058334 19621 tablet_bootstrap.cc:654] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.064889 19622 tablet_bootstrap.cc:492] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:56.065078 19621 tablet_bootstrap.cc:492] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: No bootstrap required, opened a new log
I20260709 13:19:56.065438 19622 ts_tablet_manager.cc:1403] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.003s
I20260709 13:19:56.065560 19621 ts_tablet_manager.cc:1403] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:19:56.068488 19621 raft_consensus.cc:359] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.068720 19622 raft_consensus.cc:359] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.069228 19621 raft_consensus.cc:385] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.069464 19622 raft_consensus.cc:385] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.069511 19621 raft_consensus.cc:740] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.069818 19622 raft_consensus.cc:740] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.070372 19621 consensus_queue.cc:260] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.070587 19622 consensus_queue.cc:260] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.072573 19621 ts_tablet_manager.cc:1434] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:56.073101 19622 ts_tablet_manager.cc:1434] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:56.074123 19622 tablet_bootstrap.cc:492] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:56.080466 19622 tablet_bootstrap.cc:654] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.085038 19622 tablet_bootstrap.cc:492] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:56.085512 19622 ts_tablet_manager.cc:1403] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:19:56.087812 19622 raft_consensus.cc:359] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.088366 19622 raft_consensus.cc:385] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.088585 19622 raft_consensus.cc:740] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.089149 19622 consensus_queue.cc:260] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.090842 19622 ts_tablet_manager.cc:1434] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:56.091920 19622 tablet_bootstrap.cc:492] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: Bootstrap starting.
I20260709 13:19:56.096951 19622 tablet_bootstrap.cc:654] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.102058 19622 tablet_bootstrap.cc:492] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: No bootstrap required, opened a new log
I20260709 13:19:56.102566 19622 ts_tablet_manager.cc:1403] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 13:19:56.104221 19639 raft_consensus.cc:493] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.104837 19639 raft_consensus.cc:515] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.105324 19622 raft_consensus.cc:359] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.106048 19622 raft_consensus.cc:385] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.106292 19622 raft_consensus.cc:740] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.106726 19639 leader_election.cc:290] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:56.106976 19622 consensus_queue.cc:260] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.109128 19622 ts_tablet_manager.cc:1434] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:19:56.109228 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:56.109928 19379 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:56.111084 19273 leader_election.cc:304] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:56.111233 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:56.111904 19639 raft_consensus.cc:2804] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.111943 19453 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:56.112486 19639 raft_consensus.cc:493] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.113251 19639 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.118880 19639 raft_consensus.cc:515] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.120743 19639 leader_election.cc:290] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:56.121558 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:56.121837 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:56.122165 19379 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.122499 19453 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.124264 19650 raft_consensus.cc:493] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.124858 19650 raft_consensus.cc:515] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.127028 19650 leader_election.cc:290] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:56.127911 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:56.128181 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:56.128697 19305 raft_consensus.cc:2468] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:56.128896 19453 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:56.128971 19382 raft_consensus.cc:2468] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:56.129427 19650 raft_consensus.cc:493] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.129932 19650 raft_consensus.cc:515] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.130406 19422 leader_election.cc:304] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:56.131319 19607 raft_consensus.cc:2804] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.131747 19607 raft_consensus.cc:493] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.132169 19607 raft_consensus.cc:3060] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.132253 19650 leader_election.cc:290] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:56.131537 19273 leader_election.cc:304] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:56.132984 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:56.133368 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:56.133610 19639 raft_consensus.cc:2804] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.133734 19305 raft_consensus.cc:2468] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:56.134094 19382 raft_consensus.cc:2468] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 0.
I20260709 13:19:56.134860 19639 raft_consensus.cc:697] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:56.135241 19422 leader_election.cc:304] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:56.138171 19639 consensus_queue.cc:237] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.138901 19607 raft_consensus.cc:515] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.139468 19379 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:56.140645 19650 raft_consensus.cc:2804] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.141152 19650 raft_consensus.cc:493] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.142956 19650 raft_consensus.cc:3060] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.143185 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:56.143854 19382 raft_consensus.cc:3060] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.151079 19382 raft_consensus.cc:2468] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:56.142009 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:56.152262 19305 raft_consensus.cc:3060] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.153453 19422 leader_election.cc:304] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:56.154472 19645 raft_consensus.cc:2804] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.154954 19645 raft_consensus.cc:697] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:56.150884 19650 raft_consensus.cc:515] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.155756 19645 consensus_queue.cc:237] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.157619 19650 leader_election.cc:290] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:56.158454 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:56.141817 19607 leader_election.cc:290] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:56.159142 19306 raft_consensus.cc:3060] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.159744 19305 raft_consensus.cc:2468] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:56.160871 19201 catalog_manager.cc:5697] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.164415 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:56.165824 19382 raft_consensus.cc:3060] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.167007 19306 raft_consensus.cc:2468] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:56.168944 19419 leader_election.cc:304] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:56.168859 19205 catalog_manager.cc:5697] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.170059 19645 raft_consensus.cc:2804] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.170917 19645 raft_consensus.cc:697] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:56.171818 19645 consensus_queue.cc:237] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.173557 19382 raft_consensus.cc:2468] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 1.
I20260709 13:19:56.187399 19205 catalog_manager.cc:5697] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 1 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:56.221133 19253 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:56.278683 19642 raft_consensus.cc:493] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.279241 19642 raft_consensus.cc:515] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.280947 19642 leader_election.cc:290] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:56.282018 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:56.281963 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738" is_pre_election: true
I20260709 13:19:56.282910 19453 raft_consensus.cc:2468] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:56.283015 19306 raft_consensus.cc:2468] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 0.
I20260709 13:19:56.284011 19348 leader_election.cc:304] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:56.284860 19642 raft_consensus.cc:2804] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.285235 19642 raft_consensus.cc:493] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.285575 19642 raft_consensus.cc:3060] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.292490 19642 raft_consensus.cc:515] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.294162 19642 leader_election.cc:290] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:56.295019 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:56.295270 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:56.295684 19306 raft_consensus.cc:3060] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.295954 19453 raft_consensus.cc:3060] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.301425 19306 raft_consensus.cc:2468] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:56.301728 19453 raft_consensus.cc:2468] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 1.
I20260709 13:19:56.302592 19345 leader_election.cc:304] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:56.303483 19642 raft_consensus.cc:2804] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.304023 19642 raft_consensus.cc:697] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:56.304773 19642 consensus_queue.cc:237] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.312634 19205 catalog_manager.cc:5697] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 0 to 1, leader changed from <none> to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 1 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.379026 19639 consensus_queue.cc:1048] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.380249 19572 raft_consensus.cc:493] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.380893 19572 raft_consensus.cc:515] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.383244 19572 leader_election.cc:290] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:56.383831 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:56.384614 19379 raft_consensus.cc:2468] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:56.385260 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:56.385960 19456 raft_consensus.cc:2468] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 0.
I20260709 13:19:56.387122 19572 consensus_queue.cc:1048] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.387708 19273 leader_election.cc:304] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:56.388672 19639 raft_consensus.cc:2804] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.391866 19607 consensus_queue.cc:1048] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.389045 19639 raft_consensus.cc:493] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.396744 19639 raft_consensus.cc:3060] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.400931 19645 consensus_queue.cc:1048] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.416998 19639 raft_consensus.cc:515] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.426209 19379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:56.427364 19379 raft_consensus.cc:3060] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.437654 19379 raft_consensus.cc:2468] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:56.438907 19642 consensus_queue.cc:1048] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.438990 19273 leader_election.cc:304] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:56.440146 19672 raft_consensus.cc:2804] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.440781 19672 raft_consensus.cc:697] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:56.441596 19672 consensus_queue.cc:237] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:56.457736 19639 leader_election.cc:290] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 1 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:56.462199 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:56.462944 19456 raft_consensus.cc:3060] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.464617 19647 consensus_queue.cc:1048] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.471302 19456 raft_consensus.cc:2468] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:56.472983 19201 catalog_manager.cc:5697] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 1 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.612636 19645 consensus_queue.cc:1048] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.613755 19607 consensus_queue.cc:1048] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.627790 19648 consensus_queue.cc:1048] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.627837 19650 consensus_queue.cc:1048] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.677891 19672 consensus_queue.cc:1048] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.689908 19572 consensus_queue.cc:1048] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.717640 19647 consensus_queue.cc:1048] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.729405 19642 consensus_queue.cc:1048] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.962301 19572 consensus_queue.cc:1048] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.980733 19672 consensus_queue.cc:1048] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:57.224081 19253 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:57.756615 19572 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.757282 19572 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:57.758960 19572 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:57.759608 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e" is_pre_election: true
I20260709 13:19:57.759960 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" is_pre_election: true
I20260709 13:19:57.760241 19382 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:57.760638 19453 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 1.
I20260709 13:19:57.761394 19273 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:57.762116 19572 raft_consensus.cc:2804] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:57.762475 19572 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.762804 19572 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.767835 19572 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:57.769727 19572 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:57.770588 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:57.770740 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:57.771256 19382 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.771488 19453 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.777010 19382 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:57.777227 19453 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:57.778131 19273 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:57.778882 19572 raft_consensus.cc:2804] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.779294 19572 raft_consensus.cc:697] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:57.779938 19572 consensus_queue.cc:237] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:57.788153 19203 catalog_manager.cc:5697] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 0 to 2, leader changed from <none> to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.180601 19382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
mode: GRACEFUL
new_leader_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:42948
I20260709 13:19:58.181298 19382 raft_consensus.cc:606] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Received request to transfer leadership to TS a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:58.187053 19453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c50d60833588421393abda714c75404e"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:58.187652 19453 raft_consensus.cc:606] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:58.195878 19453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:58.196427 19453 raft_consensus.cc:606] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS a6a4a238d13e442b9da85f191acbe738
I20260709 13:19:58.201377 19306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:19:58.201901 19306 raft_consensus.cc:606] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:58.207175 19453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:49438
I20260709 13:19:58.207706 19453 raft_consensus.cc:606] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:58.212904 19306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f851abede8426b8e934d1d828965a2"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:19:58.213439 19306 raft_consensus.cc:606] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:58.218465 19306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:52342
I20260709 13:19:58.218968 19306 raft_consensus.cc:606] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Received request to transfer leadership to TS 93b4e264ae824f25b79453db3d1f3d8e
I20260709 13:19:58.223750 19382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
mode: GRACEFUL
new_leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:42948
I20260709 13:19:58.224217 19382 raft_consensus.cc:606] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Received request to transfer leadership to TS 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:19:58.251268 19698 raft_consensus.cc:993] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:58.251727 19650 raft_consensus.cc:1081] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:58.253528 19306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:52332
I20260709 13:19:58.254014 19306 raft_consensus.cc:493] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.254308 19306 raft_consensus.cc:3060] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.258919 19306 raft_consensus.cc:515] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.260757 19306 leader_election.cc:290] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.262118 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:58.262291 19453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e56e48fcba4e34a0404d93c1793d87" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.262931 19382 raft_consensus.cc:3060] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.263022 19453 raft_consensus.cc:3055] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.263535 19453 raft_consensus.cc:740] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:58.264413 19453 consensus_queue.cc:260] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.265086 19456 raft_consensus.cc:1275] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:58.265712 19453 raft_consensus.cc:3060] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.266520 19572 consensus_queue.cc:1048] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:58.269824 19382 raft_consensus.cc:2468] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:58.273108 19453 raft_consensus.cc:2468] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:58.273728 19273 leader_election.cc:304] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:58.274607 19639 raft_consensus.cc:2804] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.275164 19639 raft_consensus.cc:697] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:58.276041 19639 consensus_queue.cc:237] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.285116 19382 raft_consensus.cc:1275] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:58.287410 19639 consensus_queue.cc:1048] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:58.290759 19203 catalog_manager.cc:5697] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.347532 19642 raft_consensus.cc:993] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: : Instructing follower 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:19:58.348065 19705 raft_consensus.cc:1081] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Signalling peer 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:19:58.349541 19456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:49428
I20260709 13:19:58.350100 19456 raft_consensus.cc:493] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.350404 19456 raft_consensus.cc:3060] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.356307 19456 raft_consensus.cc:515] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.357942 19456 leader_election.cc:290] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:19:58.358770 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:58.359017 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176930c6e1a349ed98f6c16a09da0e88" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:58.359381 19306 raft_consensus.cc:3060] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.359701 19382 raft_consensus.cc:3055] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.359977 19382 raft_consensus.cc:740] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:58.360622 19382 consensus_queue.cc:260] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.361505 19382 raft_consensus.cc:3060] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.364473 19306 raft_consensus.cc:2468] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 2.
I20260709 13:19:58.365710 19419 leader_election.cc:304] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:58.366569 19650 raft_consensus.cc:2804] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.366801 19382 raft_consensus.cc:2468] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 2.
I20260709 13:19:58.367030 19650 raft_consensus.cc:697] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:58.367959 19650 consensus_queue.cc:237] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.374848 19203 catalog_manager.cc:5697] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 1 to 2, leader changed from 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194) to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 2 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.452939 19698 raft_consensus.cc:993] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:58.453405 19650 raft_consensus.cc:1081] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:58.454985 19306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c50d60833588421393abda714c75404e"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:52332
I20260709 13:19:58.455567 19306 raft_consensus.cc:493] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.455951 19306 raft_consensus.cc:3060] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.461181 19306 raft_consensus.cc:515] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.462711 19306 leader_election.cc:290] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.463691 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50d60833588421393abda714c75404e" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:58.463950 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c50d60833588421393abda714c75404e" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.464356 19382 raft_consensus.cc:3060] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.464574 19456 raft_consensus.cc:3055] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.464963 19456 raft_consensus.cc:740] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:58.465721 19456 consensus_queue.cc:260] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.466934 19456 raft_consensus.cc:3060] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.471422 19382 raft_consensus.cc:2468] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:58.472770 19273 leader_election.cc:304] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:58.473462 19639 raft_consensus.cc:2804] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.473418 19456 raft_consensus.cc:2468] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:58.474278 19639 raft_consensus.cc:697] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:58.475083 19639 consensus_queue.cc:237] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.482780 19203 catalog_manager.cc:5697] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.490502 19703 raft_consensus.cc:993] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.491035 19703 raft_consensus.cc:1081] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.492981 19382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42938
I20260709 13:19:58.493480 19382 raft_consensus.cc:493] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.493789 19382 raft_consensus.cc:3060] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.498517 19382 raft_consensus.cc:515] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.499987 19382 leader_election.cc:290] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.500900 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:58.501117 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17cb4c76287648b597cd1d275ccfdd86" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.501554 19306 raft_consensus.cc:3055] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.501688 19456 raft_consensus.cc:3060] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.501843 19306 raft_consensus.cc:740] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:58.502609 19306 consensus_queue.cc:260] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.503510 19306 raft_consensus.cc:3060] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.508002 19456 raft_consensus.cc:2468] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.508994 19348 leader_election.cc:304] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:58.509712 19705 raft_consensus.cc:2804] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.509902 19306 raft_consensus.cc:2468] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.510320 19705 raft_consensus.cc:697] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:58.511202 19705 consensus_queue.cc:237] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.519246 19203 catalog_manager.cc:5697] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.528700 19698 raft_consensus.cc:993] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.529139 19650 raft_consensus.cc:1081] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.530593 19382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42942
I20260709 13:19:58.531078 19382 raft_consensus.cc:493] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.531383 19382 raft_consensus.cc:3060] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.536139 19382 raft_consensus.cc:515] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.537791 19382 leader_election.cc:290] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.538594 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:58.538950 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3574f8f346ae44f5b2dda45f6230b821" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.539353 19306 raft_consensus.cc:3060] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.539546 19456 raft_consensus.cc:3055] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.539914 19456 raft_consensus.cc:740] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:19:58.540683 19456 consensus_queue.cc:260] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.541734 19456 raft_consensus.cc:3060] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.542176 19642 raft_consensus.cc:993] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: : Instructing follower a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:58.542752 19705 raft_consensus.cc:1081] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Signalling peer a6a4a238d13e442b9da85f191acbe738 to start an election
I20260709 13:19:58.544492 19305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
 from {username='slave'} at 127.0.0.1:52334
I20260709 13:19:58.545100 19305 raft_consensus.cc:493] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.545466 19305 raft_consensus.cc:3060] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.546098 19306 raft_consensus.cc:2468] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.547329 19345 leader_election.cc:304] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93b4e264ae824f25b79453db3d1f3d8e, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:58.547786 19456 raft_consensus.cc:2468] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.548199 19705 raft_consensus.cc:2804] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.549316 19705 raft_consensus.cc:697] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:58.550065 19705 consensus_queue.cc:237] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.551874 19305 raft_consensus.cc:515] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.554896 19382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:19:58.555042 19305 leader_election.cc:290] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Requested vote from peers 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.555219 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "497039fa2f0943f1b1f8a4f23ce9f63c" candidate_uuid: "a6a4a238d13e442b9da85f191acbe738" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.555509 19382 raft_consensus.cc:3055] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.555874 19382 raft_consensus.cc:740] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:58.555807 19456 raft_consensus.cc:3060] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.556756 19382 consensus_queue.cc:260] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.557819 19382 raft_consensus.cc:3060] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.560243 19203 catalog_manager.cc:5697] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.561831 19456 raft_consensus.cc:2468] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:58.562958 19273 leader_election.cc:304] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:19:58.563712 19639 raft_consensus.cc:2804] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.564201 19639 raft_consensus.cc:697] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Leader. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:58.565088 19639 consensus_queue.cc:237] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.566216 19382 raft_consensus.cc:2468] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a4a238d13e442b9da85f191acbe738 in term 2.
I20260709 13:19:58.574769 19203 catalog_manager.cc:5697] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 reported cstate change: term changed from 1 to 2, leader changed from 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194) to a6a4a238d13e442b9da85f191acbe738 (127.8.238.193). New cstate: current_term: 2 leader_uuid: "a6a4a238d13e442b9da85f191acbe738" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.606904 19703 raft_consensus.cc:993] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.607362 19639 raft_consensus.cc:1081] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.608810 19382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f851abede8426b8e934d1d828965a2"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42938
I20260709 13:19:58.609280 19382 raft_consensus.cc:493] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.609583 19382 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.614154 19382 raft_consensus.cc:515] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.615826 19382 leader_election.cc:290] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.616962 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.617084 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:58.617709 19456 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.617843 19305 raft_consensus.cc:3055] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.618337 19305 raft_consensus.cc:740] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:58.619146 19305 consensus_queue.cc:260] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.619984 19703 raft_consensus.cc:993] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.620528 19305 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.620623 19639 raft_consensus.cc:1081] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Signalling peer 93b4e264ae824f25b79453db3d1f3d8e to start an election
I20260709 13:19:58.622574 19382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
 from {username='slave'} at 127.0.0.1:42938
I20260709 13:19:58.623297 19382 raft_consensus.cc:493] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:58.623694 19382 raft_consensus.cc:3060] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.624176 19456 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.625249 19348 leader_election.cc:304] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:58.625957 19705 raft_consensus.cc:2804] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.626425 19705 raft_consensus.cc:697] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:58.627526 19705 consensus_queue.cc:237] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.628688 19305 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.631052 19382 raft_consensus.cc:515] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.633378 19382 leader_election.cc:290] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047)
I20260709 13:19:58.634042 19305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:19:58.634851 19456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c259819e55e44f8bb20fffd77fb5c20c" candidate_uuid: "93b4e264ae824f25b79453db3d1f3d8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
I20260709 13:19:58.635448 19305 raft_consensus.cc:3055] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:58.635576 19456 raft_consensus.cc:3060] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.635807 19305 raft_consensus.cc:740] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:19:58.636705 19305 consensus_queue.cc:260] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.637144 19203 catalog_manager.cc:5697] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.638012 19305 raft_consensus.cc:3060] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.643183 19456 raft_consensus.cc:2468] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.644495 19348 leader_election.cc:304] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:19:58.645310 19305 raft_consensus.cc:2468] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93b4e264ae824f25b79453db3d1f3d8e in term 2.
I20260709 13:19:58.645530 19705 raft_consensus.cc:2804] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:58.646166 19705 raft_consensus.cc:697] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Leader. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:19:58.647171 19705 consensus_queue.cc:237] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:19:58.657241 19203 catalog_manager.cc:5697] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e reported cstate change: term changed from 1 to 2, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194). New cstate: current_term: 2 leader_uuid: "93b4e264ae824f25b79453db3d1f3d8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.721793 19456 raft_consensus.cc:1275] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.723027 19639 consensus_queue.cc:1048] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.732268 19382 raft_consensus.cc:1275] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.734023 19639 consensus_queue.cc:1048] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.827580 19379 raft_consensus.cc:1275] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.828966 19650 consensus_queue.cc:1048] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.838223 19305 raft_consensus.cc:1275] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.841305 19650 consensus_queue.cc:1048] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.938894 19456 raft_consensus.cc:1275] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.940299 19456 raft_consensus.cc:1275] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.940196 19639 consensus_queue.cc:1048] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.941622 19705 consensus_queue.cc:1048] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.959069 19379 raft_consensus.cc:1275] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.960664 19700 consensus_queue.cc:1048] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.961524 19305 raft_consensus.cc:1275] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.966720 19725 consensus_queue.cc:1048] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.977285 19455 raft_consensus.cc:1275] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.978911 19700 consensus_queue.cc:1048] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.989007 19379 raft_consensus.cc:1275] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Refusing update from remote peer a6a4a238d13e442b9da85f191acbe738: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.990513 19572 consensus_queue.cc:1048] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.996937 19455 raft_consensus.cc:1275] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.998723 19642 consensus_queue.cc:1048] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:59.010830 19305 raft_consensus.cc:1275] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.012494 19725 consensus_queue.cc:1048] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:59.031778 19305 raft_consensus.cc:1275] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.033290 19725 consensus_queue.cc:1048] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:59.039552 19305 raft_consensus.cc:1275] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.040988 19726 consensus_queue.cc:1048] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:59.043686 19455 raft_consensus.cc:1275] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.045725 19642 consensus_queue.cc:1048] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:59.055514 19456 raft_consensus.cc:1275] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Refusing update from remote peer 93b4e264ae824f25b79453db3d1f3d8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.057384 19642 consensus_queue.cc:1048] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:01.228587 19201 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46030:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:01.256240 19201 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46030:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:01.280385 19204 catalog_manager.cc:5789] TS 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195:33047) does not have the latest schema for tablet 176930c6e1a349ed98f6c16a09da0e88 (table soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1]). Expected version 1 got 0
I20260709 13:20:01.285202  9147 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:20:01.523104 19761 log.cc:927] Time spent T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:01.554510 19755 log.cc:927] Time spent T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:20:01.594556 19273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:39847, user_credentials={real_user=slave}} blocked reactor thread for 51532.7us
I20260709 13:20:01.640677 19783 tablet.cc:1724] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:01.742722 19333 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:497039fa2f0943f1b1f8a4f23ce9f63c)
I20260709 13:20:01.758800 19792 tablet.cc:1724] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.762888 19797 tablet.cc:1724] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:01.778623 19785 log.cc:927] Time spent T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: Append to log took a long time: real 0.111s	user 0.005s	sys 0.000s
W20260709 13:20:01.778368 19780 log.cc:927] Time spent T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
W20260709 13:20:01.789742 19782 log.cc:927] Time spent T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
W20260709 13:20:01.793339 19333 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:497039fa2f0943f1b1f8a4f23ce9f63c)
I20260709 13:20:01.762872 19796 tablet.cc:1724] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:01.797020 19787 log.cc:927] Time spent T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: Append to log took a long time: real 0.122s	user 0.004s	sys 0.000s
I20260709 13:20:01.800103 19798 tablet.cc:1724] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.779822 19786 tablet.cc:1724] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.777602 19793 tablet.cc:1724] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.805874 19801 tablet.cc:1724] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:01.810515 19791 log.cc:927] Time spent T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
W20260709 13:20:01.818749 19788 log.cc:927] Time spent T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:20:01.799011 19333 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:497039fa2f0943f1b1f8a4f23ce9f63c)
I20260709 13:20:01.822610 19382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f851abede8426b8e934d1d828965a2"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
mode: GRACEFUL
new_leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:60088
I20260709 13:20:01.824453 19790 tablet.cc:1724] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.826296 19382 raft_consensus.cc:606] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Received request to transfer leadership to TS 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:20:01.834370 19799 tablet.cc:1724] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.835819 19767 raft_consensus.cc:993] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: : Instructing follower 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:01.836431 19767 raft_consensus.cc:1081] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Signalling peer 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:01.838632 19455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f851abede8426b8e934d1d828965a2"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:49428
I20260709 13:20:01.839394 19455 raft_consensus.cc:493] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:01.839895 19455 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.843286 19803 tablet.cc:1724] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.852633 19804 tablet.cc:1724] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.868752 19796 tablet.cc:1724] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.872546 19783 tablet.cc:1724] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.873246 19803 tablet.cc:1724] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.869971 19455 raft_consensus.cc:515] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:01.897289 19455 leader_election.cc:290] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:20:01.897884 19378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:20:01.898818 19378 raft_consensus.cc:3055] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:01.899123 19378 raft_consensus.cc:740] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:20:01.902371 19306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f851abede8426b8e934d1d828965a2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:20:01.879727 19797 tablet.cc:1724] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.903532 19306 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.904228 19378 consensus_queue.cc:260] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:01.909315 19378 raft_consensus.cc:3060] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:01.916435 19798 tablet.cc:1724] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.927767 19306 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:01.929533 19419 leader_election.cc:304] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:20:01.931099 19650 raft_consensus.cc:2804] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.931770 19650 raft_consensus.cc:697] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:20:01.932886 19650 consensus_queue.cc:237] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:01.931421 19798 tablet.cc:1724] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.935130 19304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:43206
I20260709 13:20:01.935855 19304 raft_consensus.cc:606] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Received request to transfer leadership to TS 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:20:01.936982 19378 raft_consensus.cc:2468] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:01.931013 19786 tablet.cc:1724] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.941179  9147 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:20:01.949772 19792 tablet.cc:1724] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.962486  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:01.965094 19799 tablet.cc:1724] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.930930 19793 tablet.cc:1724] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.966094 19803 tablet.cc:1724] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.969111 19204 catalog_manager.cc:5697] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 2 to 3, leader changed from 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194) to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 3 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.967170 19790 tablet.cc:1724] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.976933 19783 tablet.cc:1724] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.991351 19804 tablet.cc:1724] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:01.994683 19378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f"
dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
mode: GRACEFUL
new_leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:60088
I20260709 13:20:01.995369 19378 raft_consensus.cc:606] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Received request to transfer leadership to TS 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:20:02.002879 19306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2"
dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
mode: GRACEFUL
new_leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:43206
I20260709 13:20:02.003489 19306 raft_consensus.cc:606] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Received request to transfer leadership to TS 1c398cc3e3244f21a5bcb100ad0bcced
I20260709 13:20:02.005082  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:02.005721  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:01.989758 19797 tablet.cc:1724] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:02.054203 19201 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f: soft_deleted_table [id=15af7cabec01457ca136297a3477a0b1] alter complete (version 1)
I20260709 13:20:02.062947 19767 raft_consensus.cc:993] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: : Instructing follower 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:02.063484 19642 raft_consensus.cc:1081] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Signalling peer 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:02.064992 19455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:49428
I20260709 13:20:02.065573 19455 raft_consensus.cc:493] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.065936 19455 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.071297 19455 raft_consensus.cc:515] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.072901 19455 leader_election.cc:290] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:20:02.073766 19304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:20:02.073995 19378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e63ba69e86741a682ae8e0052ed390f" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:20:02.074497 19304 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.074697 19378 raft_consensus.cc:3055] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:02.075109 19378 raft_consensus.cc:740] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 93b4e264ae824f25b79453db3d1f3d8e, State: Running, Role: LEADER
I20260709 13:20:02.075989 19378 consensus_queue.cc:260] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.077374 19378 raft_consensus.cc:3060] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.080708 19304 raft_consensus.cc:2468] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:02.082317 19419 leader_election.cc:304] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, a6a4a238d13e442b9da85f191acbe738; no voters: 
I20260709 13:20:02.083138 19650 raft_consensus.cc:2804] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:02.083617 19650 raft_consensus.cc:697] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:20:02.084545 19378 raft_consensus.cc:2468] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:02.084477 19650 consensus_queue.cc:237] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.094065 19204 catalog_manager.cc:5697] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 2 to 3, leader changed from 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194) to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 3 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.223964 19777 raft_consensus.cc:993] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:02.224501 19737 raft_consensus.cc:1081] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Signalling peer 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:02.226047 19449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:49420
I20260709 13:20:02.226617 19449 raft_consensus.cc:493] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.226948 19449 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.232913 19449 raft_consensus.cc:515] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.234925 19449 leader_election.cc:290] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:20:02.236096 19304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:20:02.236109 19378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd0b67c9966464d88a632905f3d92de" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:20:02.236945 19304 raft_consensus.cc:3055] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:02.237073 19378 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.237288 19304 raft_consensus.cc:740] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:20:02.238399 19304 consensus_queue.cc:260] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.239660 19304 raft_consensus.cc:3060] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.244277 19378 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:02.245860 19422 leader_election.cc:304] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:20:02.246767 19650 raft_consensus.cc:2804] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:02.246874 19304 raft_consensus.cc:2468] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:02.247347 19650 raft_consensus.cc:697] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:20:02.248428 19777 raft_consensus.cc:993] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: : Instructing follower 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:02.248293 19650 consensus_queue.cc:237] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.248970 19737 raft_consensus.cc:1081] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Signalling peer 1c398cc3e3244f21a5bcb100ad0bcced to start an election
I20260709 13:20:02.250725 19449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2"
dest_uuid: "1c398cc3e3244f21a5bcb100ad0bcced"
 from {username='slave'} at 127.0.0.1:49420
I20260709 13:20:02.253312 19449 raft_consensus.cc:493] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.253731 19449 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.255663 19204 catalog_manager.cc:5697] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 2 to 3, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 3 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.260336 19449 raft_consensus.cc:515] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.262563 19449 leader_election.cc:290] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Requested vote from peers a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829), 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847)
I20260709 13:20:02.263865 19378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "93b4e264ae824f25b79453db3d1f3d8e"
I20260709 13:20:02.264506 19378 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.265220 19304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbd28782bd7e4d7fbd73c3f0aab258e2" candidate_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a4a238d13e442b9da85f191acbe738"
I20260709 13:20:02.265996 19304 raft_consensus.cc:3055] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:02.266455 19304 raft_consensus.cc:740] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6a4a238d13e442b9da85f191acbe738, State: Running, Role: LEADER
I20260709 13:20:02.267369 19304 consensus_queue.cc:260] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.268538 19304 raft_consensus.cc:3060] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.270964 19378 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:02.272241 19422 leader_election.cc:304] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c398cc3e3244f21a5bcb100ad0bcced, 93b4e264ae824f25b79453db3d1f3d8e; no voters: 
I20260709 13:20:02.273145 19650 raft_consensus.cc:2804] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:02.274030 19650 raft_consensus.cc:697] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Becoming Leader. State: Replica: 1c398cc3e3244f21a5bcb100ad0bcced, State: Running, Role: LEADER
I20260709 13:20:02.275151 19650 consensus_queue.cc:237] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } }
I20260709 13:20:02.276388 19304 raft_consensus.cc:2468] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c398cc3e3244f21a5bcb100ad0bcced in term 3.
I20260709 13:20:02.284575 19204 catalog_manager.cc:5697] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced reported cstate change: term changed from 2 to 3, leader changed from a6a4a238d13e442b9da85f191acbe738 (127.8.238.193) to 1c398cc3e3244f21a5bcb100ad0bcced (127.8.238.195). New cstate: current_term: 3 leader_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c398cc3e3244f21a5bcb100ad0bcced" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 33047 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.399786 19304 raft_consensus.cc:1275] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:02.401464 19784 consensus_queue.cc:1048] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:02.410988 19378 raft_consensus.cc:1275] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:02.413740 19650 consensus_queue.cc:1048] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:02.680265 19304 raft_consensus.cc:1275] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.681771 19650 consensus_queue.cc:1048] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:02.693713 19378 raft_consensus.cc:1275] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.695044 19650 consensus_queue.cc:1048] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:02.703938 19304 raft_consensus.cc:1275] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.705263 19650 consensus_queue.cc:1048] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:02.711319 19378 raft_consensus.cc:1275] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.714021 19650 consensus_queue.cc:1048] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:20:02.725638 19306 raft_consensus.cc:1275] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.727389 19812 consensus_queue.cc:1048] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a4a238d13e442b9da85f191acbe738" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:02.742326 19378 raft_consensus.cc:1275] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Refusing update from remote peer 1c398cc3e3244f21a5bcb100ad0bcced: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:02.747298 19784 consensus_queue.cc:1048] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [LEADER]: Connected to new peer: Peer: permanent_uuid: "93b4e264ae824f25b79453db3d1f3d8e" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 39847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:03.070125  9147 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:03.075455  9147 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:20:03.075977  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:03.081804  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:03.082376  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:04.112308  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
W20260709 13:20:04.116206 19345 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:20:04.122279 19345 consensus_peers.cc:597] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.152659  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:04.153569  9147 tablet_replica.cc:333] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.154793  9147 raft_consensus.cc:2243] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.155377  9147 raft_consensus.cc:2272] T 176930c6e1a349ed98f6c16a09da0e88 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.158628  9147 tablet_replica.cc:333] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.159332  9147 raft_consensus.cc:2243] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.159885  9147 raft_consensus.cc:2272] T 00f851abede8426b8e934d1d828965a2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.162321  9147 tablet_replica.cc:333] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.163002  9147 raft_consensus.cc:2243] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.163466  9147 raft_consensus.cc:2272] T 17cb4c76287648b597cd1d275ccfdd86 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.165690  9147 tablet_replica.cc:333] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.166417  9147 raft_consensus.cc:2243] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.167181  9147 raft_consensus.cc:2272] T c50d60833588421393abda714c75404e P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.169457  9147 tablet_replica.cc:333] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.170424  9147 raft_consensus.cc:2243] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.171094  9147 raft_consensus.cc:2272] T 2cd0b67c9966464d88a632905f3d92de P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.173245  9147 tablet_replica.cc:333] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.173802  9147 raft_consensus.cc:2243] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.174703  9147 raft_consensus.cc:2272] T b45420f34ff0497785fee7251b2c3c7e P a6a4a238d13e442b9da85f191acbe738 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.177297  9147 tablet_replica.cc:333] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.177953  9147 raft_consensus.cc:2243] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.178802  9147 raft_consensus.cc:2272] T 497039fa2f0943f1b1f8a4f23ce9f63c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.180879  9147 tablet_replica.cc:333] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.181568  9147 raft_consensus.cc:2243] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.182112  9147 raft_consensus.cc:2272] T 43dd69a5570e4e6b9d98d8664a654e2d P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.185421  9147 tablet_replica.cc:333] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.186308  9147 raft_consensus.cc:2243] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.186957  9147 raft_consensus.cc:2272] T e5a15d95cfc74abbafcb5d82a6ec64d7 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.189517  9147 tablet_replica.cc:333] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.190187  9147 raft_consensus.cc:2243] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.191022  9147 raft_consensus.cc:2272] T 21e56e48fcba4e34a0404d93c1793d87 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.193339  9147 tablet_replica.cc:333] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.194186  9147 raft_consensus.cc:2243] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.194792  9147 raft_consensus.cc:2272] T 9fe84ad7632741b78518543ce38ed68b P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.196070 19345 consensus_peers.cc:597] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.197479  9147 tablet_replica.cc:333] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.198333  9147 raft_consensus.cc:2243] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.198832  9147 raft_consensus.cc:2272] T bbd28782bd7e4d7fbd73c3f0aab258e2 P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.200986  9147 tablet_replica.cc:333] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.201529  9147 raft_consensus.cc:2243] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.201985  9147 raft_consensus.cc:2272] T 3574f8f346ae44f5b2dda45f6230b821 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.204026  9147 tablet_replica.cc:333] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.204576  9147 raft_consensus.cc:2243] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.205106  9147 raft_consensus.cc:2272] T c259819e55e44f8bb20fffd77fb5c20c P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.207320  9147 tablet_replica.cc:333] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.207878  9147 raft_consensus.cc:2243] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.208745  9147 raft_consensus.cc:2272] T 21a86a543ba74b68858d8eb05c175138 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.210988  9147 tablet_replica.cc:333] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.211900  9147 raft_consensus.cc:2243] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.212442  9147 raft_consensus.cc:2272] T 4b971ad6505448589f155d7b895b6723 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.215595  9147 tablet_replica.cc:333] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.216295  9147 raft_consensus.cc:2243] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.216940  9147 raft_consensus.cc:2272] T 5e63ba69e86741a682ae8e0052ed390f P a6a4a238d13e442b9da85f191acbe738 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.217486 19419 consensus_peers.cc:597] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.217590 19345 consensus_peers.cc:597] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.219388  9147 tablet_replica.cc:333] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738: stopping tablet replica
I20260709 13:20:04.219946  9147 raft_consensus.cc:2243] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.220939  9147 raft_consensus.cc:2272] T 63f5bca940b943c18db11e38255b1261 P a6a4a238d13e442b9da85f191acbe738 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.256276 19419 consensus_peers.cc:597] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.267047  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
W20260709 13:20:04.283798 19419 consensus_peers.cc:597] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.306000  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
W20260709 13:20:04.328697 19422 consensus_peers.cc:597] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Couldn't send request to peer 93b4e264ae824f25b79453db3d1f3d8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.341146 19345 consensus_peers.cc:597] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.343923  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:04.344962  9147 tablet_replica.cc:333] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.345952  9147 raft_consensus.cc:2243] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.346655  9147 raft_consensus.cc:2272] T 176930c6e1a349ed98f6c16a09da0e88 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.347124 19419 consensus_peers.cc:597] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.348974  9147 tablet_replica.cc:333] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.349680  9147 raft_consensus.cc:2243] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.350536  9147 raft_consensus.cc:2272] T 17cb4c76287648b597cd1d275ccfdd86 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.352663  9147 tablet_replica.cc:333] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.353348  9147 raft_consensus.cc:2243] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.353847  9147 raft_consensus.cc:2272] T 2cd0b67c9966464d88a632905f3d92de P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.356501  9147 tablet_replica.cc:333] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.357292  9147 raft_consensus.cc:2243] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.357934  9147 raft_consensus.cc:2272] T 00f851abede8426b8e934d1d828965a2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:04.358767 19419 consensus_peers.cc:597] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.359083 19422 consensus_peers.cc:597] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Couldn't send request to peer 93b4e264ae824f25b79453db3d1f3d8e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.360384  9147 tablet_replica.cc:333] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.361029  9147 raft_consensus.cc:2243] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.361481  9147 raft_consensus.cc:2272] T 5e63ba69e86741a682ae8e0052ed390f P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.363818  9147 tablet_replica.cc:333] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.364498  9147 raft_consensus.cc:2243] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.364989  9147 raft_consensus.cc:2272] T 63f5bca940b943c18db11e38255b1261 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.367110  9147 tablet_replica.cc:333] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.367736  9147 raft_consensus.cc:2243] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.368559  9147 raft_consensus.cc:2272] T c259819e55e44f8bb20fffd77fb5c20c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.370826  9147 tablet_replica.cc:333] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.371444  9147 raft_consensus.cc:2243] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.371927  9147 raft_consensus.cc:2272] T 21a86a543ba74b68858d8eb05c175138 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.374162  9147 tablet_replica.cc:333] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.374807  9147 raft_consensus.cc:2243] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.375634  9147 raft_consensus.cc:2272] T 3574f8f346ae44f5b2dda45f6230b821 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.377728  9147 tablet_replica.cc:333] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.378417  9147 raft_consensus.cc:2243] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.379352  9147 raft_consensus.cc:2272] T 4b971ad6505448589f155d7b895b6723 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.381649  9147 tablet_replica.cc:333] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.382380  9147 raft_consensus.cc:2243] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.382854  9147 raft_consensus.cc:2272] T c50d60833588421393abda714c75404e P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.384907  9147 tablet_replica.cc:333] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.385418  9147 raft_consensus.cc:2243] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.385879  9147 raft_consensus.cc:2272] T 21e56e48fcba4e34a0404d93c1793d87 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.388216  9147 tablet_replica.cc:333] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.388926  9147 raft_consensus.cc:2243] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.389387  9147 raft_consensus.cc:2272] T 9fe84ad7632741b78518543ce38ed68b P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.391593  9147 tablet_replica.cc:333] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.392128  9147 raft_consensus.cc:2243] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.392599  9147 raft_consensus.cc:2272] T 497039fa2f0943f1b1f8a4f23ce9f63c P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.394600  9147 tablet_replica.cc:333] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.395136  9147 raft_consensus.cc:2243] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.395609  9147 raft_consensus.cc:2272] T b45420f34ff0497785fee7251b2c3c7e P 93b4e264ae824f25b79453db3d1f3d8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.397595  9147 tablet_replica.cc:333] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.398105  9147 raft_consensus.cc:2243] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.398636  9147 raft_consensus.cc:2272] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 93b4e264ae824f25b79453db3d1f3d8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.400573  9147 tablet_replica.cc:333] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.401095  9147 raft_consensus.cc:2243] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.401958  9147 raft_consensus.cc:2272] T 43dd69a5570e4e6b9d98d8664a654e2d P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.404237  9147 tablet_replica.cc:333] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e: stopping tablet replica
I20260709 13:20:04.404758  9147 raft_consensus.cc:2243] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.405622  9147 raft_consensus.cc:2272] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 93b4e264ae824f25b79453db3d1f3d8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.445248  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
W20260709 13:20:04.459764 19419 consensus_peers.cc:597] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer a6a4a238d13e442b9da85f191acbe738 (127.8.238.193:39829): Couldn't send request to peer a6a4a238d13e442b9da85f191acbe738. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:39829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.481455  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
W20260709 13:20:04.505288 19422 consensus_peers.cc:597] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Couldn't send request to peer 93b4e264ae824f25b79453db3d1f3d8e. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:39847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.526465  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:04.527410  9147 tablet_replica.cc:333] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.528195  9147 raft_consensus.cc:2243] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.529083  9147 raft_consensus.cc:2272] T 176930c6e1a349ed98f6c16a09da0e88 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.532276  9147 tablet_replica.cc:333] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.533056  9147 raft_consensus.cc:2243] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:20:04.533587 19422 consensus_peers.cc:597] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced -> Peer 93b4e264ae824f25b79453db3d1f3d8e (127.8.238.194:39847): Couldn't send request to peer 93b4e264ae824f25b79453db3d1f3d8e. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:39847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.534112  9147 raft_consensus.cc:2272] T 00f851abede8426b8e934d1d828965a2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.536291  9147 tablet_replica.cc:333] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.536854  9147 raft_consensus.cc:2243] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.537269  9147 raft_consensus.cc:2272] T 17cb4c76287648b597cd1d275ccfdd86 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.539253  9147 tablet_replica.cc:333] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.539770  9147 raft_consensus.cc:2243] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.540467  9147 raft_consensus.cc:2272] T 2cd0b67c9966464d88a632905f3d92de P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.542479  9147 tablet_replica.cc:333] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.543008  9147 raft_consensus.cc:2243] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.543408  9147 raft_consensus.cc:2272] T 3574f8f346ae44f5b2dda45f6230b821 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.545297  9147 tablet_replica.cc:333] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.545881  9147 raft_consensus.cc:2243] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.546339  9147 raft_consensus.cc:2272] T c259819e55e44f8bb20fffd77fb5c20c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.548408  9147 tablet_replica.cc:333] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.548940  9147 raft_consensus.cc:2243] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.549414  9147 raft_consensus.cc:2272] T 21a86a543ba74b68858d8eb05c175138 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.551510  9147 tablet_replica.cc:333] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.552019  9147 raft_consensus.cc:2243] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.552433  9147 raft_consensus.cc:2272] T c50d60833588421393abda714c75404e P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.554373  9147 tablet_replica.cc:333] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.554898  9147 raft_consensus.cc:2243] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.555275  9147 raft_consensus.cc:2272] T 497039fa2f0943f1b1f8a4f23ce9f63c P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.557143  9147 tablet_replica.cc:333] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.557658  9147 raft_consensus.cc:2243] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.558061  9147 raft_consensus.cc:2272] T b45420f34ff0497785fee7251b2c3c7e P 1c398cc3e3244f21a5bcb100ad0bcced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.560097  9147 tablet_replica.cc:333] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.560592  9147 raft_consensus.cc:2243] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.561003  9147 raft_consensus.cc:2272] T 21e56e48fcba4e34a0404d93c1793d87 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.563032  9147 tablet_replica.cc:333] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.563560  9147 raft_consensus.cc:2243] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.564353  9147 raft_consensus.cc:2272] T 9fe84ad7632741b78518543ce38ed68b P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.566581  9147 tablet_replica.cc:333] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.567091  9147 raft_consensus.cc:2243] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.567824  9147 raft_consensus.cc:2272] T bbd28782bd7e4d7fbd73c3f0aab258e2 P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.569824  9147 tablet_replica.cc:333] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.570356  9147 raft_consensus.cc:2243] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.571044  9147 raft_consensus.cc:2272] T 5e63ba69e86741a682ae8e0052ed390f P 1c398cc3e3244f21a5bcb100ad0bcced [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.573112  9147 tablet_replica.cc:333] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.573722  9147 raft_consensus.cc:2243] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.574216  9147 raft_consensus.cc:2272] T 63f5bca940b943c18db11e38255b1261 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.576422  9147 tablet_replica.cc:333] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.576983  9147 raft_consensus.cc:2243] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.577477  9147 raft_consensus.cc:2272] T 4b971ad6505448589f155d7b895b6723 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.579425  9147 tablet_replica.cc:333] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.580674  9147 raft_consensus.cc:2243] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.581176  9147 raft_consensus.cc:2272] T 43dd69a5570e4e6b9d98d8664a654e2d P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.583235  9147 tablet_replica.cc:333] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced: stopping tablet replica
I20260709 13:20:04.583711  9147 raft_consensus.cc:2243] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:04.584163  9147 raft_consensus.cc:2272] T e5a15d95cfc74abbafcb5d82a6ec64d7 P 1c398cc3e3244f21a5bcb100ad0bcced [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.623816  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:20:04.658016  9147 master.cc:562] Master@127.8.238.254:42815 shutting down...
I20260709 13:20:04.683597  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:04.684132  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:04.684422  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9d91e2b8c6d946328d3493ce7858bd4f: stopping tablet replica
I20260709 13:20:04.705426  9147 master.cc:584] Master@127.8.238.254:42815 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14815 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:20:04.759600  9147 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.238.254:43449
I20260709 13:20:04.760713  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:04.766542 19826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:04.767791 19827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:04.767998 19829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:04.768975  9147 server_base.cc:1061] running on GCE node
I20260709 13:20:04.769990  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:04.770180  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:04.770381  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603204770367 us; error 0 us; skew 500 ppm
I20260709 13:20:04.770850  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:04.773237  9147 webserver.cc:533] Webserver started at http://127.8.238.254:46213/ using document root <none> and password file <none>
I20260709 13:20:04.773700  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:04.773855  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:04.774085  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:04.775231  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/master-0-root/instance:
uuid: "c90c23eb32334af9a329145a54330944"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-ml7r"
I20260709 13:20:04.779770  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:04.783306 19834 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:04.784101  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:04.784366  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/master-0-root
uuid: "c90c23eb32334af9a329145a54330944"
format_stamp: "Formatted at 2026-07-09 13:20:04 on dist-test-slave-ml7r"
I20260709 13:20:04.784612  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:04.841948  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:04.843261  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:04.884155  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.254:43449
I20260709 13:20:04.884262 19885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.254:43449 every 8 connection(s)
I20260709 13:20:04.888432 19886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.900455 19886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944: Bootstrap starting.
I20260709 13:20:04.905504 19886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.910054 19886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944: No bootstrap required, opened a new log
I20260709 13:20:04.912366 19886 raft_consensus.cc:359] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90c23eb32334af9a329145a54330944" member_type: VOTER }
I20260709 13:20:04.912796 19886 raft_consensus.cc:385] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.912979 19886 raft_consensus.cc:740] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c90c23eb32334af9a329145a54330944, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.913460 19886 consensus_queue.cc:260] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90c23eb32334af9a329145a54330944" member_type: VOTER }
I20260709 13:20:04.913890 19886 raft_consensus.cc:399] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:04.914099 19886 raft_consensus.cc:493] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:04.914435 19886 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.919384 19886 raft_consensus.cc:515] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90c23eb32334af9a329145a54330944" member_type: VOTER }
I20260709 13:20:04.919893 19886 leader_election.cc:304] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c90c23eb32334af9a329145a54330944; no voters: 
I20260709 13:20:04.921043 19886 leader_election.cc:290] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:04.921483 19889 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:04.922974 19889 raft_consensus.cc:697] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 1 LEADER]: Becoming Leader. State: Replica: c90c23eb32334af9a329145a54330944, State: Running, Role: LEADER
I20260709 13:20:04.923738 19889 consensus_queue.cc:237] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90c23eb32334af9a329145a54330944" member_type: VOTER }
I20260709 13:20:04.924065 19886 sys_catalog.cc:565] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:04.929082 19891 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c90c23eb32334af9a329145a54330944. Latest consensus state: current_term: 1 leader_uuid: "c90c23eb32334af9a329145a54330944" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90c23eb32334af9a329145a54330944" member_type: VOTER } }
I20260709 13:20:04.929173 19890 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c90c23eb32334af9a329145a54330944" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90c23eb32334af9a329145a54330944" member_type: VOTER } }
I20260709 13:20:04.930219 19891 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:04.930260 19890 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:04.932323 19897 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:04.937479 19897 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:04.940498  9147 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:04.946710 19897 catalog_manager.cc:1383] Generated new cluster ID: 813feb3710334b829e925ab7aedcda5f
I20260709 13:20:04.947047 19897 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:04.988862 19897 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:04.990315 19897 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:05.004437 19897 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944: Generated new TSK 0
I20260709 13:20:05.005119 19897 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:05.072410  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:05.078446 19907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.079967 19908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.081712 19910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.086275  9147 server_base.cc:1061] running on GCE node
I20260709 13:20:05.089372  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:05.089622  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:05.089746  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603205089735 us; error 0 us; skew 500 ppm
I20260709 13:20:05.090337  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:05.092849  9147 webserver.cc:533] Webserver started at http://127.8.238.193:45301/ using document root <none> and password file <none>
I20260709 13:20:05.093289  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:05.093456  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:05.093672  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:05.094868  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-0-root/instance:
uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-ml7r"
I20260709 13:20:05.099502  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:05.102936 19915 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.103730  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:05.103989  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-0-root
uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-ml7r"
I20260709 13:20:05.104235  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:05.116909  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:05.118125  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:05.119629  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:05.122067  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:05.122342  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:05.122550  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:05.122692  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.164194  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.193:32857
I20260709 13:20:05.164304 19977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.193:32857 every 8 connection(s)
I20260709 13:20:05.169512  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:05.176577 19982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.177726 19983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.181391  9147 server_base.cc:1061] running on GCE node
W20260709 13:20:05.182315 19985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.183525  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:05.183818  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:05.183941 19978 heartbeater.cc:344] Connected to a master server at 127.8.238.254:43449
I20260709 13:20:05.184023  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603205184005 us; error 0 us; skew 500 ppm
I20260709 13:20:05.184511 19978 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:05.184923  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:05.185369 19978 heartbeater.cc:507] Master 127.8.238.254:43449 requested a full tablet report, sending...
I20260709 13:20:05.187888 19851 ts_manager.cc:194] Registered new tserver with Master: 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857)
I20260709 13:20:05.188187  9147 webserver.cc:533] Webserver started at http://127.8.238.194:43971/ using document root <none> and password file <none>
I20260709 13:20:05.188778  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:05.188992  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:05.189272  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:05.189918 19851 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40882
I20260709 13:20:05.190677  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-1-root/instance:
uuid: "9546bd6ddc2147858b89b365976682f6"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-ml7r"
I20260709 13:20:05.195299  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:20:05.198856 19990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.199808  9147 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:20:05.200096  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-1-root
uuid: "9546bd6ddc2147858b89b365976682f6"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-ml7r"
I20260709 13:20:05.200341  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:05.229803  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:05.231088  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:05.232577  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:05.235042  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:05.235285  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.235543  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:05.235707  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.276286  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.194:37451
I20260709 13:20:05.276397 20052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.194:37451 every 8 connection(s)
I20260709 13:20:05.281333  9147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:05.289214 20056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.289897 20057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:05.290997 20059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:05.291425  9147 server_base.cc:1061] running on GCE node
I20260709 13:20:05.292411  9147 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:05.292675  9147 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:05.292887  9147 hybrid_clock.cc:648] HybridClock initialized: now 1783603205292868 us; error 0 us; skew 500 ppm
I20260709 13:20:05.293586  9147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:05.294596 20053 heartbeater.cc:344] Connected to a master server at 127.8.238.254:43449
I20260709 13:20:05.294958 20053 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:05.295729 20053 heartbeater.cc:507] Master 127.8.238.254:43449 requested a full tablet report, sending...
I20260709 13:20:05.297983 19851 ts_manager.cc:194] Registered new tserver with Master: 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:05.298427  9147 webserver.cc:533] Webserver started at http://127.8.238.195:36857/ using document root <none> and password file <none>
I20260709 13:20:05.299032  9147 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:05.299232  9147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:05.299518  9147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:05.299664 19851 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40886
I20260709 13:20:05.300830  9147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-2-root/instance:
uuid: "18a2f1a5ce364081b1a85ae6ae575389"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-ml7r"
I20260709 13:20:05.305946  9147 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:05.309489 20064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.310380  9147 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:05.310695  9147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-2-root
uuid: "18a2f1a5ce364081b1a85ae6ae575389"
format_stamp: "Formatted at 2026-07-09 13:20:05 on dist-test-slave-ml7r"
I20260709 13:20:05.310951  9147 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknwYHCW/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602849780920-9147-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:05.323223  9147 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:05.324410  9147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:05.325937  9147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:05.328356  9147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:05.328552  9147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.328883  9147 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:05.329042  9147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:05.372287  9147 rpc_server.cc:307] RPC server started. Bound to: 127.8.238.195:35917
I20260709 13:20:05.372396 20126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.238.195:35917 every 8 connection(s)
I20260709 13:20:05.386776 20127 heartbeater.cc:344] Connected to a master server at 127.8.238.254:43449
I20260709 13:20:05.387265 20127 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:05.388019 20127 heartbeater.cc:507] Master 127.8.238.254:43449 requested a full tablet report, sending...
I20260709 13:20:05.390066 19851 ts_manager.cc:194] Registered new tserver with Master: 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:05.390352  9147 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01472129s
I20260709 13:20:05.391765 19851 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40894
I20260709 13:20:05.416571 19851 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40906:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:05.419322 19851 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:05.500747 20018 tablet_service.cc:1511] Processing CreateTablet for tablet 1c53b2b53b6144c99631755134ca70c5 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:05.502389 20018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c53b2b53b6144c99631755134ca70c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.502327 20015 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3f39f1916f434d849327102830b59b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:05.503938 20015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3f39f1916f434d849327102830b59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.504266 20017 tablet_service.cc:1511] Processing CreateTablet for tablet 4e01524b4a41406da7b9493bf1dd764b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:05.505818 20017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e01524b4a41406da7b9493bf1dd764b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.506758 19940 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3f39f1916f434d849327102830b59b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:05.508253 19940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3f39f1916f434d849327102830b59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.511396 19941 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0ab9f129414ccaa6dbfa03f88f5340 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:05.512924 19941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0ab9f129414ccaa6dbfa03f88f5340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.515457 19942 tablet_service.cc:1511] Processing CreateTablet for tablet 4e01524b4a41406da7b9493bf1dd764b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:05.517747 19943 tablet_service.cc:1511] Processing CreateTablet for tablet 1c53b2b53b6144c99631755134ca70c5 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:05.519959 20016 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0ab9f129414ccaa6dbfa03f88f5340 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:05.521415 20016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0ab9f129414ccaa6dbfa03f88f5340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.528693 19943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c53b2b53b6144c99631755134ca70c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.530557 19942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e01524b4a41406da7b9493bf1dd764b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.531596 20092 tablet_service.cc:1511] Processing CreateTablet for tablet 1c53b2b53b6144c99631755134ca70c5 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:05.533689 20092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c53b2b53b6144c99631755134ca70c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.536072 20091 tablet_service.cc:1511] Processing CreateTablet for tablet 4e01524b4a41406da7b9493bf1dd764b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:05.540043 20090 tablet_service.cc:1511] Processing CreateTablet for tablet 9f0ab9f129414ccaa6dbfa03f88f5340 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:05.542292 20091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e01524b4a41406da7b9493bf1dd764b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.544756 20090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f0ab9f129414ccaa6dbfa03f88f5340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.568357 20089 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3f39f1916f434d849327102830b59b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:05.569943 20089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3f39f1916f434d849327102830b59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.570029 19939 tablet_service.cc:1511] Processing CreateTablet for tablet aecfe968bb7741a8aa4e39cc49bf0e2e (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:05.571552 19939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecfe968bb7741a8aa4e39cc49bf0e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.577392 20017 tablet_service.cc:1511] Processing CreateTablet for tablet aecfe968bb7741a8aa4e39cc49bf0e2e (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:05.578931 20017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecfe968bb7741a8aa4e39cc49bf0e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.587462 20142 tablet_bootstrap.cc:492] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:05.596899 20088 tablet_service.cc:1511] Processing CreateTablet for tablet aecfe968bb7741a8aa4e39cc49bf0e2e (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:05.598485 20088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecfe968bb7741a8aa4e39cc49bf0e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.598474 19938 tablet_service.cc:1511] Processing CreateTablet for tablet 11fdfa289eda40e39e5605eef766852d (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:05.600080 19938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11fdfa289eda40e39e5605eef766852d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.622875 20143 tablet_bootstrap.cc:492] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:05.624788 20142 tablet_bootstrap.cc:654] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.627756 20144 tablet_bootstrap.cc:492] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:05.635552 20144 tablet_bootstrap.cc:654] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.636734 20143 tablet_bootstrap.cc:654] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.637337 20017 tablet_service.cc:1511] Processing CreateTablet for tablet 11fdfa289eda40e39e5605eef766852d (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:05.639034 20017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11fdfa289eda40e39e5605eef766852d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.645099 20142 tablet_bootstrap.cc:492] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:05.645951 20091 tablet_service.cc:1511] Processing CreateTablet for tablet 11fdfa289eda40e39e5605eef766852d (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:05.648062 20091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11fdfa289eda40e39e5605eef766852d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.651413 19939 tablet_service.cc:1511] Processing CreateTablet for tablet 632c499909bd48f2836598260d33004b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:05.653568 19939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c499909bd48f2836598260d33004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.646040 20142 ts_tablet_manager.cc:1403] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.000s
I20260709 13:20:05.659026 20142 raft_consensus.cc:359] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.660118 20142 raft_consensus.cc:385] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.660495 20142 raft_consensus.cc:740] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.673139 20018 tablet_service.cc:1511] Processing CreateTablet for tablet 632c499909bd48f2836598260d33004b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:05.674696 20018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c499909bd48f2836598260d33004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.674695 20092 tablet_service.cc:1511] Processing CreateTablet for tablet 632c499909bd48f2836598260d33004b (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:05.680486 20092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c499909bd48f2836598260d33004b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.682485 20143 tablet_bootstrap.cc:492] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:05.683648 20143 ts_tablet_manager.cc:1403] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.033s
I20260709 13:20:05.689028 19943 tablet_service.cc:1511] Processing CreateTablet for tablet a2f66de555f64570b49f91b446698cfb (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:05.690605 19943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f66de555f64570b49f91b446698cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.690896 20016 tablet_service.cc:1511] Processing CreateTablet for tablet a2f66de555f64570b49f91b446698cfb (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:05.692394 20016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f66de555f64570b49f91b446698cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.695600 20090 tablet_service.cc:1511] Processing CreateTablet for tablet a2f66de555f64570b49f91b446698cfb (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:05.697091 20090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f66de555f64570b49f91b446698cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.661484 20142 consensus_queue.cc:260] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.698639 20143 raft_consensus.cc:359] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.702190 20143 raft_consensus.cc:385] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.702662 20143 raft_consensus.cc:740] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.699214 19940 tablet_service.cc:1511] Processing CreateTablet for tablet 2c10ed239c5b4328a1a2576042da5cf7 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:05.703600 20143 consensus_queue.cc:260] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.704453 19940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c10ed239c5b4328a1a2576042da5cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.703603 20015 tablet_service.cc:1511] Processing CreateTablet for tablet 2c10ed239c5b4328a1a2576042da5cf7 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:05.707103 20015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c10ed239c5b4328a1a2576042da5cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.711344 20053 heartbeater.cc:499] Master 127.8.238.254:43449 was elected leader, sending a full tablet report...
I20260709 13:20:05.712421 20142 ts_tablet_manager.cc:1434] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:20:05.713609 20142 tablet_bootstrap.cc:492] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:05.723395 19978 heartbeater.cc:499] Master 127.8.238.254:43449 was elected leader, sending a full tablet report...
I20260709 13:20:05.725217 20143 ts_tablet_manager.cc:1434] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.007s
I20260709 13:20:05.727700 20142 tablet_bootstrap.cc:654] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.727880 20143 tablet_bootstrap.cc:492] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:05.738641 20143 tablet_bootstrap.cc:654] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.749331 20144 tablet_bootstrap.cc:492] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:05.749543 20142 tablet_bootstrap.cc:492] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:05.749886 20144 ts_tablet_manager.cc:1403] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.124s	user 0.032s	sys 0.024s
I20260709 13:20:05.750092 20142 ts_tablet_manager.cc:1403] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 13:20:05.753269 20144 raft_consensus.cc:359] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.755040 20148 raft_consensus.cc:493] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.755630 20148 raft_consensus.cc:515] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.758188 20092 tablet_service.cc:1511] Processing CreateTablet for tablet 2c10ed239c5b4328a1a2576042da5cf7 (DEFAULT_TABLE table=test-workload [id=0fde7675d1c445d9b7e5981ebfbadabc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:05.759703 20092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c10ed239c5b4328a1a2576042da5cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:05.767099 20148 leader_election.cc:290] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:05.767827 20143 tablet_bootstrap.cc:492] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:05.768558 20143 ts_tablet_manager.cc:1403] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.008s
I20260709 13:20:05.768469 20142 raft_consensus.cc:359] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.769431 20142 raft_consensus.cc:385] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.769778 20142 raft_consensus.cc:740] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.770602 20142 consensus_queue.cc:260] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.754063 20144 raft_consensus.cc:385] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.771701 20144 raft_consensus.cc:740] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.772496 20144 consensus_queue.cc:260] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.773000 20143 raft_consensus.cc:359] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.774308 20143 raft_consensus.cc:385] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.774662 20143 raft_consensus.cc:740] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.775715 20142 ts_tablet_manager.cc:1434] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:20:05.775529 20143 consensus_queue.cc:260] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.777601 20142 tablet_bootstrap.cc:492] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:05.778486 20143 ts_tablet_manager.cc:1434] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:05.783465 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:05.784983 20142 tablet_bootstrap.cc:654] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:05.785306 19994 leader_election.cc:343] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.788976 20143 tablet_bootstrap.cc:492] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
W20260709 13:20:05.792382 20054 tablet.cc:2406] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:05.796805 20144 ts_tablet_manager.cc:1434] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.006s
I20260709 13:20:05.798838 20143 tablet_bootstrap.cc:654] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.802446 20127 heartbeater.cc:499] Master 127.8.238.254:43449 was elected leader, sending a full tablet report...
I20260709 13:20:05.803838 20144 tablet_bootstrap.cc:492] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:05.811061 20144 tablet_bootstrap.cc:654] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.813022 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:05.813910 20102 raft_consensus.cc:2468] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:05.815582 19993 leader_election.cc:304] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:05.816720 20148 raft_consensus.cc:2804] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:05.817147 20148 raft_consensus.cc:493] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.817523 20148 raft_consensus.cc:3060] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.820686 20142 tablet_bootstrap.cc:492] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:05.821522 20142 ts_tablet_manager.cc:1403] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.008s
I20260709 13:20:05.826288 20148 raft_consensus.cc:515] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.826690 20142 raft_consensus.cc:359] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.826908 20144 tablet_bootstrap.cc:492] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:05.828106 20142 raft_consensus.cc:385] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.828837 20144 ts_tablet_manager.cc:1403] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.003s
I20260709 13:20:05.829516 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:05.832253 20144 raft_consensus.cc:359] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.833096 20144 raft_consensus.cc:385] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.833384 20144 raft_consensus.cc:740] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.828799 20142 raft_consensus.cc:740] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.835264 20142 consensus_queue.cc:260] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.836225 20149 raft_consensus.cc:493] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.828132 20143 tablet_bootstrap.cc:492] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:05.836791 20149 raft_consensus.cc:515] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.834151 20144 consensus_queue.cc:260] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
W20260709 13:20:05.839061 19994 leader_election.cc:343] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.839700 20144 ts_tablet_manager.cc:1434] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:05.841125 20144 tablet_bootstrap.cc:492] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:05.841289 20149 leader_election.cc:290] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:05.837256 20143 ts_tablet_manager.cc:1403] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.005s
I20260709 13:20:05.850564 20144 tablet_bootstrap.cc:654] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.852407 20148 leader_election.cc:290] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:05.854261 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:05.854911 20102 raft_consensus.cc:3060] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.850083 20143 raft_consensus.cc:359] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.859055 20143 raft_consensus.cc:385] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.859364 20143 raft_consensus.cc:740] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.862358 20143 consensus_queue.cc:260] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.863095 20142 ts_tablet_manager.cc:1434] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.021s
I20260709 13:20:05.864739 20142 tablet_bootstrap.cc:492] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:05.867833 20143 ts_tablet_manager.cc:1434] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:20:05.870991 20143 tablet_bootstrap.cc:492] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:05.872732 20142 tablet_bootstrap.cc:654] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.882925 20143 tablet_bootstrap.cc:654] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.887205 20102 raft_consensus.cc:2468] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:05.890463 19993 leader_election.cc:304] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:05.891734 20157 raft_consensus.cc:2804] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:05.892385 20157 raft_consensus.cc:697] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:05.893370 20157 consensus_queue.cc:237] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.919014 20144 tablet_bootstrap.cc:492] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:05.919682 20144 ts_tablet_manager.cc:1403] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.042s
I20260709 13:20:05.921839 20142 tablet_bootstrap.cc:492] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:05.922528 20142 ts_tablet_manager.cc:1403] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.037s
I20260709 13:20:05.923098 20144 raft_consensus.cc:359] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.923933 20144 raft_consensus.cc:385] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.924214 20144 raft_consensus.cc:740] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.925069 20144 consensus_queue.cc:260] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.925894 20142 raft_consensus.cc:359] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.926460 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:05.926771 20142 raft_consensus.cc:385] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.927101 20142 raft_consensus.cc:740] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.927165 20102 raft_consensus.cc:2468] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:05.927711 20144 ts_tablet_manager.cc:1434] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:05.928098 20142 consensus_queue.cc:260] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.929411 19918 leader_election.cc:304] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:05.930430 20149 raft_consensus.cc:2804] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:05.930809 20142 ts_tablet_manager.cc:1434] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:20:05.930801 20149 raft_consensus.cc:493] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.931838 20149 raft_consensus.cc:3060] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.931895 20142 tablet_bootstrap.cc:492] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:05.932616 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:05.933471 20143 tablet_bootstrap.cc:492] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:05.934195 20143 ts_tablet_manager.cc:1403] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.004s
I20260709 13:20:05.935029 20144 tablet_bootstrap.cc:492] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
W20260709 13:20:05.935357 19899 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:20:05.939566 19917 leader_election.cc:343] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.941037 20157 raft_consensus.cc:493] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.941138 20142 tablet_bootstrap.cc:654] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.941736 20157 raft_consensus.cc:515] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.942220 20144 tablet_bootstrap.cc:654] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:05.943297 20143 raft_consensus.cc:359] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.944094 20143 raft_consensus.cc:385] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:05.944393 20143 raft_consensus.cc:740] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.945199 20143 consensus_queue.cc:260] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.928730 19851 catalog_manager.cc:5697] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:05.946010 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:05.946125 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
W20260709 13:20:05.949842 19993 leader_election.cc:343] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.944099 20157 leader_election.cc:290] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
W20260709 13:20:05.953522 19994 leader_election.cc:343] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:05.954257 19994 leader_election.cc:304] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:05.956017 20157 raft_consensus.cc:2749] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:05.960440 20153 raft_consensus.cc:493] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.961288 20153 raft_consensus.cc:515] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.973291 20153 leader_election.cc:290] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:05.987186 20164 raft_consensus.cc:493] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.988673 20142 tablet_bootstrap.cc:492] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:05.989512 20142 ts_tablet_manager.cc:1403] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.013s
I20260709 13:20:05.989425 20164 raft_consensus.cc:515] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.988391 20149 raft_consensus.cc:515] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.996413 20143 ts_tablet_manager.cc:1434] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.009s
I20260709 13:20:05.996937 20142 raft_consensus.cc:359] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:05.997735 20143 tablet_bootstrap.cc:492] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:05.997850 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:05.998697 20028 raft_consensus.cc:2468] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:05.997781 20142 raft_consensus.cc:385] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.000432 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.001415 20144 tablet_bootstrap.cc:492] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:06.003021 20142 raft_consensus.cc:740] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.003502 20144 ts_tablet_manager.cc:1403] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.021s
I20260709 13:20:06.005618 19917 leader_election.cc:304] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.005463 20142 consensus_queue.cc:260] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.008000 20142 ts_tablet_manager.cc:1434] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:20:06.007880 20144 raft_consensus.cc:359] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.008455 20143 tablet_bootstrap.cc:654] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.008749 20144 raft_consensus.cc:385] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.010754 20144 raft_consensus.cc:740] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.011221 20027 raft_consensus.cc:3060] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.011791 20144 consensus_queue.cc:260] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.014518 20144 ts_tablet_manager.cc:1434] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:20:06.014950 20167 raft_consensus.cc:2804] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.019065 20144 tablet_bootstrap.cc:492] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:06.023540 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:06.024230 20167 raft_consensus.cc:493] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:06.025616 19918 leader_election.cc:343] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.025961 20167 raft_consensus.cc:3060] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.026515 20144 tablet_bootstrap.cc:654] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.033958 20142 tablet_bootstrap.cc:492] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:06.008924 20164 leader_election.cc:290] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.040573 20143 tablet_bootstrap.cc:492] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:06.041465 20143 ts_tablet_manager.cc:1403] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.017s
I20260709 13:20:06.044107 20149 leader_election.cc:290] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.045754 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.046716 20102 raft_consensus.cc:3060] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.048975 20027 raft_consensus.cc:2468] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:06.049372 20142 tablet_bootstrap.cc:654] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.058496 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.059563 19953 raft_consensus.cc:2468] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:06.061899 20068 leader_election.cc:304] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:06.063287 20153 raft_consensus.cc:2804] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.063810 20153 raft_consensus.cc:493] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.064283 20153 raft_consensus.cc:3060] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.064551 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.065626 20028 raft_consensus.cc:2468] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:06.073179 20167 raft_consensus.cc:515] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.076473 20102 raft_consensus.cc:2468] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:06.079955 19918 leader_election.cc:304] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:06.080926 20149 raft_consensus.cc:2804] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.081429 20149 raft_consensus.cc:697] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.081893 20144 tablet_bootstrap.cc:492] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:06.082779 20144 ts_tablet_manager.cc:1403] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.026s
I20260709 13:20:06.082320 20149 consensus_queue.cc:237] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.087250 20143 raft_consensus.cc:359] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.088299 20143 raft_consensus.cc:385] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.088590 20143 raft_consensus.cc:740] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.089354 20143 consensus_queue.cc:260] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.090389 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.090402 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.091123 20028 raft_consensus.cc:3060] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:06.093182 19918 leader_election.cc:343] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.095355 20144 raft_consensus.cc:359] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.096199 20144 raft_consensus.cc:385] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.096489 20144 raft_consensus.cc:740] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.098803 20143 ts_tablet_manager.cc:1434] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.002s
I20260709 13:20:06.100615 20144 consensus_queue.cc:260] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.102624 20143 tablet_bootstrap.cc:492] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:06.107208 20028 raft_consensus.cc:2468] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:06.079811 20153 raft_consensus.cc:515] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.111287 19917 leader_election.cc:304] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389
I20260709 13:20:06.109618 20167 leader_election.cc:290] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.112215 20164 raft_consensus.cc:2804] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.116561 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.117811 20153 leader_election.cc:290] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:06.118443 20028 raft_consensus.cc:3060] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.119196 20164 raft_consensus.cc:697] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.121095 20178 raft_consensus.cc:493] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.121349 20164 consensus_queue.cc:237] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.121670 20178 raft_consensus.cc:515] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.122486 20144 ts_tablet_manager.cc:1434] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.005s
I20260709 13:20:06.119268 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:06.123967 20144 tablet_bootstrap.cc:492] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:06.124207 19953 raft_consensus.cc:3060] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.125871 20142 tablet_bootstrap.cc:492] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:06.129122 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.129889 20027 raft_consensus.cc:2468] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:06.131351 20066 leader_election.cc:304] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.134653 20028 raft_consensus.cc:2468] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:06.135193 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.136128 20066 leader_election.cc:304] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.136637 20143 tablet_bootstrap.cc:654] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.137104 20142 ts_tablet_manager.cc:1403] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.122s	user 0.032s	sys 0.006s
I20260709 13:20:06.139375 19848 catalog_manager.cc:5697] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:06.136744 20068 leader_election.cc:343] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.127070 20178 leader_election.cc:290] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857)
I20260709 13:20:06.145012 20177 raft_consensus.cc:2804] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.145720 20177 raft_consensus.cc:493] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.146142 20177 raft_consensus.cc:3060] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.147459 19953 raft_consensus.cc:2468] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:06.150583 20178 raft_consensus.cc:2804] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.151379 20178 raft_consensus.cc:697] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:06.152571 20178 consensus_queue.cc:237] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.159767 20142 raft_consensus.cc:359] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.160645 20142 raft_consensus.cc:385] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.160945 20142 raft_consensus.cc:740] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.162204 20142 consensus_queue.cc:260] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.171422 20144 tablet_bootstrap.cc:654] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.176102 20164 raft_consensus.cc:493] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.176764 20143 tablet_bootstrap.cc:492] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:06.177412 20143 ts_tablet_manager.cc:1403] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.006s
I20260709 13:20:06.177139 20164 raft_consensus.cc:515] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.177659 19851 catalog_manager.cc:5697] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.180775 20143 raft_consensus.cc:359] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.181684 20143 raft_consensus.cc:385] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.181999 20143 raft_consensus.cc:740] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.183638 20143 consensus_queue.cc:260] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.185058 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.186743 20164 leader_election.cc:290] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.186949 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:06.187698 20102 raft_consensus.cc:2393] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34f61f67e27e41c9b92dd69ad761b4cb in current term 1: Already voted for candidate 9546bd6ddc2147858b89b365976682f6 in this term.
I20260709 13:20:06.188915 19918 leader_election.cc:304] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.191234 20144 tablet_bootstrap.cc:492] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:06.189543 19848 catalog_manager.cc:5697] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.191869 20144 ts_tablet_manager.cc:1403] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.008s
I20260709 13:20:06.192950 20164 raft_consensus.cc:3060] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.194993 20144 raft_consensus.cc:359] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.195855 20144 raft_consensus.cc:385] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.196156 20144 raft_consensus.cc:740] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.197847 20143 ts_tablet_manager.cc:1434] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.008s
I20260709 13:20:06.198920 20143 tablet_bootstrap.cc:492] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:06.199952 20167 raft_consensus.cc:493] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.200536 20167 raft_consensus.cc:515] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.202804 20167 leader_election.cc:290] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.203632 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.203524 20177 raft_consensus.cc:515] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.205026 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
W20260709 13:20:06.206444 19917 leader_election.cc:343] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.207388 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.208003 20028 raft_consensus.cc:3060] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.208595 20178 raft_consensus.cc:493] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.209204 20178 raft_consensus.cc:515] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.209954 20164 raft_consensus.cc:2749] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.210989 20142 ts_tablet_manager.cc:1434] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.072s	user 0.002s	sys 0.005s
I20260709 13:20:06.212131 20142 tablet_bootstrap.cc:492] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:06.212778 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.213788 20177 leader_election.cc:290] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857)
I20260709 13:20:06.216071 20028 raft_consensus.cc:2468] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:06.216312 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:06.216972 19953 raft_consensus.cc:3060] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.217401 20066 leader_election.cc:304] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.218444 20177 raft_consensus.cc:2804] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.202050 20144 consensus_queue.cc:260] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.219576 20102 raft_consensus.cc:2468] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:06.219749 20177 raft_consensus.cc:697] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:06.221228 20142 tablet_bootstrap.cc:654] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.220994 20177 consensus_queue.cc:237] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.221642 19918 leader_election.cc:304] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.222658 20164 raft_consensus.cc:2804] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.223034 20164 raft_consensus.cc:493] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.223387 20164 raft_consensus.cc:3060] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.224721 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.224962 19953 raft_consensus.cc:2468] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:06.228574 20143 tablet_bootstrap.cc:654] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.230645 20028 raft_consensus.cc:2393] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18a2f1a5ce364081b1a85ae6ae575389 in current term 1: Already voted for candidate 34f61f67e27e41c9b92dd69ad761b4cb in this term.
I20260709 13:20:06.231564 20178 leader_election.cc:290] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:06.232177 20066 leader_election.cc:304] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389; no voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.233588 20178 raft_consensus.cc:3060] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.234102 20144 ts_tablet_manager.cc:1434] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:20:06.235338 20144 tablet_bootstrap.cc:492] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:06.236910 20164 raft_consensus.cc:515] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.240182 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
W20260709 13:20:06.241655 19917 leader_election.cc:343] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:06.243359 20164 leader_election.cc:290] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.244035 20144 tablet_bootstrap.cc:654] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.244709 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.248937 20102 raft_consensus.cc:3060] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.250406 20178 raft_consensus.cc:2749] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.251088 20142 tablet_bootstrap.cc:492] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:06.251710 20142 ts_tablet_manager.cc:1403] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.007s
I20260709 13:20:06.254659 20143 tablet_bootstrap.cc:492] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:06.255290 20143 ts_tablet_manager.cc:1403] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.005s
I20260709 13:20:06.254995 20142 raft_consensus.cc:359] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.255957 20142 raft_consensus.cc:385] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.256330 20142 raft_consensus.cc:740] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.257179 20142 consensus_queue.cc:260] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.244287 19851 catalog_manager.cc:5697] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.258446 20143 raft_consensus.cc:359] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.259245 20143 raft_consensus.cc:385] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.259523 20143 raft_consensus.cc:740] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.259755 20142 ts_tablet_manager.cc:1434] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:20:06.260907 20142 tablet_bootstrap.cc:492] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:06.263509 20102 raft_consensus.cc:2468] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:06.263886 20143 consensus_queue.cc:260] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.266872 20143 ts_tablet_manager.cc:1434] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:06.267966 20143 tablet_bootstrap.cc:492] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:06.267716 19918 leader_election.cc:304] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.269541 20164 raft_consensus.cc:2804] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.270074 20164 raft_consensus.cc:697] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.270998 20164 consensus_queue.cc:237] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.269201 20142 tablet_bootstrap.cc:654] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.275952 20143 tablet_bootstrap.cc:654] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.281253 20144 tablet_bootstrap.cc:492] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:06.282011 20144 ts_tablet_manager.cc:1403] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.003s
I20260709 13:20:06.286329 20144 raft_consensus.cc:359] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.287424 20144 raft_consensus.cc:385] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.287827 20144 raft_consensus.cc:740] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.288612 20142 tablet_bootstrap.cc:492] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:06.289227 20142 ts_tablet_manager.cc:1403] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 13:20:06.288899 20144 consensus_queue.cc:260] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.293035 20144 ts_tablet_manager.cc:1434] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:20:06.297755 20144 tablet_bootstrap.cc:492] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:06.301427 20142 raft_consensus.cc:359] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.302902 20142 raft_consensus.cc:385] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.303191 20142 raft_consensus.cc:740] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.303977 20143 tablet_bootstrap.cc:492] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:06.303880 20142 consensus_queue.cc:260] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.304543 20143 ts_tablet_manager.cc:1403] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.019s
I20260709 13:20:06.306607 20142 ts_tablet_manager.cc:1434] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:20:06.307713 20142 tablet_bootstrap.cc:492] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:06.307538 20143 raft_consensus.cc:359] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.307389 19851 catalog_manager.cc:5697] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.314827 20142 tablet_bootstrap.cc:654] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.308347 20143 raft_consensus.cc:385] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.315438 20143 raft_consensus.cc:740] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.316242 20143 consensus_queue.cc:260] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.316929 20157 consensus_queue.cc:1048] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.318481 20143 ts_tablet_manager.cc:1434] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:20:06.319635 20143 tablet_bootstrap.cc:492] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:06.327639 20142 tablet_bootstrap.cc:492] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:06.328425 20142 ts_tablet_manager.cc:1403] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:20:06.331863 20142 raft_consensus.cc:359] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.332597 20142 raft_consensus.cc:385] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.332903 20142 raft_consensus.cc:740] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.333771 20142 consensus_queue.cc:260] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.334502 20143 tablet_bootstrap.cc:654] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.335160 20144 tablet_bootstrap.cc:654] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.335983 20142 ts_tablet_manager.cc:1434] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:20:06.345912 20157 consensus_queue.cc:1048] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.385456 20143 tablet_bootstrap.cc:492] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:06.385980 20143 ts_tablet_manager.cc:1403] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.020s
I20260709 13:20:06.388554 20144 tablet_bootstrap.cc:492] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:06.389160 20144 ts_tablet_manager.cc:1403] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.032s
I20260709 13:20:06.388756 20143 raft_consensus.cc:359] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.389562 20143 raft_consensus.cc:385] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.389892 20143 raft_consensus.cc:740] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.390759 20143 consensus_queue.cc:260] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.391937 20144 raft_consensus.cc:359] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.392693 20144 raft_consensus.cc:385] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.393152 20144 raft_consensus.cc:740] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.394006 20144 consensus_queue.cc:260] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.396179 20144 ts_tablet_manager.cc:1434] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:06.397804 20143 ts_tablet_manager.cc:1434] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:20:06.399277 20148 raft_consensus.cc:493] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.399837 20148 raft_consensus.cc:515] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.402165 20148 leader_election.cc:290] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.403849 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.404508 20144 tablet_bootstrap.cc:492] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:06.404742 19952 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:06.407220 20178 raft_consensus.cc:493] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.407884 20178 raft_consensus.cc:515] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.409384 19994 leader_election.cc:304] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.410598 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:06.411756 20164 raft_consensus.cc:493] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.412324 20164 raft_consensus.cc:515] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.412626 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.413286 19952 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:06.411661 20101 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:06.414122 20148 raft_consensus.cc:2804] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.413955 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.414594 20148 raft_consensus.cc:493] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.415035 20148 raft_consensus.cc:3060] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.411088 20144 tablet_bootstrap.cc:654] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.416416 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c499909bd48f2836598260d33004b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:06.417133 20027 raft_consensus.cc:2468] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:06.419409 20178 leader_election.cc:290] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:06.422358 19917 leader_election.cc:304] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.423378 20167 raft_consensus.cc:2804] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.423779 20167 raft_consensus.cc:493] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.424088 20167 raft_consensus.cc:3060] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.427306 20148 raft_consensus.cc:515] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.428030 20068 leader_election.cc:304] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:06.428938 20028 raft_consensus.cc:2393] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18a2f1a5ce364081b1a85ae6ae575389 in current term 1: Already voted for candidate 9546bd6ddc2147858b89b365976682f6 in this term.
I20260709 13:20:06.430972 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.431684 20101 raft_consensus.cc:3060] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.433252 20164 leader_election.cc:290] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.435292 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c499909bd48f2836598260d33004b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:06.436127 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:06.436228 20102 raft_consensus.cc:2468] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:06.436838 19952 raft_consensus.cc:3060] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.434494 20148 leader_election.cc:290] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.439836 20101 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:06.440514 20178 raft_consensus.cc:2764] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:20:06.441231 19993 leader_election.cc:304] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.443954 20148 raft_consensus.cc:2804] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.444484 20148 raft_consensus.cc:697] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:06.445322 20148 consensus_queue.cc:237] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.451901 20167 raft_consensus.cc:515] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.456175 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c499909bd48f2836598260d33004b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.456768 20028 raft_consensus.cc:3060] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.457558 19847 catalog_manager.cc:5697] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.459239 19952 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:06.462931 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c499909bd48f2836598260d33004b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.463599 20101 raft_consensus.cc:3060] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.464088 20028 raft_consensus.cc:2468] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:06.465461 19917 leader_election.cc:304] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.466370 20164 raft_consensus.cc:2804] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.466876 20164 raft_consensus.cc:697] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.467825 20144 tablet_bootstrap.cc:492] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:06.467697 20164 consensus_queue.cc:237] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.468391 20144 ts_tablet_manager.cc:1403] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.028s
I20260709 13:20:06.471472 20144 raft_consensus.cc:359] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.472266 20144 raft_consensus.cc:385] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.472558 20144 raft_consensus.cc:740] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.473308 20144 consensus_queue.cc:260] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.475399 20144 ts_tablet_manager.cc:1434] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:06.475781 20101 raft_consensus.cc:2468] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:06.476677 20167 leader_election.cc:290] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.479542 19847 catalog_manager.cc:5697] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.530776 20148 raft_consensus.cc:493] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.531418 20148 raft_consensus.cc:515] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.533236 20148 leader_election.cc:290] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.534117 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.534373 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:06.534919 19952 raft_consensus.cc:2468] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:06.535041 20101 raft_consensus.cc:2468] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:06.536150 19994 leader_election.cc:304] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.536836 20148 raft_consensus.cc:2804] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:06.537168 20148 raft_consensus.cc:493] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.537469 20148 raft_consensus.cc:3060] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.542889 20148 raft_consensus.cc:515] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.544813 20148 leader_election.cc:290] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.545562 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:06.546015 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.546276 19952 raft_consensus.cc:3060] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.546793 20101 raft_consensus.cc:3060] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.547061 20167 consensus_queue.cc:1048] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.553788 19952 raft_consensus.cc:2468] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:06.555323 19994 leader_election.cc:304] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.556587 20148 raft_consensus.cc:2804] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.557111 20148 raft_consensus.cc:697] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:06.557571 20101 raft_consensus.cc:2468] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:06.559553 20157 raft_consensus.cc:493] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.560120 20157 raft_consensus.cc:515] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.561542 20167 consensus_queue.cc:1048] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.562255 20157 leader_election.cc:290] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.558014 20148 consensus_queue.cc:237] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.565454 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:06.566414 20100 raft_consensus.cc:2393] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9546bd6ddc2147858b89b365976682f6 in current term 1: Already voted for candidate 34f61f67e27e41c9b92dd69ad761b4cb in this term.
I20260709 13:20:06.568548 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:06.570597 19994 leader_election.cc:304] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:06.574348 20203 raft_consensus.cc:3060] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.578467 20149 consensus_queue.cc:1048] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.585043 20203 raft_consensus.cc:2749] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:06.586221 19847 catalog_manager.cc:5697] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.596302 20167 consensus_queue.cc:1048] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.652051 20102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
mode: GRACEFUL
new_leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:41556
I20260709 13:20:06.652642 20102 raft_consensus.cc:606] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Received request to transfer leadership to TS 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:06.661252 20102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
mode: GRACEFUL
new_leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:41556
I20260709 13:20:06.661904 20102 raft_consensus.cc:606] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Received request to transfer leadership to TS 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:06.664191 20178 consensus_queue.cc:1048] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.668417 20177 consensus_queue.cc:1048] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.675325 20178 raft_consensus.cc:993] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: : Instructing follower 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:06.675928 20178 raft_consensus.cc:1081] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Signalling peer 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:06.682292 19951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:45404
I20260709 13:20:06.683035 19951 raft_consensus.cc:493] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.683140 20027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d3f39f1916f434d849327102830b59b"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
mode: GRACEFUL
new_leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:41608
I20260709 13:20:06.683485 19951 raft_consensus.cc:3060] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.683907 20027 raft_consensus.cc:606] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Received request to transfer leadership to TS 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:06.687358 20177 consensus_queue.cc:1048] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.691865 20213 consensus_queue.cc:1048] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.697463 19951 raft_consensus.cc:515] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.703409 19951 leader_election.cc:290] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.703787 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.705797 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f0ab9f129414ccaa6dbfa03f88f5340" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.706650 20102 raft_consensus.cc:3055] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:06.707083 20102 raft_consensus.cc:740] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:06.707825 20153 raft_consensus.cc:993] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: : Instructing follower 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:06.708406 20153 raft_consensus.cc:1081] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Signalling peer 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:06.708077 20102 consensus_queue.cc:260] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.709535 20102 raft_consensus.cc:3060] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.711772 19952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:45404
I20260709 13:20:06.712646 19952 raft_consensus.cc:493] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.713222 19952 raft_consensus.cc:3060] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.720237 20102 raft_consensus.cc:2468] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:06.721714 19918 leader_election.cc:304] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.723222 20167 raft_consensus.cc:2804] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:06.723739 20167 raft_consensus.cc:697] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.724502 20167 consensus_queue.cc:237] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.725152 19952 raft_consensus.cc:515] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.735090 19950 raft_consensus.cc:1240] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Rejecting Update request from peer 18a2f1a5ce364081b1a85ae6ae575389 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:06.736243 19952 leader_election.cc:290] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.737257 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.740463 20213 consensus_queue.cc:1059] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.741292 20178 raft_consensus.cc:3055] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:06.741632 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c53b2b53b6144c99631755134ca70c5" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.741689 20178 raft_consensus.cc:740] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:06.741889 19851 catalog_manager.cc:5697] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 1 to 2, leader changed from 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195) to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 2 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.742985 20178 consensus_queue.cc:260] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.744172 20178 raft_consensus.cc:3060] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.744068 19950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
mode: GRACEFUL
new_leader_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:20:06.744948 19950 raft_consensus.cc:606] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Received request to transfer leadership to TS 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.753198 19950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
mode: GRACEFUL
new_leader_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:20:06.753908 19950 raft_consensus.cc:606] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Received request to transfer leadership to TS 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.760301 19950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "632c499909bd48f2836598260d33004b"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
mode: GRACEFUL
new_leader_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:20:06.760849 19950 raft_consensus.cc:606] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Received request to transfer leadership to TS 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.761204 20102 raft_consensus.cc:2468] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:06.762859 19918 leader_election.cc:304] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:06.763624 20167 raft_consensus.cc:2804] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:06.764037 20167 raft_consensus.cc:697] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.764842 20167 consensus_queue.cc:237] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.769733 20028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
mode: GRACEFUL
new_leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
 from {username='slave'} at 127.0.0.1:41608
I20260709 13:20:06.770485 20028 raft_consensus.cc:606] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Received request to transfer leadership to TS 18a2f1a5ce364081b1a85ae6ae575389
I20260709 13:20:06.771781 19851 catalog_manager.cc:5697] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 1 to 2, leader changed from 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195) to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 2 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.858395 20148 raft_consensus.cc:993] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: : Instructing follower 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:06.858852 20203 raft_consensus.cc:1081] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Signalling peer 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:06.860450 19950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d3f39f1916f434d849327102830b59b"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:45400
I20260709 13:20:06.860980 19950 raft_consensus.cc:493] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.861299 19950 raft_consensus.cc:3060] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.866556 19950 raft_consensus.cc:515] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.869297 19950 leader_election.cc:290] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.869482 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:06.870275 20027 raft_consensus.cc:3055] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:06.870653 20027 raft_consensus.cc:740] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:06.870460 20164 consensus_queue.cc:1048] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.871371 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3f39f1916f434d849327102830b59b" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.871507 20167 consensus_queue.cc:1048] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.872082 20102 raft_consensus.cc:3060] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.871677 20027 consensus_queue.cc:260] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.873133 20027 raft_consensus.cc:3060] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.880599 20102 raft_consensus.cc:2468] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:06.880601 20027 raft_consensus.cc:2468] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:06.883549 19918 leader_election.cc:304] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:06.887794 20164 raft_consensus.cc:2804] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:06.899451 20164 raft_consensus.cc:697] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.900261 20149 raft_consensus.cc:993] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: : Instructing follower 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:06.901017 20149 raft_consensus.cc:1081] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Signalling peer 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:06.902071 20164 consensus_queue.cc:237] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.905849 20027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41590
I20260709 13:20:06.906579 20027 raft_consensus.cc:493] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.907027 20027 raft_consensus.cc:3060] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.908910 20219 consensus_queue.cc:1048] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.915428 20027 raft_consensus.cc:515] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.916777 20028 raft_consensus.cc:1240] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Rejecting Update request from peer 34f61f67e27e41c9b92dd69ad761b4cb for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:06.916358 19851 catalog_manager.cc:5697] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 1 to 2, leader changed from 9546bd6ddc2147858b89b365976682f6 (127.8.238.194) to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 2 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.918905 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.919615 20101 raft_consensus.cc:3060] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.919626 20027 leader_election.cc:290] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.919795 20219 consensus_queue.cc:1059] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.918977 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11fdfa289eda40e39e5605eef766852d" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:06.920821 19950 raft_consensus.cc:3055] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:06.921149 19950 raft_consensus.cc:740] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.921978 19950 consensus_queue.cc:260] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.923199 19950 raft_consensus.cc:3060] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.924587 20167 raft_consensus.cc:993] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: : Instructing follower 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:06.925113 20149 raft_consensus.cc:1081] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Signalling peer 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:06.929759 20027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "632c499909bd48f2836598260d33004b"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41590
I20260709 13:20:06.930063 20219 consensus_queue.cc:1048] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:06.933764 20027 raft_consensus.cc:493] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.934782 20027 raft_consensus.cc:3060] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.939733 19950 raft_consensus.cc:2468] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:06.941366 19994 leader_election.cc:304] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:06.941850 20101 raft_consensus.cc:2468] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
W20260709 13:20:06.942502 20220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:20:06.942379 20027 raft_consensus.cc:515] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.942572 20203 raft_consensus.cc:2804] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:06.944191 20203 raft_consensus.cc:697] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:06.945124 20203 consensus_queue.cc:237] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.948698 20027 leader_election.cc:290] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:06.951073 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c499909bd48f2836598260d33004b" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:06.953451 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c499909bd48f2836598260d33004b" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:06.954752 19950 raft_consensus.cc:3055] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:06.955120 19950 raft_consensus.cc:740] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:06.956075 19950 consensus_queue.cc:260] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.957163 19950 raft_consensus.cc:3060] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.957230 19847 catalog_manager.cc:5697] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 1 to 2, leader changed from 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193) to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.965499 19950 raft_consensus.cc:2468] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:06.966899 19994 leader_election.cc:304] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389
I20260709 13:20:06.968140 20203 raft_consensus.cc:2804] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:06.968626 20203 raft_consensus.cc:697] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:06.969434 20203 consensus_queue.cc:237] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:06.978621 20203 consensus_queue.cc:1048] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:06.980321 19851 catalog_manager.cc:5697] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 1 to 2, leader changed from 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193) to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.990018 20157 consensus_queue.cc:1048] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:07.125672 20027 raft_consensus.cc:3060] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.131788 20027 raft_consensus.cc:1275] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.133203 20219 consensus_queue.cc:1048] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.141229 20102 raft_consensus.cc:1275] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.143131 20164 consensus_queue.cc:1048] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.154145 20027 raft_consensus.cc:3060] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.160218 20027 raft_consensus.cc:1275] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.161443 20164 consensus_queue.cc:1048] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:07.169740 20102 raft_consensus.cc:1275] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.171772 20219 consensus_queue.cc:1048] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:07.175762 20157 consensus_queue.cc:1048] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:07.185024 20203 raft_consensus.cc:993] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: : Instructing follower 18a2f1a5ce364081b1a85ae6ae575389 to start an election
I20260709 13:20:07.185566 20203 raft_consensus.cc:1081] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Signalling peer 18a2f1a5ce364081b1a85ae6ae575389 to start an election
I20260709 13:20:07.187651 20102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
 from {username='slave'} at 127.0.0.1:41534
I20260709 13:20:07.189110 20102 raft_consensus.cc:493] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:07.189551 20102 raft_consensus.cc:3060] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.191848 20203 consensus_queue.cc:1048] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:07.198769 20219 raft_consensus.cc:993] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: : Instructing follower 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:07.199275 20219 raft_consensus.cc:1081] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Signalling peer 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:07.201488 20027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41590
I20260709 13:20:07.202240 20027 raft_consensus.cc:493] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:07.202672 20027 raft_consensus.cc:3060] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.205655 20102 raft_consensus.cc:515] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:07.208979 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:07.209679 19950 raft_consensus.cc:3060] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.209878 20027 raft_consensus.cc:515] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:07.211194 20102 leader_election.cc:290] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:07.212383 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10ed239c5b4328a1a2576042da5cf7" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:07.213119 20026 raft_consensus.cc:3055] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:07.213459 20026 raft_consensus.cc:740] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:07.214395 20026 consensus_queue.cc:260] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:07.215842 20026 raft_consensus.cc:3060] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.216995 20027 leader_election.cc:290] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:07.219098 19950 raft_consensus.cc:2468] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 2.
I20260709 13:20:07.219432 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:07.220868 20068 leader_election.cc:304] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:07.220160 20102 raft_consensus.cc:3060] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.222882 20213 raft_consensus.cc:2804] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:07.223451 20213 raft_consensus.cc:697] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:07.224206 20213 consensus_queue.cc:237] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:07.226212 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecfe968bb7741a8aa4e39cc49bf0e2e" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:07.226965 19950 raft_consensus.cc:3055] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:07.227279 19950 raft_consensus.cc:740] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:07.228107 19950 consensus_queue.cc:260] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:07.229427 19950 raft_consensus.cc:3060] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.230211 20102 raft_consensus.cc:2468] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:07.231719 19993 leader_election.cc:304] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:07.232669 20203 raft_consensus.cc:2804] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:07.233191 20203 raft_consensus.cc:697] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:07.234045 20203 consensus_queue.cc:237] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:07.234382 20026 raft_consensus.cc:2468] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 2.
I20260709 13:20:07.237466 19950 raft_consensus.cc:2468] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:07.240095 19850 catalog_manager.cc:5697] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 1 to 2, leader changed from 9546bd6ddc2147858b89b365976682f6 (127.8.238.194) to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:07.241799 19847 catalog_manager.cc:5697] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 1 to 2, leader changed from 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193) to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:07.314476 20026 raft_consensus.cc:1275] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.315905 20164 consensus_queue.cc:1048] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.323632 20102 raft_consensus.cc:1275] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.325600 20149 consensus_queue.cc:1048] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.329193 19950 raft_consensus.cc:1275] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.331291 20157 consensus_queue.cc:1048] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.341571 20101 raft_consensus.cc:1275] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.343164 20148 consensus_queue.cc:1048] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.498761 19950 raft_consensus.cc:1275] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.500190 20148 consensus_queue.cc:1048] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.507747 20101 raft_consensus.cc:3060] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.516206 20101 raft_consensus.cc:1275] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.517426 20203 consensus_queue.cc:1048] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.631971 19950 raft_consensus.cc:1275] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.633315 20203 consensus_queue.cc:1048] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.642165 20101 raft_consensus.cc:1275] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.644625 20157 consensus_queue.cc:1048] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.710194 20026 raft_consensus.cc:1275] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 18a2f1a5ce364081b1a85ae6ae575389: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.711747 20178 consensus_queue.cc:1048] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:07.720330 19950 raft_consensus.cc:1275] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 18a2f1a5ce364081b1a85ae6ae575389: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:07.721900 20178 consensus_queue.cc:1048] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.803663 19847 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40920:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:09.806013 19847 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:09.857599 19940 tablet_service.cc:1511] Processing CreateTablet for tablet c442c315bb374c638ff04245855dccac (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:09.858547 20015 tablet_service.cc:1511] Processing CreateTablet for tablet c442c315bb374c638ff04245855dccac (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:09.859004 19940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c442c315bb374c638ff04245855dccac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.859916 20015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c442c315bb374c638ff04245855dccac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.861749 19943 tablet_service.cc:1511] Processing CreateTablet for tablet 35e802e4fc9548e6b88371336ef54b29 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:09.863196 19943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e802e4fc9548e6b88371336ef54b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.863219 20016 tablet_service.cc:1511] Processing CreateTablet for tablet 35e802e4fc9548e6b88371336ef54b29 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:09.864682 20016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e802e4fc9548e6b88371336ef54b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.865414 20090 tablet_service.cc:1511] Processing CreateTablet for tablet 35e802e4fc9548e6b88371336ef54b29 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:09.866896 20090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e802e4fc9548e6b88371336ef54b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.867997 19939 tablet_service.cc:1511] Processing CreateTablet for tablet 6611f3bd58184dd083431a9c33fc82af (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:09.869376 19939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6611f3bd58184dd083431a9c33fc82af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.870430 20017 tablet_service.cc:1511] Processing CreateTablet for tablet 6611f3bd58184dd083431a9c33fc82af (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:09.871835 20017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6611f3bd58184dd083431a9c33fc82af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.862277 20092 tablet_service.cc:1511] Processing CreateTablet for tablet c442c315bb374c638ff04245855dccac (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:09.873211 19938 tablet_service.cc:1511] Processing CreateTablet for tablet 04a6fce64a2b4ce6a4fd04dd26c3b1e5 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:09.874590 19938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a6fce64a2b4ce6a4fd04dd26c3b1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.874958 20091 tablet_service.cc:1511] Processing CreateTablet for tablet 6611f3bd58184dd083431a9c33fc82af (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:09.873728 20092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c442c315bb374c638ff04245855dccac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.882611 20091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6611f3bd58184dd083431a9c33fc82af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.895258 20089 tablet_service.cc:1511] Processing CreateTablet for tablet 04a6fce64a2b4ce6a4fd04dd26c3b1e5 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:09.896785 20089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a6fce64a2b4ce6a4fd04dd26c3b1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.898371 19941 tablet_service.cc:1511] Processing CreateTablet for tablet 5178ad636bbd433c9583b0d40f23cace (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:09.899794 19941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5178ad636bbd433c9583b0d40f23cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.904018 20018 tablet_service.cc:1511] Processing CreateTablet for tablet 04a6fce64a2b4ce6a4fd04dd26c3b1e5 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:09.905442 20018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a6fce64a2b4ce6a4fd04dd26c3b1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.907011 19942 tablet_service.cc:1511] Processing CreateTablet for tablet dc47f944485f42d4ac7c6a25dbadba34 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:09.907275 20014 tablet_service.cc:1511] Processing CreateTablet for tablet 5178ad636bbd433c9583b0d40f23cace (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:09.908442 19942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc47f944485f42d4ac7c6a25dbadba34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.908663 20014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5178ad636bbd433c9583b0d40f23cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.904109 20088 tablet_service.cc:1511] Processing CreateTablet for tablet 5178ad636bbd433c9583b0d40f23cace (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:09.911263 20087 tablet_service.cc:1511] Processing CreateTablet for tablet dc47f944485f42d4ac7c6a25dbadba34 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:09.911769 20088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5178ad636bbd433c9583b0d40f23cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.912693 20087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc47f944485f42d4ac7c6a25dbadba34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.914789 20013 tablet_service.cc:1511] Processing CreateTablet for tablet dc47f944485f42d4ac7c6a25dbadba34 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:09.916255 20013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc47f944485f42d4ac7c6a25dbadba34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.925601 19937 tablet_service.cc:1511] Processing CreateTablet for tablet cd5bbcac6ac44d35bb02ed3138d5e48a (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:09.931247 19937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5bbcac6ac44d35bb02ed3138d5e48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.934722 20012 tablet_service.cc:1511] Processing CreateTablet for tablet cd5bbcac6ac44d35bb02ed3138d5e48a (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:09.936262 20012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5bbcac6ac44d35bb02ed3138d5e48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.936312 20086 tablet_service.cc:1511] Processing CreateTablet for tablet cd5bbcac6ac44d35bb02ed3138d5e48a (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:09.937881 20086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5bbcac6ac44d35bb02ed3138d5e48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.938318 20244 tablet_bootstrap.cc:492] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:09.948299 20245 tablet_bootstrap.cc:492] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:09.957912 20244 tablet_bootstrap.cc:654] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:09.960568 20245 tablet_bootstrap.cc:654] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:09.966454 19943 tablet_service.cc:1511] Processing CreateTablet for tablet 76a975a873104f3e889b02fcf9f62304 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:09.967562 20011 tablet_service.cc:1511] Processing CreateTablet for tablet 76a975a873104f3e889b02fcf9f62304 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:09.968071 19943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a975a873104f3e889b02fcf9f62304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.969030 20011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a975a873104f3e889b02fcf9f62304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.980039 20091 tablet_service.cc:1511] Processing CreateTablet for tablet 76a975a873104f3e889b02fcf9f62304 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:09.981587 20091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a975a873104f3e889b02fcf9f62304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.989526 19942 tablet_service.cc:1511] Processing CreateTablet for tablet e36d7656a11d438688c9778225551327 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:09.991080 19942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36d7656a11d438688c9778225551327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.991730 20010 tablet_service.cc:1511] Processing CreateTablet for tablet e36d7656a11d438688c9778225551327 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:09.993217 20010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36d7656a11d438688c9778225551327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:09.998679 20090 tablet_service.cc:1511] Processing CreateTablet for tablet e36d7656a11d438688c9778225551327 (DEFAULT_TABLE table=soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:10.000212 20090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36d7656a11d438688c9778225551327. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:10.005201 19899 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:09.998677 20244 tablet_bootstrap.cc:492] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.006371 20244 ts_tablet_manager.cc:1403] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.000s
I20260709 13:20:10.013566 20244 raft_consensus.cc:359] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.018397 20244 raft_consensus.cc:385] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.018999 20244 raft_consensus.cc:740] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.023633 20244 consensus_queue.cc:260] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.033023 20244 ts_tablet_manager.cc:1434] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:20:10.047377 20248 tablet_bootstrap.cc:492] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.056318 20244 tablet_bootstrap.cc:492] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.098973 20248 tablet_bootstrap.cc:654] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.111611 20245 tablet_bootstrap.cc:492] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.112450 20245 ts_tablet_manager.cc:1403] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.164s	user 0.027s	sys 0.057s
I20260709 13:20:10.116372 20244 tablet_bootstrap.cc:654] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.116628 20245 raft_consensus.cc:359] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.117517 20245 raft_consensus.cc:385] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.117888 20245 raft_consensus.cc:740] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.118862 20245 consensus_queue.cc:260] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.122031 20245 ts_tablet_manager.cc:1434] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:20:10.123267 20245 tablet_bootstrap.cc:492] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.132920 20245 tablet_bootstrap.cc:654] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.134974 20248 tablet_bootstrap.cc:492] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.138736 20248 ts_tablet_manager.cc:1403] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.005s
I20260709 13:20:10.142020 20248 raft_consensus.cc:359] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.142475 20244 tablet_bootstrap.cc:492] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.142726 20245 tablet_bootstrap.cc:492] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.142860 20248 raft_consensus.cc:385] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.143291 20244 ts_tablet_manager.cc:1403] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.005s
I20260709 13:20:10.143404 20245 ts_tablet_manager.cc:1403] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:20:10.143327 20248 raft_consensus.cc:740] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.144534 20248 consensus_queue.cc:260] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.146050 20244 raft_consensus.cc:359] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.146929 20244 raft_consensus.cc:385] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.147192 20248 ts_tablet_manager.cc:1434] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:20:10.147325 20244 raft_consensus.cc:740] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.148372 20248 tablet_bootstrap.cc:492] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.148370 20244 consensus_queue.cc:260] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.150126 20245 raft_consensus.cc:359] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.151059 20245 raft_consensus.cc:385] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.151415 20245 raft_consensus.cc:740] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.152397 20245 consensus_queue.cc:260] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.154620 20244 ts_tablet_manager.cc:1434] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:20:10.155067 20245 ts_tablet_manager.cc:1434] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:10.155925 20244 tablet_bootstrap.cc:492] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.156164 20245 tablet_bootstrap.cc:492] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.157852 20248 tablet_bootstrap.cc:654] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.163676 20245 tablet_bootstrap.cc:654] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.164680 20244 tablet_bootstrap.cc:654] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.175829 20245 tablet_bootstrap.cc:492] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.176433 20245 ts_tablet_manager.cc:1403] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:20:10.179389 20245 raft_consensus.cc:359] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.180274 20245 raft_consensus.cc:385] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.180652 20245 raft_consensus.cc:740] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.181564 20245 consensus_queue.cc:260] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.183635 20245 ts_tablet_manager.cc:1434] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:20:10.184789 20245 tablet_bootstrap.cc:492] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.191330 20245 tablet_bootstrap.cc:654] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.203256 20245 tablet_bootstrap.cc:492] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.203896 20245 ts_tablet_manager.cc:1403] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:20:10.206984 20245 raft_consensus.cc:359] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.207913 20245 raft_consensus.cc:385] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.208283 20245 raft_consensus.cc:740] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.209081 20245 consensus_queue.cc:260] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.211815 20245 ts_tablet_manager.cc:1434] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:10.213143 20245 tablet_bootstrap.cc:492] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.219684 20245 tablet_bootstrap.cc:654] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.231395 20245 tablet_bootstrap.cc:492] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.232020 20245 ts_tablet_manager.cc:1403] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:20:10.235126 20245 raft_consensus.cc:359] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.236101 20245 raft_consensus.cc:385] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.236445 20245 raft_consensus.cc:740] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.237354 20245 consensus_queue.cc:260] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.238549 20244 tablet_bootstrap.cc:492] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.239193 20244 ts_tablet_manager.cc:1403] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.084s	user 0.032s	sys 0.048s
I20260709 13:20:10.239941 20245 ts_tablet_manager.cc:1434] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:10.241071 20245 tablet_bootstrap.cc:492] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.241204 20248 tablet_bootstrap.cc:492] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.241791 20248 ts_tablet_manager.cc:1403] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.094s	user 0.037s	sys 0.028s
I20260709 13:20:10.242774 20244 raft_consensus.cc:359] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.243670 20244 raft_consensus.cc:385] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.244022 20244 raft_consensus.cc:740] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.245013 20248 raft_consensus.cc:359] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.244969 20244 consensus_queue.cc:260] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.245807 20248 raft_consensus.cc:385] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.246160 20248 raft_consensus.cc:740] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.247108 20248 consensus_queue.cc:260] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.248170 20244 ts_tablet_manager.cc:1434] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 13:20:10.248112 20245 tablet_bootstrap.cc:654] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.249498 20244 tablet_bootstrap.cc:492] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.252900 20248 ts_tablet_manager.cc:1434] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:20:10.254304 20248 tablet_bootstrap.cc:492] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.257342 20244 tablet_bootstrap.cc:654] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.260525 20245 tablet_bootstrap.cc:492] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.261094 20245 ts_tablet_manager.cc:1403] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:20:10.261739 20248 tablet_bootstrap.cc:654] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.264227 20245 raft_consensus.cc:359] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.265082 20245 raft_consensus.cc:385] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.265400 20245 raft_consensus.cc:740] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.266440 20245 consensus_queue.cc:260] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.269083 20245 ts_tablet_manager.cc:1434] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:10.269136 20244 tablet_bootstrap.cc:492] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.269876 20244 ts_tablet_manager.cc:1403] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:20:10.270133 20248 tablet_bootstrap.cc:492] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.270141 20245 tablet_bootstrap.cc:492] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.270865 20248 ts_tablet_manager.cc:1403] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 13:20:10.273273 20244 raft_consensus.cc:359] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.274343 20244 raft_consensus.cc:385] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.274771 20244 raft_consensus.cc:740] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.273962 20248 raft_consensus.cc:359] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.275640 20244 consensus_queue.cc:260] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.276175 20248 raft_consensus.cc:385] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.276798 20248 raft_consensus.cc:740] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.279066 20244 ts_tablet_manager.cc:1434] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:10.278976 20248 consensus_queue.cc:260] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.277016 20245 tablet_bootstrap.cc:654] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.280467 20244 tablet_bootstrap.cc:492] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.281920 20250 raft_consensus.cc:493] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.282497 20250 raft_consensus.cc:515] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.283766 20232 raft_consensus.cc:493] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.284302 20232 raft_consensus.cc:515] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.284750 20250 leader_election.cc:290] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.286620 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
W20260709 13:20:10.288467 20066 leader_election.cc:343] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.290158 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.290539 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.290980 19950 raft_consensus.cc:2468] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:10.291221 20026 raft_consensus.cc:2468] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:10.290158 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.292791 20102 raft_consensus.cc:2468] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:10.293247 19917 leader_election.cc:304] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.286660 20232 leader_election.cc:290] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.294201 20164 raft_consensus.cc:2804] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.295024 20164 raft_consensus.cc:493] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.295400 20164 raft_consensus.cc:3060] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.294457 20250 raft_consensus.cc:493] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.290187 20244 tablet_bootstrap.cc:654] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.306924 20068 leader_election.cc:304] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.308727 20249 raft_consensus.cc:493] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.309437 20248 ts_tablet_manager.cc:1434] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 13:20:10.309329 20249 raft_consensus.cc:515] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.313766 20249 leader_election.cc:290] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.314536 20249 raft_consensus.cc:2804] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.314970 20249 raft_consensus.cc:493] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.315405 20249 raft_consensus.cc:3060] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.311578 20248 tablet_bootstrap.cc:492] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.319628 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.308221 20250 raft_consensus.cc:515] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.333143 20250 leader_election.cc:290] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.336710 20248 tablet_bootstrap.cc:654] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.337373 20164 raft_consensus.cc:515] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
W20260709 13:20:10.342901 20066 leader_election.cc:343] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.343925 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.344390 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.344666 20026 raft_consensus.cc:2468] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:10.353538 20164 leader_election.cc:290] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
W20260709 13:20:10.353672 20068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.238.193:32857, user_credentials={real_user=slave}} blocked reactor thread for 46872.4us
I20260709 13:20:10.346988 20066 leader_election.cc:304] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.357699 20245 tablet_bootstrap.cc:492] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.360987 20245 ts_tablet_manager.cc:1403] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.091s	user 0.025s	sys 0.041s
I20260709 13:20:10.362179 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.362459 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.363138 19952 raft_consensus.cc:2393] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18a2f1a5ce364081b1a85ae6ae575389 in current term 1: Already voted for candidate 34f61f67e27e41c9b92dd69ad761b4cb in this term.
I20260709 13:20:10.360937 20250 raft_consensus.cc:2804] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.364082 20250 raft_consensus.cc:493] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.364603 20250 raft_consensus.cc:3060] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.365846 20244 tablet_bootstrap.cc:492] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.366521 20244 ts_tablet_manager.cc:1403] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.016s
I20260709 13:20:10.367785 20249 raft_consensus.cc:515] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.369779 20244 raft_consensus.cc:359] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.370571 20244 raft_consensus.cc:385] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.370893 20244 raft_consensus.cc:740] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.369554 20245 raft_consensus.cc:359] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.371444 20245 raft_consensus.cc:385] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.371766 20244 consensus_queue.cc:260] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.372599 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.373373 20245 raft_consensus.cc:740] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.374538 20245 consensus_queue.cc:260] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.372741 20249 leader_election.cc:290] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.375285 20244 ts_tablet_manager.cc:1434] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:20:10.376509 20244 tablet_bootstrap.cc:492] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.379681 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.382441 20232 raft_consensus.cc:493] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.383872 20232 raft_consensus.cc:515] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
W20260709 13:20:10.384164 20068 leader_election.cc:343] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.384912 20068 leader_election.cc:304] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389; no voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.386840 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6611f3bd58184dd083431a9c33fc82af" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.387439 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:10.388100 19952 raft_consensus.cc:3060] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:10.388572 19917 leader_election.cc:343] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.389859 20232 leader_election.cc:290] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.391007 20263 raft_consensus.cc:2749] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:10.391255 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6611f3bd58184dd083431a9c33fc82af" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.392006 20263 raft_consensus.cc:493] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.392107 20101 raft_consensus.cc:2468] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:10.392717 20263 raft_consensus.cc:515] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
W20260709 13:20:10.393558 20066 leader_election.cc:343] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.394968 19918 leader_election.cc:304] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.398532 20232 raft_consensus.cc:2804] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.399073 20232 raft_consensus.cc:493] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.397749 20245 ts_tablet_manager.cc:1434] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 13:20:10.399528 20263 leader_election.cc:290] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.399575 20232 raft_consensus.cc:3060] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.400794 20245 tablet_bootstrap.cc:492] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.406575 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
W20260709 13:20:10.409013 20066 leader_election.cc:343] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.411867 20164 raft_consensus.cc:493] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.412739 20164 raft_consensus.cc:515] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.417336 20245 tablet_bootstrap.cc:654] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.417404 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.418334 19952 raft_consensus.cc:2468] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:10.421875 20250 raft_consensus.cc:515] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.423360 20244 tablet_bootstrap.cc:654] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.425037 20250 leader_election.cc:290] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
W20260709 13:20:10.428712 20068 leader_election.cc:343] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.429015 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.439978 20026 raft_consensus.cc:3060] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.439837 20068 leader_election.cc:304] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389; no voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.429771 20102 raft_consensus.cc:2393] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34f61f67e27e41c9b92dd69ad761b4cb in current term 1: Already voted for candidate 18a2f1a5ce364081b1a85ae6ae575389 in this term.
I20260709 13:20:10.441154 20263 raft_consensus.cc:2749] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:10.432228 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:10.444466 19952 raft_consensus.cc:2393] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18a2f1a5ce364081b1a85ae6ae575389 in current term 1: Already voted for candidate 34f61f67e27e41c9b92dd69ad761b4cb in this term.
I20260709 13:20:10.444558 19918 leader_election.cc:304] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.448019 20267 raft_consensus.cc:2749] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:10.448167 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
W20260709 13:20:10.450501 19917 leader_election.cc:343] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.453949 20248 tablet_bootstrap.cc:492] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.454682 20248 ts_tablet_manager.cc:1403] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.144s	user 0.047s	sys 0.055s
I20260709 13:20:10.454088 20244 tablet_bootstrap.cc:492] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.454598 20232 raft_consensus.cc:515] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.455681 20244 ts_tablet_manager.cc:1403] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.000s
I20260709 13:20:10.457969 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6611f3bd58184dd083431a9c33fc82af" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.458114 20248 raft_consensus.cc:359] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.458937 20248 raft_consensus.cc:385] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.459278 20248 raft_consensus.cc:740] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
W20260709 13:20:10.459718 19917 leader_election.cc:343] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.459246 20244 raft_consensus.cc:359] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.460397 20244 raft_consensus.cc:385] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.460898 20244 raft_consensus.cc:740] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.460448 20248 consensus_queue.cc:260] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.460994 20164 leader_election.cc:290] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.462186 20244 consensus_queue.cc:260] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.462604 20068 leader_election.cc:304] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.463709 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.464720 20244 ts_tablet_manager.cc:1434] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:10.467450 20244 tablet_bootstrap.cc:492] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
W20260709 13:20:10.465238 19918 leader_election.cc:343] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.468139 19918 leader_election.cc:304] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.469128 20269 raft_consensus.cc:2749] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:10.458114 20026 raft_consensus.cc:2468] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:10.471251 20248 ts_tablet_manager.cc:1434] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:20:10.472433 20248 tablet_bootstrap.cc:492] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.473229 20066 leader_election.cc:304] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.474254 20244 tablet_bootstrap.cc:654] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.474736 20232 leader_election.cc:290] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.475353 20266 raft_consensus.cc:2804] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.476126 20266 raft_consensus.cc:697] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:10.478507 20263 raft_consensus.cc:2804] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.479285 20263 raft_consensus.cc:697] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:10.480212 20248 tablet_bootstrap.cc:654] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.480358 20263 consensus_queue.cc:237] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.488466 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6611f3bd58184dd083431a9c33fc82af" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.489228 20102 raft_consensus.cc:3060] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.477304 20266 consensus_queue.cc:237] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.499910 20244 tablet_bootstrap.cc:492] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.503834 20244 ts_tablet_manager.cc:1403] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.010s
I20260709 13:20:10.503978 20245 tablet_bootstrap.cc:492] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.504705 20245 ts_tablet_manager.cc:1403] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.010s
I20260709 13:20:10.508749 20245 raft_consensus.cc:359] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.509785 20245 raft_consensus.cc:385] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.510175 20245 raft_consensus.cc:740] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.512533 20102 raft_consensus.cc:2468] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:10.511389 20245 consensus_queue.cc:260] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.521341 20245 ts_tablet_manager.cc:1434] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:20:10.522157 20245 tablet_bootstrap.cc:492] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: Bootstrap starting.
I20260709 13:20:10.518560 20244 raft_consensus.cc:359] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.523674 20244 raft_consensus.cc:385] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.523381 19918 leader_election.cc:304] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.524154 20244 raft_consensus.cc:740] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.524883 20232 raft_consensus.cc:2804] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.525589 20232 raft_consensus.cc:697] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:10.525002 20244 consensus_queue.cc:260] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.526494 20232 consensus_queue.cc:237] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.528074 20244 ts_tablet_manager.cc:1434] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:20:10.529327 20244 tablet_bootstrap.cc:492] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.531960 20271 raft_consensus.cc:493] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.532627 20271 raft_consensus.cc:515] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.532778 19850 catalog_manager.cc:5697] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.535770 20271 leader_election.cc:290] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.536015 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.536499 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.536899 19850 catalog_manager.cc:5697] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:10.537776 19994 leader_election.cc:343] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:10.538486 19993 leader_election.cc:343] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.538931 19993 leader_election.cc:304] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.540076 20271 raft_consensus.cc:2749] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:10.543628 20245 tablet_bootstrap.cc:654] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.543985 20248 tablet_bootstrap.cc:492] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.544590 20248 ts_tablet_manager.cc:1403] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.072s	user 0.040s	sys 0.023s
I20260709 13:20:10.548193 20248 raft_consensus.cc:359] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.549065 20244 tablet_bootstrap.cc:654] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.549268 20248 raft_consensus.cc:385] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.549958 20248 raft_consensus.cc:740] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.551251 20248 consensus_queue.cc:260] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.557276 20248 ts_tablet_manager.cc:1434] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:20:10.558792 20248 tablet_bootstrap.cc:492] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.561630 19851 catalog_manager.cc:5697] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.567257 20248 tablet_bootstrap.cc:654] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.594777 20248 tablet_bootstrap.cc:492] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.595666 20248 ts_tablet_manager.cc:1403] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.013s
I20260709 13:20:10.596879 20271 raft_consensus.cc:493] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.597671 20245 tablet_bootstrap.cc:492] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: No bootstrap required, opened a new log
I20260709 13:20:10.597474 20271 raft_consensus.cc:515] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.598282 20245 ts_tablet_manager.cc:1403] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.015s
I20260709 13:20:10.601452 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a975a873104f3e889b02fcf9f62304" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.598964 20248 raft_consensus.cc:359] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.603127 20248 raft_consensus.cc:385] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.603484 20248 raft_consensus.cc:740] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.603613 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a975a873104f3e889b02fcf9f62304" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.604379 20102 raft_consensus.cc:2468] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:10.604390 20248 consensus_queue.cc:260] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.603132 19952 raft_consensus.cc:2468] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:10.609726 20245 raft_consensus.cc:359] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.610564 20245 raft_consensus.cc:385] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.611312 19994 leader_election.cc:304] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.611604 20245 raft_consensus.cc:740] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.612453 20233 raft_consensus.cc:2804] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.612927 20233 raft_consensus.cc:493] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.612538 20245 consensus_queue.cc:260] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.613277 20233 raft_consensus.cc:3060] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.618534 20245 ts_tablet_manager.cc:1434] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:20:10.599732 20271 leader_election.cc:290] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.620628 20263 raft_consensus.cc:493] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.621233 20263 raft_consensus.cc:515] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.623979 20248 ts_tablet_manager.cc:1434] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.015s
I20260709 13:20:10.625322 20248 tablet_bootstrap.cc:492] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.625699 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.632010 20248 tablet_bootstrap.cc:654] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.634183 20233 raft_consensus.cc:515] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.635174 20263 leader_election.cc:290] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.636070 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.636786 20026 raft_consensus.cc:2468] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:10.637095 20233 leader_election.cc:290] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
W20260709 13:20:10.639626 20068 leader_election.cc:343] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.640233 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a975a873104f3e889b02fcf9f62304" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:10.640476 20244 tablet_bootstrap.cc:492] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.640905 19952 raft_consensus.cc:3060] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.641263 20244 ts_tablet_manager.cc:1403] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.025s
I20260709 13:20:10.643472 20066 leader_election.cc:304] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.645181 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76a975a873104f3e889b02fcf9f62304" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.645974 20102 raft_consensus.cc:3060] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.645341 20244 raft_consensus.cc:359] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.646510 20244 raft_consensus.cc:385] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.646875 20244 raft_consensus.cc:740] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.647500 20266 raft_consensus.cc:493] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.647677 20244 consensus_queue.cc:260] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.648069 20266 raft_consensus.cc:515] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.649847 20244 ts_tablet_manager.cc:1434] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:10.650254 20266 leader_election.cc:290] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.652055 20244 tablet_bootstrap.cc:492] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: Bootstrap starting.
I20260709 13:20:10.645175 20263 raft_consensus.cc:2804] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.652995 20263 raft_consensus.cc:493] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.653347 20263 raft_consensus.cc:3060] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.652053 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36d7656a11d438688c9778225551327" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.654577 19950 raft_consensus.cc:2468] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:10.655968 20068 leader_election.cc:304] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:10.656885 20266 raft_consensus.cc:2804] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.657230 20266 raft_consensus.cc:493] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.657658 20266 raft_consensus.cc:3060] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.665655 20244 tablet_bootstrap.cc:654] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.666682 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36d7656a11d438688c9778225551327" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.667464 20026 raft_consensus.cc:2468] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 0.
I20260709 13:20:10.671108 20102 raft_consensus.cc:2468] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:10.673003 19993 leader_election.cc:304] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.673691 20244 tablet_bootstrap.cc:492] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: No bootstrap required, opened a new log
I20260709 13:20:10.674301 20244 ts_tablet_manager.cc:1403] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.002s
I20260709 13:20:10.674340 20233 raft_consensus.cc:2804] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.675120 20233 raft_consensus.cc:697] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:10.676313 20233 consensus_queue.cc:237] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.677489 20232 raft_consensus.cc:493] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.678041 20232 raft_consensus.cc:515] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.680328 20232 leader_election.cc:290] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.681311 20244 raft_consensus.cc:359] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.682117 20244 raft_consensus.cc:385] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.682489 20244 raft_consensus.cc:740] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.683167 20244 consensus_queue.cc:260] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.684265 19952 raft_consensus.cc:2468] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:10.688431 20266 raft_consensus.cc:515] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.689424 20244 ts_tablet_manager.cc:1434] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:20:10.692814 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36d7656a11d438688c9778225551327" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.693568 20027 raft_consensus.cc:3060] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.694798 20263 raft_consensus.cc:515] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.695937 19950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36d7656a11d438688c9778225551327" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:10.696626 19950 raft_consensus.cc:3060] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.696823 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.697489 20102 raft_consensus.cc:2468] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:10.701375 20263 leader_election.cc:290] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.702806 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.703117 20266 leader_election.cc:290] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:10.703549 20028 raft_consensus.cc:3060] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.704078 19918 leader_election.cc:304] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:10.705051 20232 raft_consensus.cc:2804] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.705422 20232 raft_consensus.cc:493] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.705749 20232 raft_consensus.cc:3060] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.706316 20248 tablet_bootstrap.cc:492] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.706897 20248 ts_tablet_manager.cc:1403] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.044s
I20260709 13:20:10.710047 20248 raft_consensus.cc:359] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.710412 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:10.710844 20248 raft_consensus.cc:385] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.711118 19952 raft_consensus.cc:3060] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.711232 20248 raft_consensus.cc:740] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.711616 20028 raft_consensus.cc:2468] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:10.712078 20248 consensus_queue.cc:260] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.713132 20066 leader_election.cc:304] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.714121 20263 raft_consensus.cc:2804] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.714712 20248 ts_tablet_manager.cc:1434] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:20:10.715561 20263 raft_consensus.cc:697] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:10.715855 20248 tablet_bootstrap.cc:492] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.716517 20263 consensus_queue.cc:237] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.719615 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.724417 19950 raft_consensus.cc:2468] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
W20260709 13:20:10.725679 19917 leader_election.cc:343] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.723266 20248 tablet_bootstrap.cc:654] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.727376 19952 raft_consensus.cc:2468] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:10.704129 20027 raft_consensus.cc:2468] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 1.
I20260709 13:20:10.729113 20232 raft_consensus.cc:515] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.727702 20068 leader_election.cc:304] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:10.731101 20266 raft_consensus.cc:2804] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.731664 20266 raft_consensus.cc:697] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:10.732571 20266 consensus_queue.cc:237] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.733428 20283 raft_consensus.cc:493] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.734637 20283 raft_consensus.cc:515] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.735344 20248 tablet_bootstrap.cc:492] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.735953 20248 ts_tablet_manager.cc:1403] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:20:10.739003 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.740252 19952 raft_consensus.cc:2393] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9546bd6ddc2147858b89b365976682f6 in current term 1: Already voted for candidate 18a2f1a5ce364081b1a85ae6ae575389 in this term.
I20260709 13:20:10.740084 20248 raft_consensus.cc:359] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.741179 20248 raft_consensus.cc:385] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.741569 20248 raft_consensus.cc:740] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.742697 20248 consensus_queue.cc:260] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.745152 20248 ts_tablet_manager.cc:1434] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:10.745592 20283 leader_election.cc:290] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.746222 20248 tablet_bootstrap.cc:492] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: Bootstrap starting.
I20260709 13:20:10.746796 19848 catalog_manager.cc:5697] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.747696 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.749297 19993 leader_election.cc:304] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.750590 20283 raft_consensus.cc:3060] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.751803 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.752127 20232 leader_election.cc:290] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
W20260709 13:20:10.753386 19917 leader_election.cc:343] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:10.757786 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.758297 20248 tablet_bootstrap.cc:654] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:10.758546 20102 raft_consensus.cc:3060] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.761703 20283 raft_consensus.cc:2749] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:10.764724 20232 raft_consensus.cc:493] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.765362 20232 raft_consensus.cc:515] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.768699 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6" is_pre_election: true
I20260709 13:20:10.769364 20232 leader_election.cc:290] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.768815 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.769598 20027 raft_consensus.cc:2468] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:10.770203 20101 raft_consensus.cc:2468] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 0.
I20260709 13:20:10.771275 19917 leader_election.cc:304] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.771713 20102 raft_consensus.cc:2468] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:10.772172 20232 raft_consensus.cc:2804] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.767323 19850 catalog_manager.cc:5697] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.773263 19918 leader_election.cc:304] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.774421 20269 raft_consensus.cc:2804] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.774804 20232 raft_consensus.cc:493] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.777889 20232 raft_consensus.cc:3060] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.774972 20269 raft_consensus.cc:697] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:10.779407 20248 tablet_bootstrap.cc:492] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: No bootstrap required, opened a new log
I20260709 13:20:10.779997 20248 ts_tablet_manager.cc:1403] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.015s
I20260709 13:20:10.779596 20269 consensus_queue.cc:237] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.783263 20233 raft_consensus.cc:493] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.783851 20233 raft_consensus.cc:515] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.786278 20233 leader_election.cc:290] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.786119 19848 catalog_manager.cc:5697] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 1 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:10.786630 20232 raft_consensus.cc:515] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.787533 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:10.788259 19952 raft_consensus.cc:2468] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:10.788364 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:10.789158 20102 raft_consensus.cc:2468] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 0.
I20260709 13:20:10.789606 19994 leader_election.cc:304] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.783035 20248 raft_consensus.cc:359] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.790938 20248 raft_consensus.cc:385] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:10.791381 20248 raft_consensus.cc:740] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Initialized, Role: FOLLOWER
I20260709 13:20:10.791487 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.792131 20027 raft_consensus.cc:3060] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.792351 20248 consensus_queue.cc:260] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.790855 20233 raft_consensus.cc:2804] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:10.793335 20233 raft_consensus.cc:493] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.793684 20233 raft_consensus.cc:3060] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.794862 20248 ts_tablet_manager.cc:1434] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:20:10.794734 20232 leader_election.cc:290] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.799105 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.799822 20102 raft_consensus.cc:3060] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.803102 20233 raft_consensus.cc:515] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.805393 20027 raft_consensus.cc:2468] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:10.806151 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:10.806921 19952 raft_consensus.cc:3060] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.809460 19917 leader_election.cc:304] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.809782 20102 raft_consensus.cc:2468] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 1.
I20260709 13:20:10.810959 20269 raft_consensus.cc:2804] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.810916 19850 catalog_manager.cc:5697] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.811702 20269 raft_consensus.cc:697] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:10.813221 20269 consensus_queue.cc:237] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.815992 19952 raft_consensus.cc:2468] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:10.817322 20233 leader_election.cc:290] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.817559 19994 leader_election.cc:304] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.818538 20233 raft_consensus.cc:2804] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:10.819618 20233 raft_consensus.cc:697] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:10.820613 20233 consensus_queue.cc:237] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.818569 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.822736 20102 raft_consensus.cc:3060] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:10.828683 19848 catalog_manager.cc:5697] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 1 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.831713 19850 catalog_manager.cc:5697] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 1 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:10.832119 20102 raft_consensus.cc:2468] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 1.
I20260709 13:20:10.860987 20102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c442c315bb374c638ff04245855dccac"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
mode: GRACEFUL
new_leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:41556
I20260709 13:20:10.861511 20102 raft_consensus.cc:606] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Received request to transfer leadership to TS 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.866714 20102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
mode: GRACEFUL
new_leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:41556
I20260709 13:20:10.867242 20102 raft_consensus.cc:606] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Received request to transfer leadership to TS 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.875403 20027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
mode: GRACEFUL
new_leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:41608
I20260709 13:20:10.875974 20027 raft_consensus.cc:606] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Received request to transfer leadership to TS 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:10.881669 20102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
mode: GRACEFUL
new_leader_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41556
I20260709 13:20:10.882185 20102 raft_consensus.cc:606] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Received request to transfer leadership to TS 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.887382 19952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
mode: GRACEFUL
new_leader_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:20:10.887943 19952 raft_consensus.cc:606] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Received request to transfer leadership to TS 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.892274 20266 consensus_queue.cc:1048] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:10.893906 19952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
mode: GRACEFUL
new_leader_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:20:10.894843 19952 raft_consensus.cc:606] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Received request to transfer leadership to TS 9546bd6ddc2147858b89b365976682f6
I20260709 13:20:10.901865 20250 raft_consensus.cc:993] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: : Instructing follower 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:10.902498 20250 raft_consensus.cc:1081] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Signalling peer 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:10.905608 19952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c442c315bb374c638ff04245855dccac"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:45404
I20260709 13:20:10.906222 19952 raft_consensus.cc:493] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.906698 19952 raft_consensus.cc:3060] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:10.912834 19952 raft_consensus.cc:515] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.913862 19950 raft_consensus.cc:1240] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Rejecting Update request from peer 18a2f1a5ce364081b1a85ae6ae575389 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:10.914595 20266 consensus_queue.cc:1048] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:10.915783 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:10.916437 20027 raft_consensus.cc:3060] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:10.918390 20266 consensus_queue.cc:1059] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:10.919626 20249 raft_consensus.cc:3055] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:10.919713 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c442c315bb374c638ff04245855dccac" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:10.920054 20249 raft_consensus.cc:740] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:10.920768 19952 leader_election.cc:290] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:10.921164 20249 consensus_queue.cc:260] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.922267 20249 raft_consensus.cc:3060] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:10.925041 20027 raft_consensus.cc:2468] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:10.926103 20026 raft_consensus.cc:1240] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Rejecting Update request from peer 18a2f1a5ce364081b1a85ae6ae575389 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:20:10.926712 19917 leader_election.cc:304] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:10.927671 20269 raft_consensus.cc:2804] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:10.928232 20269 raft_consensus.cc:697] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:10.929072 20269 consensus_queue.cc:237] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:10.938365 20102 raft_consensus.cc:2468] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:10.993570 20026 raft_consensus.cc:3060] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:11.009549 19848 catalog_manager.cc:5697] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 1 to 2, leader changed from 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195) to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 2 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.019881 20269 consensus_queue.cc:1048] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.037935 20266 consensus_queue.cc:1048] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.041806 20266 consensus_queue.cc:1048] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.054108 20266 raft_consensus.cc:993] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: : Instructing follower 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:11.060268 20263 raft_consensus.cc:1081] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Signalling peer 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:11.065070 19950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:45404
I20260709 13:20:11.081419 19950 raft_consensus.cc:493] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.081964 19950 raft_consensus.cc:3060] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.094189 20269 consensus_queue.cc:1048] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.108644 20283 consensus_queue.cc:1048] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.112788 19950 raft_consensus.cc:515] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.135569 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:11.136538 20027 raft_consensus.cc:3060] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.140597 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e802e4fc9548e6b88371336ef54b29" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:11.141418 20101 raft_consensus.cc:3055] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.141775 20101 raft_consensus.cc:740] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:11.142663 20266 consensus_queue.cc:1048] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.142900 20101 consensus_queue.cc:260] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.142742 19950 leader_election.cc:290] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:11.144235 20101 raft_consensus.cc:3060] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.154381 20027 raft_consensus.cc:2468] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:11.156100 19917 leader_election.cc:304] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:11.157207 20269 raft_consensus.cc:2804] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.157713 20269 raft_consensus.cc:697] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:11.159086 20269 consensus_queue.cc:237] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.160001 20101 raft_consensus.cc:2468] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:11.178587 20233 consensus_queue.cc:1048] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.180119 20233 raft_consensus.cc:493] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.179596 19847 catalog_manager.cc:5697] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 1 to 2, leader changed from 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195) to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 2 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.180904 20233 raft_consensus.cc:515] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.183617 20233 leader_election.cc:290] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:11.189579 19953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" is_pre_election: true
I20260709 13:20:11.196874 20266 consensus_queue.cc:1048] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:11.213228 20266 consensus_queue.cc:1048] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.214079 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389" is_pre_election: true
I20260709 13:20:11.223592 20101 raft_consensus.cc:2393] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9546bd6ddc2147858b89b365976682f6 in current term 1: Already voted for candidate 34f61f67e27e41c9b92dd69ad761b4cb in this term.
I20260709 13:20:11.226048 19993 leader_election.cc:304] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:11.227355 20283 raft_consensus.cc:3060] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:11.240275 20266 consensus_queue.cc:1048] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.242331 20283 raft_consensus.cc:2749] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:11.246683 20249 raft_consensus.cc:993] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: : Instructing follower 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:11.248600 20249 raft_consensus.cc:1081] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Signalling peer 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:11.254599 20028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41604
I20260709 13:20:11.255267 20028 raft_consensus.cc:493] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.255705 20028 raft_consensus.cc:3060] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.264181 20028 raft_consensus.cc:515] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.267755 20028 leader_election.cc:290] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:11.268878 20102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:11.269609 20102 raft_consensus.cc:3055] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.269894 20102 raft_consensus.cc:740] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:11.270920 20102 consensus_queue.cc:260] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.272037 20102 raft_consensus.cc:3060] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.278879 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5178ad636bbd433c9583b0d40f23cace" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:11.280373 20102 raft_consensus.cc:2468] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:11.281692 19993 leader_election.cc:304] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 34f61f67e27e41c9b92dd69ad761b4cb
I20260709 13:20:11.283027 20283 raft_consensus.cc:2804] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.283535 20283 raft_consensus.cc:697] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:11.284595 20283 consensus_queue.cc:237] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.292249 20283 consensus_queue.cc:1048] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:11.294485 19848 catalog_manager.cc:5697] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 1 to 2, leader changed from 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195) to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.299907 20307 consensus_queue.cc:1048] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.314725 20269 raft_consensus.cc:993] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: : Instructing follower 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:11.315315 20269 raft_consensus.cc:1081] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Signalling peer 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:11.317497 20271 consensus_queue.cc:1048] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:11.318472 20027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41590
I20260709 13:20:11.319265 20027 raft_consensus.cc:493] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.319676 20027 raft_consensus.cc:3060] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.324258 20269 consensus_queue.cc:1048] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.330580 20307 consensus_queue.cc:1048] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:11.332415 20027 raft_consensus.cc:515] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.333631 20028 raft_consensus.cc:1240] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Rejecting Update request from peer 34f61f67e27e41c9b92dd69ad761b4cb for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:11.336040 20307 consensus_queue.cc:1059] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:11.338562 20232 raft_consensus.cc:3055] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.339074 20232 raft_consensus.cc:740] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:11.339178 20027 leader_election.cc:290] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:11.339450 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:11.340036 20232 consensus_queue.cc:260] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.341153 20232 raft_consensus.cc:3060] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.353528 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5bbcac6ac44d35bb02ed3138d5e48a" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:11.358526 20269 raft_consensus.cc:993] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: : Instructing follower 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:11.359160 20269 raft_consensus.cc:1081] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Signalling peer 9546bd6ddc2147858b89b365976682f6 to start an election
I20260709 13:20:11.364548 20027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
 from {username='slave'} at 127.0.0.1:41590
I20260709 13:20:11.364845 20233 raft_consensus.cc:993] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: : Instructing follower 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:11.365375 20233 raft_consensus.cc:1081] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Signalling peer 34f61f67e27e41c9b92dd69ad761b4cb to start an election
I20260709 13:20:11.366066 20027 raft_consensus.cc:493] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.366559 20027 raft_consensus.cc:3060] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.370672 19950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
 from {username='slave'} at 127.0.0.1:45400
I20260709 13:20:11.371409 19950 raft_consensus.cc:493] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.371794 19950 raft_consensus.cc:3060] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.374925 20027 raft_consensus.cc:515] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.380256 19952 raft_consensus.cc:2468] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:11.380517 20232 consensus_queue.cc:1048] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.381417 20101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:11.382009 20101 raft_consensus.cc:3060] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.380337 19950 raft_consensus.cc:515] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.383452 19994 leader_election.cc:304] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 18a2f1a5ce364081b1a85ae6ae575389
I20260709 13:20:11.384370 20283 raft_consensus.cc:2804] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.384850 20283 raft_consensus.cc:697] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:11.385070 20026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:11.385741 20026 raft_consensus.cc:3055] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.386093 20026 raft_consensus.cc:740] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:11.385830 20283 consensus_queue.cc:237] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.387073 20026 consensus_queue.cc:260] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.388228 20026 raft_consensus.cc:3060] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.389556 20101 raft_consensus.cc:2468] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:11.390386 20102 raft_consensus.cc:1240] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Rejecting Update request from peer 34f61f67e27e41c9b92dd69ad761b4cb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:20:11.390774 19950 leader_election.cc:290] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Requested vote from peers 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:11.391093 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc47f944485f42d4ac7c6a25dbadba34" candidate_uuid: "9546bd6ddc2147858b89b365976682f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:11.391716 19952 raft_consensus.cc:3055] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.392023 19952 raft_consensus.cc:740] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:11.392517 20100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a6fce64a2b4ce6a4fd04dd26c3b1e5" candidate_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
I20260709 13:20:11.393178 20100 raft_consensus.cc:3060] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.393069 19952 consensus_queue.cc:260] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.394126 19952 raft_consensus.cc:3060] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.394942 20027 leader_election.cc:290] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195:35917)
I20260709 13:20:11.397311 19993 leader_election.cc:304] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:11.397981 20026 raft_consensus.cc:2468] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:11.398259 20283 raft_consensus.cc:2804] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.398927 20283 raft_consensus.cc:697] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Becoming Leader. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:11.399914 20283 consensus_queue.cc:237] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.400672 19850 catalog_manager.cc:5697] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 1 to 2, leader changed from 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193) to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.403803 19917 leader_election.cc:304] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34f61f67e27e41c9b92dd69ad761b4cb, 9546bd6ddc2147858b89b365976682f6; no voters: 
I20260709 13:20:11.404812 20232 raft_consensus.cc:2804] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.405370 20232 raft_consensus.cc:697] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Becoming Leader. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:11.406155 19952 raft_consensus.cc:2468] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9546bd6ddc2147858b89b365976682f6 in term 2.
I20260709 13:20:11.406426 20232 consensus_queue.cc:237] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:11.404812 20100 raft_consensus.cc:2468] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34f61f67e27e41c9b92dd69ad761b4cb in term 2.
I20260709 13:20:11.414748 19850 catalog_manager.cc:5697] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb reported cstate change: term changed from 1 to 2, leader changed from 9546bd6ddc2147858b89b365976682f6 (127.8.238.194) to 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193). New cstate: current_term: 2 leader_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.417379 19847 catalog_manager.cc:5697] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 reported cstate change: term changed from 1 to 2, leader changed from 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193) to 9546bd6ddc2147858b89b365976682f6 (127.8.238.194). New cstate: current_term: 2 leader_uuid: "9546bd6ddc2147858b89b365976682f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.420207 20027 raft_consensus.cc:1275] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.421780 20232 consensus_queue.cc:1048] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:11.426937 20100 raft_consensus.cc:1275] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.429287 20232 consensus_queue.cc:1048] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.676147 19952 raft_consensus.cc:3060] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.681717 19952 raft_consensus.cc:1275] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.683089 20283 consensus_queue.cc:1048] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.692797 20100 raft_consensus.cc:1275] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.694348 20271 consensus_queue.cc:1048] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.716476 20100 raft_consensus.cc:1275] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.718775 20232 consensus_queue.cc:1048] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.727418 20027 raft_consensus.cc:1275] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.728860 20307 consensus_queue.cc:1048] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.775956 20100 raft_consensus.cc:3060] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.781912 20100 raft_consensus.cc:1275] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.783337 20283 consensus_queue.cc:1048] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.784711 19950 raft_consensus.cc:1275] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.786350 20283 consensus_queue.cc:1048] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.806722 19952 raft_consensus.cc:1275] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.808238 20101 raft_consensus.cc:1275] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 9546bd6ddc2147858b89b365976682f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.810434 20233 consensus_queue.cc:1048] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:11.820013 20283 consensus_queue.cc:1048] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.858157 20101 raft_consensus.cc:1275] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.859421 20307 consensus_queue.cc:1048] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:11.867473 20027 raft_consensus.cc:1275] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 34f61f67e27e41c9b92dd69ad761b4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:11.869303 20164 consensus_queue.cc:1048] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:13.908764 19848 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40920:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:13.930687 19848 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40920:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:14.012247  9147 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:14.064680 20341 log.cc:927] Time spent T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:14.092157 20354 tablet.cc:1724] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.143962 20354 tablet.cc:1724] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:14.147814 20338 log.cc:927] Time spent T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: Append to log took a long time: real 0.105s	user 0.002s	sys 0.003s
W20260709 13:20:14.158578 20353 log.cc:927] Time spent T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: Append to log took a long time: real 0.103s	user 0.002s	sys 0.003s
I20260709 13:20:14.233260 20363 tablet.cc:1724] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.242385 20357 tablet.cc:1724] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.293998 20359 tablet.cc:1724] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:14.302341 20361 log.cc:927] Time spent T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.003s
W20260709 13:20:14.273059 19917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.238.194:37451, user_credentials={real_user=slave}} blocked reactor thread for 52567.6us
W20260709 13:20:14.306818 20368 log.cc:927] Time spent T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
W20260709 13:20:14.341862 20364 log.cc:927] Time spent T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: Append to log took a long time: real 0.135s	user 0.002s	sys 0.000s
I20260709 13:20:14.344051 20380 tablet.cc:1724] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:14.360855 20370 log.cc:927] Time spent T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
I20260709 13:20:14.326969 20354 tablet.cc:1724] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.396682 20389 tablet.cc:1724] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.393596 20388 tablet.cc:1724] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:14.431205 20377 log.cc:927] Time spent T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:20:14.429807 20392 tablet.cc:1724] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.467314 19953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b"
dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
mode: GRACEFUL
new_leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
 from {username='slave'} at 127.0.0.1:40426
I20260709 13:20:14.468375 19953 raft_consensus.cc:606] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Received request to transfer leadership to TS 18a2f1a5ce364081b1a85ae6ae575389
I20260709 13:20:14.474576 20391 tablet.cc:1724] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.426383 20354 tablet.cc:1724] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.483891 20385 tablet.cc:1724] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.431983 20357 tablet.cc:1724] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:14.496465 20383 log.cc:927] Time spent T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:20:14.502090 20381 log.cc:927] Time spent T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:20:14.503461 20390 tablet.cc:1724] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.515627 20363 tablet.cc:1724] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.523013 20359 tablet.cc:1724] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.479360 20380 tablet.cc:1724] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.536592 20392 tablet.cc:1724] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.544693 20389 tablet.cc:1724] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.551172 20164 raft_consensus.cc:993] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: : Instructing follower 18a2f1a5ce364081b1a85ae6ae575389 to start an election
I20260709 13:20:14.551966 20164 raft_consensus.cc:1081] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Signalling peer 18a2f1a5ce364081b1a85ae6ae575389 to start an election
I20260709 13:20:14.554342 20095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
 from {username='slave'} at 127.0.0.1:41548
I20260709 13:20:14.555030 20095 raft_consensus.cc:493] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.555517 20095 raft_consensus.cc:3060] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.533895 20388 tablet.cc:1724] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.568135 20392 tablet.cc:1724] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.571748 20357 tablet.cc:1724] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.573585 20095 raft_consensus.cc:515] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:14.577427 20363 tablet.cc:1724] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.574635 20391 tablet.cc:1724] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.584017 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:14.584736 19952 raft_consensus.cc:3055] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.585032 19952 raft_consensus.cc:740] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34f61f67e27e41c9b92dd69ad761b4cb, State: Running, Role: LEADER
I20260709 13:20:14.586659 20027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e01524b4a41406da7b9493bf1dd764b" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:14.587359 20027 raft_consensus.cc:3060] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.586866 20395 tablet.cc:1724] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.585886 19952 consensus_queue.cc:260] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:14.593209 19952 raft_consensus.cc:3060] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.592180 20388 tablet.cc:1724] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:14.616495 19952 raft_consensus.cc:2468] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 2.
I20260709 13:20:14.615695 20095 leader_election.cc:290] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:14.618534 20068 leader_election.cc:304] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:14.618199 20027 raft_consensus.cc:2468] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 2.
I20260709 13:20:14.620052 20376 raft_consensus.cc:2804] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.620569 20376 raft_consensus.cc:697] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:14.621428 20376 consensus_queue.cc:237] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:14.638684 20027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb"
dest_uuid: "9546bd6ddc2147858b89b365976682f6"
mode: GRACEFUL
new_leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
 from {username='slave'} at 127.0.0.1:57570
I20260709 13:20:14.639508 20027 raft_consensus.cc:606] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Received request to transfer leadership to TS 18a2f1a5ce364081b1a85ae6ae575389
I20260709 13:20:14.644328 20322 raft_consensus.cc:993] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: : Instructing follower 18a2f1a5ce364081b1a85ae6ae575389 to start an election
I20260709 13:20:14.644853 20322 raft_consensus.cc:1081] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Signalling peer 18a2f1a5ce364081b1a85ae6ae575389 to start an election
I20260709 13:20:14.645391  9147 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:14.646135  9147 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:14.646765 20102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb"
dest_uuid: "18a2f1a5ce364081b1a85ae6ae575389"
 from {username='slave'} at 127.0.0.1:41534
I20260709 13:20:14.647382 20102 raft_consensus.cc:493] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.647732 20102 raft_consensus.cc:3060] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.660763 20102 raft_consensus.cc:515] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:14.663517 19952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34f61f67e27e41c9b92dd69ad761b4cb"
I20260709 13:20:14.664197 19952 raft_consensus.cc:3060] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.663626 20102 leader_election.cc:290] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 2 election: Requested vote from peers 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857), 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451)
I20260709 13:20:14.668706 20028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f66de555f64570b49f91b446698cfb" candidate_uuid: "18a2f1a5ce364081b1a85ae6ae575389" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9546bd6ddc2147858b89b365976682f6"
I20260709 13:20:14.669404 20028 raft_consensus.cc:3055] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.669757 20028 raft_consensus.cc:740] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9546bd6ddc2147858b89b365976682f6, State: Running, Role: LEADER
I20260709 13:20:14.672581 19848 catalog_manager.cc:5697] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 1 to 2, leader changed from 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193) to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:14.674036 19952 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 2.
I20260709 13:20:14.675580 20068 leader_election.cc:304] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18a2f1a5ce364081b1a85ae6ae575389, 34f61f67e27e41c9b92dd69ad761b4cb; no voters: 
I20260709 13:20:14.677876 20376 raft_consensus.cc:2804] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.677486 20028 consensus_queue.cc:260] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:14.678473 20376 raft_consensus.cc:697] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 LEADER]: Becoming Leader. State: Replica: 18a2f1a5ce364081b1a85ae6ae575389, State: Running, Role: LEADER
I20260709 13:20:14.679455 20028 raft_consensus.cc:3060] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.679455 20376 consensus_queue.cc:237] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } }
I20260709 13:20:14.690142 20028 raft_consensus.cc:2468] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18a2f1a5ce364081b1a85ae6ae575389 in term 2.
I20260709 13:20:14.691805 19847 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944: soft_deleted_table [id=0db8055251b647ef8a4677cd8f86ab84] alter complete (version 1)
I20260709 13:20:14.703528 19848 catalog_manager.cc:5697] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 reported cstate change: term changed from 1 to 2, leader changed from 9546bd6ddc2147858b89b365976682f6 (127.8.238.194) to 18a2f1a5ce364081b1a85ae6ae575389 (127.8.238.195). New cstate: current_term: 2 leader_uuid: "18a2f1a5ce364081b1a85ae6ae575389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18a2f1a5ce364081b1a85ae6ae575389" member_type: VOTER last_known_addr { host: "127.8.238.195" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:15.038163 20028 raft_consensus.cc:1275] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 18a2f1a5ce364081b1a85ae6ae575389: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.039634 20376 consensus_queue.cc:1048] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.050765 19952 raft_consensus.cc:1275] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 18a2f1a5ce364081b1a85ae6ae575389: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.052070 20319 consensus_queue.cc:1048] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.070701 19952 raft_consensus.cc:1275] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Refusing update from remote peer 18a2f1a5ce364081b1a85ae6ae575389: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.071887 20404 consensus_queue.cc:1048] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34f61f67e27e41c9b92dd69ad761b4cb" member_type: VOTER last_known_addr { host: "127.8.238.193" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.081192 20027 raft_consensus.cc:1275] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Refusing update from remote peer 18a2f1a5ce364081b1a85ae6ae575389: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.083303 20376 consensus_queue.cc:1048] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9546bd6ddc2147858b89b365976682f6" member_type: VOTER last_known_addr { host: "127.8.238.194" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.713474  9147 tablet_server.cc:179] TabletServer@127.8.238.193:0 shutting down...
I20260709 13:20:15.741664  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:15.742550  9147 tablet_replica.cc:333] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.743356  9147 raft_consensus.cc:2243] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.743888  9147 raft_consensus.cc:2272] T cd5bbcac6ac44d35bb02ed3138d5e48a P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.746140  9147 tablet_replica.cc:333] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.746809  9147 raft_consensus.cc:2243] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.747303  9147 raft_consensus.cc:2272] T e36d7656a11d438688c9778225551327 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.749899  9147 tablet_replica.cc:333] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.750732  9147 raft_consensus.cc:2243] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.751438  9147 raft_consensus.cc:2272] T 76a975a873104f3e889b02fcf9f62304 P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.753610  9147 tablet_replica.cc:333] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.754328  9147 raft_consensus.cc:2243] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.755076  9147 raft_consensus.cc:2272] T 35e802e4fc9548e6b88371336ef54b29 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.757112  9147 tablet_replica.cc:333] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.757622  9147 raft_consensus.cc:2243] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.758015  9147 raft_consensus.cc:2272] T dc47f944485f42d4ac7c6a25dbadba34 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.760099  9147 tablet_replica.cc:333] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.760660  9147 raft_consensus.cc:2243] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.761425  9147 raft_consensus.cc:2272] T 6611f3bd58184dd083431a9c33fc82af P 34f61f67e27e41c9b92dd69ad761b4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.763615  9147 tablet_replica.cc:333] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.764123  9147 raft_consensus.cc:2243] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.764837  9147 raft_consensus.cc:2272] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.767096  9147 tablet_replica.cc:333] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.767669  9147 raft_consensus.cc:2243] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.768375  9147 raft_consensus.cc:2272] T c442c315bb374c638ff04245855dccac P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.770550  9147 tablet_replica.cc:333] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.771054  9147 raft_consensus.cc:2243] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.771514  9147 raft_consensus.cc:2272] T 632c499909bd48f2836598260d33004b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.773716  9147 tablet_replica.cc:333] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.774515  9147 raft_consensus.cc:2243] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.775175  9147 raft_consensus.cc:2272] T a2f66de555f64570b49f91b446698cfb P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.779036  9147 tablet_replica.cc:333] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.779865  9147 raft_consensus.cc:2243] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.781164  9147 raft_consensus.cc:2272] T 1c53b2b53b6144c99631755134ca70c5 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:15.782374 19994 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:20:15.784513  9147 tablet_replica.cc:333] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.785369  9147 raft_consensus.cc:2243] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:20:15.785593 19994 consensus_peers.cc:597] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 -> Peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Couldn't send request to peer 34f61f67e27e41c9b92dd69ad761b4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:15.786474  9147 raft_consensus.cc:2272] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.788820  9147 tablet_replica.cc:333] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.789465  9147 raft_consensus.cc:2243] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.790485  9147 raft_consensus.cc:2272] T 5d3f39f1916f434d849327102830b59b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.792842  9147 tablet_replica.cc:333] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.793429  9147 raft_consensus.cc:2243] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.793936  9147 raft_consensus.cc:2272] T 2c10ed239c5b4328a1a2576042da5cf7 P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.796324  9147 tablet_replica.cc:333] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.796887  9147 raft_consensus.cc:2243] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.797375  9147 raft_consensus.cc:2272] T 11fdfa289eda40e39e5605eef766852d P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.799554  9147 tablet_replica.cc:333] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.800118  9147 raft_consensus.cc:2243] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.800581  9147 raft_consensus.cc:2272] T 5178ad636bbd433c9583b0d40f23cace P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.802884  9147 tablet_replica.cc:333] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.803596  9147 raft_consensus.cc:2243] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.804263  9147 raft_consensus.cc:2272] T aecfe968bb7741a8aa4e39cc49bf0e2e P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.806867  9147 tablet_replica.cc:333] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb: stopping tablet replica
I20260709 13:20:15.807349  9147 raft_consensus.cc:2243] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.807723  9147 raft_consensus.cc:2272] T 4e01524b4a41406da7b9493bf1dd764b P 34f61f67e27e41c9b92dd69ad761b4cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:15.820384 19994 consensus_peers.cc:597] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 -> Peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Couldn't send request to peer 34f61f67e27e41c9b92dd69ad761b4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:15.853932  9147 tablet_server.cc:196] TabletServer@127.8.238.193:0 shutdown complete.
I20260709 13:20:15.892143  9147 tablet_server.cc:179] TabletServer@127.8.238.194:0 shutting down...
W20260709 13:20:15.923143 20066 consensus_peers.cc:597] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 -> Peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Couldn't send request to peer 9546bd6ddc2147858b89b365976682f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:15.926782  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:15.927645  9147 tablet_replica.cc:333] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.928772  9147 raft_consensus.cc:2243] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.929661  9147 raft_consensus.cc:2272] T dc47f944485f42d4ac7c6a25dbadba34 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.931739  9147 tablet_replica.cc:333] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.932279  9147 raft_consensus.cc:2243] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.932670  9147 raft_consensus.cc:2272] T 6611f3bd58184dd083431a9c33fc82af P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.934798  9147 tablet_replica.cc:333] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.935433  9147 raft_consensus.cc:2243] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.936156  9147 raft_consensus.cc:2272] T cd5bbcac6ac44d35bb02ed3138d5e48a P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.938043  9147 tablet_replica.cc:333] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.938651  9147 raft_consensus.cc:2243] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.939069  9147 raft_consensus.cc:2272] T e36d7656a11d438688c9778225551327 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.941171  9147 tablet_replica.cc:333] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.941758  9147 raft_consensus.cc:2243] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.942154  9147 raft_consensus.cc:2272] T 35e802e4fc9548e6b88371336ef54b29 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.944183  9147 tablet_replica.cc:333] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.944725  9147 raft_consensus.cc:2243] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.945117  9147 raft_consensus.cc:2272] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.947206  9147 tablet_replica.cc:333] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.947723  9147 raft_consensus.cc:2243] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.948125  9147 raft_consensus.cc:2272] T c442c315bb374c638ff04245855dccac P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.950058  9147 tablet_replica.cc:333] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.950657  9147 raft_consensus.cc:2243] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.951417  9147 raft_consensus.cc:2272] T aecfe968bb7741a8aa4e39cc49bf0e2e P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.953648  9147 tablet_replica.cc:333] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.954198  9147 raft_consensus.cc:2243] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.955029  9147 raft_consensus.cc:2272] T 5178ad636bbd433c9583b0d40f23cace P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.956981  9147 tablet_replica.cc:333] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.957499  9147 raft_consensus.cc:2243] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.958192  9147 raft_consensus.cc:2272] T 76a975a873104f3e889b02fcf9f62304 P 9546bd6ddc2147858b89b365976682f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.960345  9147 tablet_replica.cc:333] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.960843  9147 raft_consensus.cc:2243] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.961627  9147 raft_consensus.cc:2272] T 632c499909bd48f2836598260d33004b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.963771  9147 tablet_replica.cc:333] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.964272  9147 raft_consensus.cc:2243] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.964676  9147 raft_consensus.cc:2272] T a2f66de555f64570b49f91b446698cfb P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.967429  9147 tablet_replica.cc:333] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.967999  9147 raft_consensus.cc:2243] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.968437  9147 raft_consensus.cc:2272] T 2c10ed239c5b4328a1a2576042da5cf7 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.970482  9147 tablet_replica.cc:333] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.970963  9147 raft_consensus.cc:2243] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:15.971725  9147 raft_consensus.cc:2272] T 11fdfa289eda40e39e5605eef766852d P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.973769  9147 tablet_replica.cc:333] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.974387  9147 raft_consensus.cc:2243] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.974903  9147 raft_consensus.cc:2272] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.977192  9147 tablet_replica.cc:333] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.977712  9147 raft_consensus.cc:2243] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.978206  9147 raft_consensus.cc:2272] T 1c53b2b53b6144c99631755134ca70c5 P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.980461  9147 tablet_replica.cc:333] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.980969  9147 raft_consensus.cc:2243] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.981401  9147 raft_consensus.cc:2272] T 4e01524b4a41406da7b9493bf1dd764b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:15.984058  9147 tablet_replica.cc:333] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6: stopping tablet replica
I20260709 13:20:15.984586  9147 raft_consensus.cc:2243] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:15.985050  9147 raft_consensus.cc:2272] T 5d3f39f1916f434d849327102830b59b P 9546bd6ddc2147858b89b365976682f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:16.006327 20066 consensus_peers.cc:597] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 -> Peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Couldn't send request to peer 9546bd6ddc2147858b89b365976682f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.026738  9147 tablet_server.cc:196] TabletServer@127.8.238.194:0 shutdown complete.
W20260709 13:20:16.049909 20066 consensus_peers.cc:597] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 -> Peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Couldn't send request to peer 9546bd6ddc2147858b89b365976682f6. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:16.063580 20068 consensus_peers.cc:597] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 -> Peer 34f61f67e27e41c9b92dd69ad761b4cb (127.8.238.193:32857): Couldn't send request to peer 34f61f67e27e41c9b92dd69ad761b4cb. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.193:32857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.065295  9147 tablet_server.cc:179] TabletServer@127.8.238.195:0 shutting down...
W20260709 13:20:16.073096 20066 consensus_peers.cc:597] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 -> Peer 9546bd6ddc2147858b89b365976682f6 (127.8.238.194:37451): Couldn't send request to peer 9546bd6ddc2147858b89b365976682f6. Status: Network error: Client connection negotiation failed: client connection to 127.8.238.194:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:16.097762  9147 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:16.098670  9147 tablet_replica.cc:333] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.099382  9147 raft_consensus.cc:2243] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.099902  9147 raft_consensus.cc:2272] T 76a975a873104f3e889b02fcf9f62304 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.101915  9147 tablet_replica.cc:333] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.102638  9147 raft_consensus.cc:2243] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.103484  9147 raft_consensus.cc:2272] T e36d7656a11d438688c9778225551327 P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.105669  9147 tablet_replica.cc:333] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.106359  9147 raft_consensus.cc:2243] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.106807  9147 raft_consensus.cc:2272] T cd5bbcac6ac44d35bb02ed3138d5e48a P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.108718  9147 tablet_replica.cc:333] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.109301  9147 raft_consensus.cc:2243] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.109740  9147 raft_consensus.cc:2272] T dc47f944485f42d4ac7c6a25dbadba34 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.111897  9147 tablet_replica.cc:333] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.112558  9147 raft_consensus.cc:2243] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.113111  9147 raft_consensus.cc:2272] T 6611f3bd58184dd083431a9c33fc82af P 18a2f1a5ce364081b1a85ae6ae575389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.115190  9147 tablet_replica.cc:333] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.115751  9147 raft_consensus.cc:2243] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.116247  9147 raft_consensus.cc:2272] T 04a6fce64a2b4ce6a4fd04dd26c3b1e5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.118281  9147 tablet_replica.cc:333] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.118885  9147 raft_consensus.cc:2243] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.119344  9147 raft_consensus.cc:2272] T c442c315bb374c638ff04245855dccac P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.121286  9147 tablet_replica.cc:333] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.121886  9147 raft_consensus.cc:2243] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.122421  9147 raft_consensus.cc:2272] T 632c499909bd48f2836598260d33004b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.124562  9147 tablet_replica.cc:333] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.125159  9147 raft_consensus.cc:2243] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.126065  9147 raft_consensus.cc:2272] T a2f66de555f64570b49f91b446698cfb P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.128072  9147 tablet_replica.cc:333] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.128623  9147 raft_consensus.cc:2243] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.129413  9147 raft_consensus.cc:2272] T 2c10ed239c5b4328a1a2576042da5cf7 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.131440  9147 tablet_replica.cc:333] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.131973  9147 raft_consensus.cc:2243] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.132454  9147 raft_consensus.cc:2272] T 11fdfa289eda40e39e5605eef766852d P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.134569  9147 tablet_replica.cc:333] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.135140  9147 raft_consensus.cc:2243] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.135589  9147 raft_consensus.cc:2272] T 35e802e4fc9548e6b88371336ef54b29 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.137428  9147 tablet_replica.cc:333] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.137876  9147 raft_consensus.cc:2243] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.138909  9147 raft_consensus.cc:2272] T 4e01524b4a41406da7b9493bf1dd764b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.141140  9147 tablet_replica.cc:333] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.141716  9147 raft_consensus.cc:2243] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.145087  9147 raft_consensus.cc:2272] T 1c53b2b53b6144c99631755134ca70c5 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.147442  9147 tablet_replica.cc:333] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.148021  9147 raft_consensus.cc:2243] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.148514  9147 raft_consensus.cc:2272] T 9f0ab9f129414ccaa6dbfa03f88f5340 P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.150621  9147 tablet_replica.cc:333] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.151192  9147 raft_consensus.cc:2243] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.151696  9147 raft_consensus.cc:2272] T 5178ad636bbd433c9583b0d40f23cace P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.153813  9147 tablet_replica.cc:333] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.154500  9147 raft_consensus.cc:2243] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.155025  9147 raft_consensus.cc:2272] T aecfe968bb7741a8aa4e39cc49bf0e2e P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.157112  9147 tablet_replica.cc:333] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389: stopping tablet replica
I20260709 13:20:16.157637  9147 raft_consensus.cc:2243] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:16.158133  9147 raft_consensus.cc:2272] T 5d3f39f1916f434d849327102830b59b P 18a2f1a5ce364081b1a85ae6ae575389 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.198982  9147 tablet_server.cc:196] TabletServer@127.8.238.195:0 shutdown complete.
I20260709 13:20:16.236626  9147 master.cc:562] Master@127.8.238.254:43449 shutting down...
I20260709 13:20:16.258342  9147 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:16.258886  9147 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:16.259183  9147 tablet_replica.cc:333] T 00000000000000000000000000000000 P c90c23eb32334af9a329145a54330944: stopping tablet replica
I20260709 13:20:16.279356  9147 master.cc:584] Master@127.8.238.254:43449 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11575 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26391 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (366389 ms total)
[  PASSED  ] 8 tests.
I20260709 13:20:16.338125  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 414 messages since previous log ~14 seconds ago
I20260709 13:20:16.338524  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 414 messages since previous log ~14 seconds ago
I20260709 13:20:16.338734  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 413 messages since previous log ~14 seconds ago
I20260709 13:20:16.338944  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:20:16.339154  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:20:16.339387  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~187 seconds ago
I20260709 13:20:16.339658  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:20:16.339964  9147 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
